[EPIC] Add Spark engine support for Gravitino

[jerryshao]

Describe the proposal

This epic task tracks the work of adding Spark engine support for Gravitino.

Task list

• [Subtask] initial design of Support Gravitino in Spark #1287
• [Subtask] [spark-connector] support specifying scala version to build and test Gravitino #1530
• [Subtask] [spark-connector] Add the code skeleton for spark-connector #1528
• [Subtask] [spark-connector] query simple hive data from spark-connector #1529
• [Subtask] [spark-connector] support hive partition and bucket table #1550
• [Subtask] [spark-connector] support more spark data types #1552
• [Subtask] [spark-connector] support hive table properties #1549
• [Subtask] [spark-connector]: support CTAS and ITAS command #2402
• [Subtask] [spark-connector] support query existing view #1562
• [Subtask] [spark-connector] support namespace DDL operations #1564
• [Subtask] [spark-connector] support table DDL operations #1565
• [Subtask] [spark-connector] support passing catalog properties to spark connector #3292
• [Subtask] [spark-connector] setup a test system to cover existings spark&hive sql tests #1573
• [Subtask] [spark-connector] support querying with Hive function and UDF #1566
• [Subtask] [spark-connector] optimize read hive bucket table #1567
• [Subtask] [spark-connector] support parquet&orc vector read in hive #1568
• [Subtask] [spark-connector] support Dynamic Partition Pruning #1578
• [Subtask] [spark-connector] support hive view management #1569
• [Subtask] [spark-connector] support partition manage  #1570
• [Subtask] [spark-connector] support Iceberg catalog #1571
• [Subtask] [spark-connector] support JDBC catalog #1572
• [Subtask] [spark-connector] support multi spark&scala version  #1574

good first issues to familiar with spark-connector:

• [Improvement] spark-connector support alter namespace operation. #2401

[jerryshao]

@FANNG1 please list all your subtasks here.

[coolderli]

FYI @caican00