Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[Feature]Support Alibaba DLF metastore for hive external table (StarR…
…ocks#6403) Data Lake Formation (DLF) is a key component of the cloud-native data lake framework which is widely used on Alibaba Cloud just like AWS Glue, details see https://www.alibabacloud.com/en/product/datalake-formation. This PR allows users to use DLF as metastore in Hive external table. Usage: Add a config file hive-site.xml to {FE Home DIR}/conf , with following configs: <?xml version="1.0"?> <configuration> <!--Set to use dlf client--> <property> <name>hive.metastore.type</name> <value>dlf</value> </property> <!--DLF endpoint, see https://www.alibabacloud.com/help/en/doc-detail/197608.html--> <property> <name>dlf.catalog.endpoint</name> <value>dlf-vpc.cn-beijing.aliyuncs.com</value> </property> <!--DLF region, see https://www.alibabacloud.com/help/en/doc-detail/197608.html--> <property> <name>dlf.catalog.region</name> <value>cn-beijing</value> </property> <!--Proxy mode of DLF--> <property> <name>dlf.catalog.proxyMode</name> <value>DLF_ONLY</value> </property> <!--Access Key mode of DLF--> <property> <name>dlf.catalog.akMode</name> <value>EMR_AUTO</value> </property> <!--User id of the alibaba cloud account--> <property> <name>dlf.catalog.uid</name> <value>xxxxxx</value> </property> <!--Access Key ID of DLF, can be omitted if the cluster is created with the same Alibaba Cloud account of DLF--> <property> <name>dlf.catalog.accessKeyId</name> <value>xxxxxx</value> </property> <!--Access Key secret of DLF, can be omitted if the cluster is created with the same Alibaba Cloud account of DLF--> <property> <name>dlf.catalog.accessKeySecret</name> <value>xxxxxx</value> </property> </configuration>
- Loading branch information