Skip to content

Generate create table statement, select statement, or DataFrame structure schama, and get rid of the boring work.

Notifications You must be signed in to change notification settings

barneywill/table_generator

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

table_generator

Generate create table statement, select statement, or DataFrame structure schama, and get rid of the boring work.

Generator Description
1 JsonTableGenerator Generate create table statement for Hive from JSON
2 JsonDataFrameStructureTypeGenerator Generate StructureType for DataFrame from JSON
3 MysqlTableGenerator Generate create table statement for Hive from Mysql, mapping a table in Mysql to a table in Hive
4 PostgreSQLTableGenerator Generate create table statement for Hive from Postgresql, mapping a table in Postgresql to a table in Hive
5 Hive2DorisTableGenerator Generate create table statement for Doris from Hive, mapping a table in Hive to a table in Doris
6 generate_hbase_table.sh Generate create table statement for Hive from HBase, mapping a table in HBase to an external table in Hive
7 generate_from_table.sh Generate select from statement for a table
#package
sbt package

Generate create table statement for Hive from JSON

usage : generator.JsonTableGenerator <dbName> <tableName> <json> <isNameQuoted>

Generate StructureType for DataFrame from JSON

usage : generator.JsonDataFrameStructureTypeGenerator <json>

Generate create table statement for Hive from Mysql, mapping a table in Mysql to a table in Hive

usage : generator.MysqlTableGenerator <mysqlUrl> <mysqlUser> <mysqlPassword> <hiveDb> <mysqlDb> <mysqlTable> <timeColumn>

Generate create table statement for Hive from Postgresql, mapping a table in Postgresql to a table in Hive

usage : generator.PostgreSQLTableGenerator <postgreUrl> <postgreUser> <postgrePassword> <hiveDb> <postgreDb> <postgreTable> <timeColumn>

Generate create table statement for Doris from Hive, mapping a table in Hive to a table in Doris

usage : generator.Hive2DorisTableGenerator <hiveUrl> <hiveUser> <hiveDb> <hiveDb> <hiveTable> <dorisDb> <dorisTable>

Generate create table statement for Hive from HBase, mapping a table in HBase to an external table in Hive

usage : sh generate_hbase_table.sh <ns.table>

Generate select from statement for a table

usage : sh generate_from_table.sh <db.table> [alias] [line_breaker]

About

Generate create table statement, select statement, or DataFrame structure schama, and get rid of the boring work.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published