Repo uses docker-compose file to create docker container to run hadoop, hive and spark. Notes.txt file has details about implementation. This repo covers end-to-end simple flow, reading parquet files to spark-df and loading it to csv-file and run unit-test-cases.
-
Notifications
You must be signed in to change notification settings - Fork 0
Repo uses docker-compose file to create docker container to run hadoop, hive and spark. Notes.txt file has details about implementation. This repo covers end-to-end simple flow, reading parquet files to spark-df and loading it to csv-file and run unit-test-cases.
pajagtap/data-reporting
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Repo uses docker-compose file to create docker container to run hadoop, hive and spark. Notes.txt file has details about implementation. This repo covers end-to-end simple flow, reading parquet files to spark-df and loading it to csv-file and run unit-test-cases.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published