Skip to content

Various Projects on Python related to Data Engineering

Notifications You must be signed in to change notification settings

spaw6065/DataEngineeringWithPython

 
 

Repository files navigation

Data Engineering With Python

  • This repo contains different projects using Python language and different SQL & NoSQL databases like PostgreSQL, Apache Cassandra, SQlite3.
  • Prime focus of this projects are to get data from different sources and load into some database based on the nature and usecase of the project.
  • We will use some API to connect to the data and do transformation of the data using Python libraries and functions.
  • Usage of AWS services like S3, Redshift, IAM, Glue,EMR.
  • Transforming schemas from 3NF to star schema for simplification of query and to increase optimization.

About

Various Projects on Python related to Data Engineering

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 57.3%
  • Python 42.7%