Personal blog & portfolio of Emsal Cengiz | Data Engineer | Writing about data engineering, cloud, and software.

Script to analyze music streaming logs, calculating the distribution of distinct song plays per client on a specific date. Outputs a summary table of client counts by distinct play count

This repository has my learning scala examples

liked Apache Beam for streaming data transformations

After ETL done by reading static data, an API is designed with flask_sqlalchemy, the purpose is to show the top five users

You can do a lot of things with Apache Spark. What I've done here is to work with a static file and create a Batch ETL system.

I made various data normalization operations with python scripts. Target data in CSV format

Generating random data with Apache Kafka

ways to make an HTTP request in JavaScript

I find Apache Airflow very useful for ETL work. Here I transferred data from the source database(mysql) to the target database(postresql) and used the Airflow Bash Operator.

shell komutlarının türkçe açıklamalarını içerir

A collection of simple Bash scripts.