About Me π
I am a Senior Data Engineer with over 15 years of experience in databases, data warehousing, and big data solutions. My expertise spans structured and unstructured data processing, ingestion, storage, querying, and analytics, with hands-on experience in technologies like Databricks, Snowflake, Azure Data Factory, Spark, and Power BI.
π I am currently working on:
Designing and implementing Databricks Lakehouse architectures with Medallion models.
Leveraging Databricks SQL, Python, and Snowflake for data pipeline development and optimization.
Migrating legacy systems (SSIS, Netezza) to modern cloud platforms like Snowflake and Databricks.
π€ I am looking to collaborate on:
Lakehouse architecture and Medallion models.
Best practices for optimizing Spark workflows and large-scale data engineering solutions.
π I am currently learning:
Machine Learning and Generative AI.
Large Language Models (LLMs) and their applications in data engineering.
π‘ I am looking for help with:
Advancing my knowledge in Machine Learning and LLMs.
Exploring innovative use cases for Generative AI in data workflows.
β Ask me about:
Implementing scalable data pipelines using Databricks and Snowflake.
Optimizing joins and tackling real-time challenges like data skew, spill management, and schema evolution.
Transitioning ETL frameworks to cloud-native solutions.
π Fun Fact:
I've successfully led multiple ransomware recovery projects, ensuring data resilience and continuityβa testament to my love for problem-solving in high-stakes scenarios!
Popular repositories Loading
-
Data-Engineering-with-AWS-2nd-edition
Data-Engineering-with-AWS-2nd-edition PublicForked from PacktPublishing/Data-Engineering-with-AWS-2nd-edition
Data Engineering with AWS, 2nd edition - Published by Packt
Python
-
-
-
-
-
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.