-
Designed and maintained batch and streaming pipelines using Apache Spark, Kafka, Airflow, and dbt
-
Led migration of legacy ETL workflows to a cloud-native lakehouse on Snowflake and Databricks
-
Built data quality checks and lineage metadata to improve incident detection and root-cause analysis
-
Partnered with analytics and product teams to define data models, SLAs, and delivery timelines
-
Mentored junior engineers on pipeline design, testing, and operational best practices
Keywords: Apache Spark, Apache Kafka, Apache Airflow, dbt, Snowflake, Data Modeling, Data Quality, ETL/ELT
-
Built and operated ELT pipelines for retail sales, inventory, and customer analytics
-
Modeled warehouse layers in Amazon Redshift and automated transformations with Airflow
-
Integrated third-party marketing and POS data into a unified reporting environment
-
Improved pipeline reliability through monitoring, alerting, and automated data validation
-
Supported Tableau dashboards used by merchandising and finance teams
Keywords: Python, SQL, AWS Glue, Amazon Redshift, Apache Airflow, Tableau, Data Warehousing
-
Assisted with building SQL-based ETL jobs for clinical and operational reporting
-
Profiled source data and documented data quality issues for remediation
-
Automated recurring data extracts and validation checks with Python
Keywords: SQL, Python, ETL, Data Profiling