About
Data Engineer with experience in building scalable cloud data platforms using Snowflake, dbt, PySpark, Azure Data Factory, and Databricks. Skilled in ETL/ELT pipelines, data warehousing, performance optimization, and real-time data processing. Experienced in designing end-to-end data solutions for analytics and reporting. Open to remote contract, freelance, and part-time opportunities.
What I'm looking for
Looking for remote Data Engineering opportunities including freelance, contract, part-time, or consulting roles focused on Snowflake, dbt, PySpark, Databricks, and Azure Data Factory. Interested in building scalable data pipelines, cloud migration, ETL/ELT development, and performance optimization projects.
Experience
Senior Data Engineer
Entain India Pvt Ltd
Feb 2022 โ Present
Designing and developing scalable ETL/ELT data pipelines using Snowflake, PySpark, Azure Data Factory, and dbt.
Building and maintaining cloud-based data warehouse solutions for analytics and reporting.
Developing dbt models for data transformation, testing, and documentation.
Creating and scheduling ADF pipelines for orchestration and data movement across multiple sources.
Optimizing Snowflake SQL queries, warehouse usage, and overall pipeline performance.
Handling large-scale data processing using PySpark and Databricks.
Implementing data quality checks, monitoring, and error handling mechanisms.
Collaborating with business analysts, QA teams, and stakeholders to gather requirements and deliver data solutions.
Supporting production deployments, troubleshooting issues, and maintaining SLA compliance.
Working on performance tuning, cost optimization, and automation of data engineering workflows.
Participating in code reviews, release activities, and Agile/Scrum ceremonies.
SNOWFLAKEPYSPARKSQLADFPYTHON
Senior Data Engineer
Persistent systems
Sep 2021 โ Jun 2022
Designing and developing scalable ETL/ELT data pipelines using Snowflake, PySpark, Azure Data Factory, and dbt.
Building and maintaining cloud-based data warehouse solutions for analytics and reporting.
Developing dbt models for data transformation, testing, and documentation.
Creating and scheduling ADF pipelines for orchestration and data movement across multiple sources.
Optimizing Snowflake SQL queries, warehouse usage, and overall pipeline performance.
Handling large-scale data processing using PySpark and Databricks.
Implementing data quality checks, monitoring, and error handling mechanisms.
Collaborating with business analysts, QA teams, and stakeholders to gather requirements and deliver data solutions.
Supporting production deployments, troubleshooting issues, and maintaining SLA compliance.
Working on performance tuning, cost optimization, and automation of data engineering workflows.
Participating in code reviews, release activities, and Agile/Scrum ceremonies.
pysparksnowflakesqlpython
Education
JNTU
MCA ยท computer science
2009 โ 2012
Skills
DATA PIPELINESCI/CDDATA BRICKSPERFORMANCE TUNINGDATA ENGINEERNOSQLMONGODBDBTSNOWFLAKEAWS S3ADLS GEN2ADFPYSPARKPYTHONETL/ELTDATA WAREHOUSINGSQLplsql
Languages
English (Professional working proficiency)Telugu (Native or bilingual proficiency)