AMIT PAWAR

AMIT PAWAR

Innovative Data Engineer with expertise in Azure, Python, SQL, PySpark, and Databricks.

Pune, Maharashtra

#OpenToWork

About

Innovative Data Engineer with expertise in Azure, Python, SQL, PySpark, and Databricks. Specialized in building scalable, high-performance data pipelines and delivering automated, reliable, data-driven solutions.

What I'm looking for

Data engineering, Data Analyst

Experience

Data Engineer

Jalopeura (Ecommerce)

Jan 2024 – Present

• Designed and developed a scalable Azure-based analytics platform using medallion architecture. • Improved processing speed by 40% and reduced latency by 25% using PySpark and Databricks. • Built standardized ETL/ELT pipelines with Azure Data Factory, Data Lake, Databricks, and Synapse. • Utilized Snowflake for data modeling, large-scale processing, and performance tuning. • Developed reusable frameworks to reduce development time and ensure on-time delivery. • Translated business requirements into optimized data models and queries using SQL and PySpark. • Orchestrated end-to-end workflows and gained exposure to Apache Airflow and Kafka. • Built Lakehouse solutions in Microsoft Fabric and integrated with Power BI for actionable business insights.

Azure DatabricksPySparkSnowflake

Data Engineer

ISG (Banking)

Jan 2022 – Jan 2024

• Collaborated with Data Scientists, Business Analysts, and stakeholders to deliver data engineering solutions. • Ingested data from CSV, JSON, APIs, and databases; performed transformation and cleansing using medallion architecture across Data Lake and Data Warehouse. • Built and orchestrated ETL pipelines with scheduling, logging, and monitoring using Airflow; familiar with Kafka. • Leveraged Snowflake for complex queries, data modeling, and multi-source integration. • Optimized performance via indexing, partitioning, and materialized views; ensured scalability through cloud autoscaling and sharding. • Implemented RBAC and encryption for data security and maintained comprehensive ETL/ELT and architecture documentation.

Apache AirflowSnowflakeKafka
ISG (HR )

Data Analyst

ISG (HR )

Jan 2021 – Jan 2022

• Worked on an HR analytics project to analyze workforce trends, evaluate HR department performance, identify process gaps, and suggest strategic improvements. • Extracted and analyzed employee data (department, experience, salary, performance) using SQL; identified turnover patterns across specific departments and low-tenure groups. • Developed a structured report card and dashboard using QlikView, enabling better workforce planning and data-driven HR decisions.

SQLQlikViewData Analysis

Data Analyst

Atos (IOCL)

Jan 2019 – Jan 2021

• Focused on transforming complex datasets into clear, actionable insights that drive strategic business decisions. • Conducted statistical analyses on large datasets to assess data quality and integrity while collaborating closely with developers to build scalable business solutions. • Collected, cleaned, and analyzed data from multiple sources such as Oracle DB and Qlik Sense to identify key trends and correlations. • Played a vital role in requirement gathering, solution design, testing, and validation ensuring result-driven outcomes.

OracleQlik SenseStatistical Analysis

Education

MGM College of Engineering, Nanded (SRTMUN)

B.E. · Electronics and Telecommunication (ENTC)

Certifications

Databricks Certification: Generative AI Fundamentals

Databricks Certification

Databricks Certification: Azure Platform Architect & GCP Platform Architect

Databricks Certification

Skills

DBTKafkaApache AirflowData ModellingData WarehousingMedallion ArchitectureETL/ELT PipelinesPostgreSQLRedshiftBigQuerySnowflakePySparkMicrosoft FabricAWSADLS Gen2Azure DatabricksAzure Synapse AnalyticsAzure Data FactorySQLPython

Languages

English