Headline

Certified Azure Data Engineer || 2x Databricks Certified || 2x Microsoft Certified || DP-700 Certified || Azure Data Factory || ADLS Gen2 || PySpark || Python || SQL Server || Data Bricks || Azure DevOps

About

With 5 years of experience in data engineering, I specialize in building scalable data solutions on Microsoft Azure, with a strong focus on transforming raw data into reliable, business-ready insights. As a fresher at Infosys I built a solid foundation in data engineering and cloud concepts. During this phase, I worked on understanding data pipelines, basic data integration, and supporting existing workflows—gaining hands-on exposure to Azure services and real-world project environments. This experience helped me develop a strong base in data handling, debugging, and collaborative development practices. At Bitwise, I transitioned into a more advanced and impactful role as an Azure Data Engineer, where I design and develop end-to-end data solutions. I have built and optimized ETL/ELT pipelines using Azure Data Factory, integrating data from multiple sources such as APIs, databases, and flat files into Azure Data Lake and Blob Storage. I extensively work with Azure Databricks and PySpark to process large-scale data, implementing Medallion architecture (Bronze, Silver, Gold layers) for structured and efficient data transformation. I have hands-on experience in performance tuning, data partitioning, and leveraging Delta Lake for optimized storage and faster query performance. Additionally, I ensure secure and reliable data pipelines using Azure Key Vault and CI/CD practices through Azure DevOps, contributing to improved deployment efficiency and data quality. I am passionate about solving complex data problems, continuously improving system performance, and building scalable cloud-native data platforms. I enjoy working in collaborative environments and contributing to solutions that drive meaningful business outcomes

Location

Pune Division

AI stack

cursor

gemini

github copilot

openai

Work experience

Programmer at Bitwise India, Aug 2023 - Present · 2 yrs 10 mos, Pune District, Maharashtra, India, • Developed end-to-end ETL pipelines using Azure Data Factory to ingest and process data from heterogeneous sources into Azure Data Lake, Azure Blob Storage, and Azure SQL Database, with scalable transformations executed in Azure Databricks. • Developed high-performance Spark applications in Azure Databricks using PySpark and Spark SQL, implementing Medallion Architecture (Bronze, Silver, Gold) to build scalable pipelines and deliver analytics-ready datasets for business insights. • Designed and fine-tuned high-performance SQL queries to build scalable data solutions, ensuring optimal efficiency while meeting both technical requirements and business goals. • Integrated ADF pipelines with Azure DevOps CI/CD for continuous deployment, environment promotion, and version control.

System Engineer at Infosys, May 2021 - Jul 2023 · 2 yrs 3 mos, Pune District, Maharashtra, India, • Created end-to-end data pipelines using Azure Data Factory, managing on-demand clusters, and establishing linked services between data sources and destinations, ensuring seamless data flow and integration. • Built data transformation workflows using PySpark in Databricks to improve efficiency and scalability. • Automated metadata-driven ingestion and transformation workflows using ADF Lookup, ForEach Activity, and parameterized pipelines for reusability. • Migrated legacy on-premises databases to Azure SQL and ADLS Gen2 using custom transformation logic and schema mapping.

Education

Bachelor of Technology, Electronics, SRM IST Chennai