Headline

Data Engineer | Immediate Joiner | Azure Data Factory · Databricks · PySpark · Delta Lake | Databricks Certified

About

Data Engineer with 2.5 years of experience building cloud-native data pipelines on Microsoft Azure, working in the Supply Chain and Manufacturing domain at Birlasoft Limited. I specialize in: → Designing ADF ingestion pipelines with incremental loading and REST API integration → PySpark transformations and Delta Lake (ACID, MERGE, schema evolution) on Databricks → Medallion Architecture (Bronze → Silver → Gold) with Unity Catalog governance → CI/CD for data pipelines using Databricks Asset Bundles and GitHub Certified: Databricks Associate Data Engineer | Microsoft Azure DP-900 Open to Data Engineer roles in Azure/Databricks environments. Open to relocation and remote opportunities.

Location

India

Work experience

Data Engineer at Birlasoft, Apr 2024 - Present · 2 yrs 4 mos, Pune, Maharashtra, India, Supply Chain Data Modernization | Manufacturing & Logistics Domain - Built ADF ingestion pipelines consuming shipment data from logistics REST APIs (~17 GB/day) into ADLS Gen2 using incremental timestamp-based loading — reduced processing time by ~40% - Developed PySpark notebooks in Databricks to flatten nested JSON, deduplicate records and write clean data to Silver Delta Lake tables - Implemented Delta Lake ACID transactions, schema evolution and MERGE upserts for late-arriving records - Managed all credentials via Azure Key Vault and Databricks secret scopes — zero hardcoded secrets Stack: Azure Data Factory · Databricks · PySpark · Delta Lake · ADLS Gen2 · Azure Key Vault · Python · SQL

Trainee at Birlasoft, Sep 2023 - Apr 2024 · 8 mos, On-site

Software Trainee at Naskraft IT Solutions PVT LTD., Feb 2023 - Aug 2023 · 7 mos, Aurangabad

Education

Bachelor of Technology - BTech, Computer Science and Engineering, Maharashtra Institute of Technology Aurangabad