Headline

Senior Data Engineer |Data & AI | Databricks | PySpark | Spark | Kafka | Lakehouse | Azure & AWS | 9+ Years

About

Senior Data Engineer with 9+ years of experience building scalable data platforms, real-time streaming pipelines, and Lakehouse architectures using Databricks, PySpark, and cloud technologies (Azure & AWS). I specialize in designing high-performance ETL/ELT pipelines, optimizing distributed data processing, and enabling analytics across large-scale data systems (GB–TB scale). I have hands-on expertise in Kafka, Delta Lake, and Medallion architecture. In my recent role, I built a Databricks-based platform integrating 500+ batch and streaming data sources and improved processing performance. 🔹 Skills: Databricks, PySpark, Spark, Kafka, SQL, Azure, AWS 🔹 Expertise: Data Engineering, Lakehouse, Streaming, Data Modeling

Location

Bengaluru

AI stack

cursor

gemini

github copilot

openai

Work experience

Senior Associate Data Engineering L2 at Publicis Sapient, Aug 2025 - Present · 10 mos, Bengaluru, Karnataka, India, • Designed and optimized large-scale Spark pipelines processing TB-scale data • Built scalable ETL/ELT workflows using Databricks and Azure services • Implemented Delta Lake-based Lakehouse architecture for improved data reliability

Career Break Owing to Motherhood + Freelance at Maternity Break, Jan 2024 - Jun 2025 · 1 yr 6 mos, Bengaluru, Karnataka, India, Took a planned maternity break, while staying technically active through select consulting projects Designed Databricks-based data pipelines and Lakehouse solutions Built end-to-end ETL workflows with data validation and monitoring frameworks Worked on event-driven data processing using Azure Functions Strengthened expertise in Delta Lake, streaming, and scalable architecture design

Data Engineer at A.P. Moller - Maersk, May 2022 - Apr 2023 · 1 yr, Bengaluru, Karnataka, India, • Developed data pipelines on Azure Databricks handling large-scale enterprise data • Built ingestion frameworks for batch and streaming data using Kafka • Enabled analytics by designing curated data layers (Bronze/Silver/Gold) • Reduced pipeline failures and improved data quality

IT Analyst at Tata Consultancy Services, Mar 2021 - Apr 2022 · 1 yr 2 mos, Bengaluru, Karnataka, India, • Built ETL pipelines and data transformation workflows using Azure tools • Worked on data migration and warehouse modernization projects • Improved query performance through indexing and optimization techniques

Senior Software Engineer at NTT DATA, Jan 2019 - Mar 2021 · 2 yrs 3 mos, Bengaluru, Karnataka, India

Education

Bachelor’s Degree, Computer Science, Rajasthan Institute of Engineering & Technology,Jaipur