Headline

Senior Data Platform Engineer building modern AI-ready data platforms | Databricks Certified Professional | Azure | Delta Lake | PySpark | Lakehouse Architecture | Open to Global Opportunities

About

I'm a Senior Data Engineer with 7.5+ years of experience building data platforms that actually work in production — not just on paper. My sweet spot is Lakehouse architecture on Azure. I design and build end-to-end data infrastructure using Databricks, Delta Lake, Azure Data Factory, and PySpark — the kind of platforms that let product and analytics teams move fast without worrying about data quality or pipeline failures. Over the years, I've worked across Food, Retail, BFSI, FinTech, and B2B data domains, which has given me a solid understanding of what it means to own data infrastructure in high-stakes environments. Some things I've delivered that I'm proud of: ▪ Improved data reliability by 60%+ by building rigorous validation and quality frameworks ▪ Cut Spark processing time by 30% through systematic job and query optimization ▪ Reduced pipeline support tickets by 50% after diagnosing and fixing a critical integration issue ▪ Led a full Lakehouse migration on Azure for a large financial client — redesigned the data model, set up real-time reporting, and improved system recovery time by 80% ▪ Built reusable, parameterized ADF frameworks that teams could actually maintain and extend I hold dual Databricks certifications — Certified Data Engineer Professional and Associate — along with the Microsoft Azure Data Engineer certification (DP-203). These aren't just badges; they reflect how I think about building production-grade data systems. What I enjoy most is working in product-focused environments where data is a core part of the product. I like being close to the business problem, not just the pipeline. I work well in small, fast-moving teams where you own things end-to-end and decisions actually matter. Right now, I'm open to Senior Data Engineer and Lead Data Engineer roles at product-based startups and scale-ups — particularly in the USA, UK, UAE, and Europe. If your team is building something ambitious and needs someone who can own the data platform, I'd love to talk.

Location

Greater Bengaluru Area

AI stack

claude code

claude

gemini

openai

Microsoft Copilot

Work experience

Data Engineer at Persistent Systems, Dec 2023 - Present · 2 yrs 11 mos, Greater Bengaluru Area, Building and owning a production-grade data platform on Azure Databricks for enterprise clients across Food, FM, and Healthcare domains. ▪ Architected and optimized 100% of platform pipelines using ADF, Databricks, DBT, and PySpark — improving processing performance by 30% and data reliability by 60%+ ▪ Designed core data models and Delta Lake architecture for unified cross-domain reporting ▪ Established CI/CD pipelines via Azure DevOps, embedding DataOps practices across the team ▪ Trained and mentored a team of 5 analysts on data metrics and pipeline best practices Skills: Databricks · Delta Lake · Azure Data Factory · PySpark · DBT · CI/CD · DataOps · Data Modeling

Data Engineer at Nagarro, Sep 2021 - Dec 2023 · 2 yrs 4 mos, On-site data engineer for a large BFSI (Microfinance) client — owned the full migration from on-premises reporting to a cloud Lakehouse on Azure. ▪ Architected end-to-end Lakehouse migration enabling real-time insights on loan defaults and revenue across all national branches ▪ Designed SCD 1/2/3 data models ensuring accurate historical tracking across all business domains ▪ Enforced PII masking, data governance, and archival strategies meeting industry compliance standards ▪ Recommended platform upgrades that improved system recovery time after outages by 80% Skills: Azure · Databricks · ADF · PySpark · Data Governance · Lakehouse Architecture · SCD Modeling

Software Engineer at PromptCloud, Mar 2020 - Apr 2021 · 1 yr 2 mos, Greater Bengaluru Area

Data Engineer at OceanFrogs, Jan 2019 - Mar 2020 · 1 yr 3 mos, Bengaluru Area, India, Worked on Account Intelligence Platform for B2B client:  Uncover the technologies used on different websites, and segment target accounts based on tech usage.  Developed Logic to predict technographics and firmographics data.  Find decision markers that score high on intent topics.  Discover accounts ready to do business & find accurate information about their decision makers.  Manage data including handling data in unusual formats, covering data into a usable form, aggregate and disaggregate data as needed using database and other tools. Skills:- Python, Postman, Selenium, JSON, MS-SQL, Jira, Git.