Headline

Senior Data Engineer @ AXA GBS | Databricks · Delta Lake · Unity Catalog · Apache Spark | Databricks Certified Professional & Associate

About

Associate Consultant at AXA Global Business Services, leveraging expertise in data engineering, PySpark, and Microsoft Power BI to contribute to data-driven decision-making and operational efficiency. A graduate in Information Technology from Vellore Institute of Technology, with certifications in Azure and Databricks Data Engineering, and prior experience at Mu Sigma Inc. in decision-driven analytics, fostering a strong foundation in problem-solving and decision driven insights.

Location

Andhra Pradesh

AI stack

claude code

mcp

openai

ChatGPT

OpenAI Agents SDK

OpenAI Playground

Work experience

Associate Consultant at AXA Global Business Services (AXA GBS), Feb 2025 - Present · 1 yr 9 mos, Hybrid

Senior Data Engineer at AXA GBS, Feb 2025 - Present · 1 yr 9 mos, Built an Agentic AI framework using MCP, GitHub Copilot and reusable deterministic functions to automate product data engineering by enabling AI agents to identify and update the files required for metadata management, orchestration and data quality. Established tool driven workflows with deterministic outputs, minimizing unnecessary LLM reasoning and token consumption while reducing manual development effort by 40%. Designed and enforced a standardized data write and governance framework using PySpark, Delta Lake, Liquid Clustering and Databricks dashboards, integrating metadata-driven configurations to automate pre/post-write validations, standardize write patterns, monitor catalog and pipeline health, and simplify column-level masking management. Developed a selective unit testing framework integrated with CI/CD pipelines, automating test notebook and mock data generation and enabling targeted validation of data engineering changes before promotion; with major reduction in unit test development effort. Architected and engineered a Databricks based analytics platform to modernize hiring and interview reporting, integrating JSON data ingestion through LDP and Auto Loader, governed data access using Unity Catalog column-level masking, and evolving existing databricks dashboard to an interactive Databricks App for dashboard consumption, metric updates, and stakeholder collaboration.

Apprentice leader at Mu Sigma Inc., Jan 2024 - Feb 2025 · 1 yr 2 mos, Bengaluru, Karnataka, India

Senior Data Engineer at Mu Sigma Inc., Jul 2022 - Jan 2025 · 2 yrs 7 mos, Led a strategic migration initiative to transition a large-scale legacy External hive metastore with 500+ data assets to a centralized Unity Catalog environment, establishing a robust data governance framework. Led a team of 10 engineers in the implementation of Data mesh and data lake house principles, successfully creating CPG data assets. This initiative reduced time spent on business requirement gathering by 35%. Defined and established best practices for Databricks Asset Bundle deployment, leading to optimized workflows, improved scalability, and resulting in a reduction in overall digital engagement costs. Spearheaded architecture and design of high-frequency data models using Lambda architecture, Apache Kafka, Databricks Structured Streaming delivering near real time data with multiple stream-stream joins to planners and reducing planning cycle times, boosting inventory accuracy.

Trainee decision scientist at Mu Sigma Inc., Sep 2020 - Jan 2024 · 3 yrs 5 mos, Bengaluru, Karnataka, India

Web Development Intern at Happiest Minds Technologies, May 2019 - Jun 2019 · 2 mos, Bengaluru Area, India

Education

vellore institute of technology, Information Technology, Vellore Institute of Technology

Bachelor of Technology, Information Technology, Vellore Institute of Technology