Headline

Data Engineer | ETL Development | Apache Spark (PySpark) | Databricks | Azure | SQL | Python | Data Quality

About

Data Engineer with 2+ years of experience in ETL development, data quality frameworks, and cloud - based data solutions using SQL, Python, PySpark, Databricks, and Azure. I specialize in building scalable data systems following Medallion Architecture (Bronze, Silver, Gold), managing Delta Lake pipelines, performing data quality assessments, and delivering reliable decision-support solutions for enterprise stakeholders. Key highlights: Built automated Data Quality Validation Framework with real-time Streamlit dashboards Executed end-to-end Actian → Databricks Delta Lake migration with full validation Managed SRE alerting, RCA, and production incident resolution for Databricks pipelines Implemented Power Automate workflows reducing Mean Time To Respond (MTTR) Supported CI/CD using Azure DevOps, Git, and pull request workflows Tech Stack: PySpark | Databricks | Delta Lake | Azure | SQL Server | Python | Power Automate | Streamlit | Git | Azure DevOps

Location

Chennai

Work experience

Data Engineer at Metricbees Private Limited, Sep 2025 - Present · 10 mos, Developed ETL processes using PySpark and Databricks following Medallion Architecture (Bronze → Silver → Gold), ensuring reliable data availability for business stakeholders Conducted Data Quality Assessments — null checks, duplicate detection, schema validation, and referential integrity checks across SQL Server and Databricks Delta tables Built automated Data Quality Validation Framework with real-time Streamlit dashboards for continuous pipeline health monitoring Executed end-to-end data migration from Actian platform to Databricks Delta Lake including schema mapping and post-migration validation Provided on-call production support via SRE alerting — RCA, Databricks job failure resolution, and preventive fix implementation Supported CI/CD processes using Azure DevOps and Git — feature branches, pull requests, and deployment workflows

Junior Data Engineer at Metricbees Private Limited, Feb 2024 - Present · 2 yrs 5 mos

Fullstack intern at Accord Infomatrix, Aug 2023 - Feb 2024 · 7 mos, Chennai, Tamil Nadu, India

Education

Bachelor's of Technology, Information Technology, Adhiparasakthi College of Engineering

12th grade, Bio-maths, Anne Marie matric hr sec school