Headline

Senior Data Engineer | PySpark · Azure Data Factory · Microsoft Fabric | ETL Pipelines & Data Quality | 4+ Years at LTIMindtree

About

Data Engineer with 4+ years of experience building scalable data pipelines and analytics solutions at LTIMindtree, one of India's leading IT services companies. I specialize in end-to-end data engineering — from ingestion and transformation to quality checks and delivery — using PySpark, Azure Data Factory, Microsoft Fabric, and Python. I have hands-on experience designing ETL/ELT workflows, working with large-scale structured and semi-structured datasets, and ensuring high data quality across enterprise pipelines. Key areas of expertise: • Data pipeline development using PySpark and Azure Data Factory • Microsoft Fabric (Lakehouse, Data Warehouse, Dataflows Gen2, Pipelines) • ETL/ELT design and optimization for large datasets • Data quality frameworks and validation automation • Azure cloud services: ADLS Gen2, Azure Synapse, Azure SQL Previously worked as an Android Developer, giving me a strong foundation in software engineering principles and cross-functional collaboration. Currently open to Data Engineer and Senior Data Engineer opportunities where I can contribute to building robust, scalable data platforms.

Location

Namakkal

AI stack

geminicli

obsidian

perplexity

xai

Work experience

Senior Data Engineer at LTIMindtree, Aug 2021 - Present · 4 yrs 11 mos, Bengaluru, Karnataka, India, • Designed and developed end-to-end ETL/ELT data pipelines using Azure Data Factory (ADF) and PySpark, processing large volumes of structured and semi-structured data for enterprise clients. • Built and maintained data solutions on Microsoft Fabric including Lakehouse architecture, Dataflows Gen2, and Fabric Pipelines to enable scalable analytics and reporting. • Developed PySpark transformation scripts for data cleansing, enrichment, and aggregation on Azure Data Lake Storage Gen2 (ADLS Gen2), improving pipeline performance and data reliability. • Implemented data quality checks and automated validation frameworks, reducing downstream data errors and ensuring SLA-compliant data delivery. • Collaborated with data architects and business analysts to translate business requirements into technical data models and pipeline designs. • Worked with Azure Synapse Analytics and Azure SQL Database for data warehousing and ad-hoc analytical queries. • Monitored and optimized pipeline performance, reducing average job execution time by identifying and resolving bottlenecks in transformation logic. • Maintained documentation for data flows, pipeline configurations, and data dictionaries to support team knowledge sharing and onboarding.

Android Developer at Computira, Aug 2020 - Sep 2021 · 1 yr 2 mos, Tamil Nadu, India

Education

Bachelor of Engineering - BE, Computer Science, KSR INSTITUTE FOR ENGINEERING AND TECHNOLOGY, NAMAKKAL