Headline

Azure Data Engineer | Microsoft Fabric (Lakehouse, Pipelines, Notebooks) | Azure Data Factory, Databricks | PySpark, SQL, ETL | Data Warehousing | Real-Time & Batch Processing | 4+ Years

About

Data Engineer with 4+ years of hands-on experience designing and building scalable data pipelines using Microsoft Fabric and Azure technologies, specializing in batch processing and healthcare claims data. CORE EXPERTISE Data Engineering & Pipeline Development: • Built end-to-end data pipelines for processing large-scale healthcare claims data • Experience in ETL/ELT workflows using Azure Data Factory and Microsoft Fabric Pipelines • Worked on pipelines for claims ingestion, transformation, and loading • Developed scalable data workflows for batch data processing Microsoft Fabric & Lakehouse: • Hands-on experience with Microsoft Fabric (Lakehouse, Data Warehouse, Notebooks, Pipelines) • Designed and implemented Lakehouse architecture using OneLake • Data transformation using PySpark in Fabric notebooks • Managed data ingestion and transformation workflows in Fabric environment

Location

Chennai

Work experience

Consultant at Anirai Consultancy LLP, May 2025 - Present · 1 yr 2 mos, Chennai, Tamil Nadu, India, Fairos Plus – Occunet Built an enterprise-grade data processing pipeline using Microsoft Fabric to handle healthcare accumulator data from multiple external systems. Designed an event-driven Lakehouse architecture to process SISCO (Excel) and BRMS (pipe-delimited) files containing member benefit usage such as deductible and out-of-pocket amounts. Implemented Medallion Architecture (Bronze, Silver, Gold) and performed PySpark-based transformations including JSON-driven column mapping, data cleaning, splitting fields, handling multiple date formats, and data validation. Standardized data into a unified schema and enriched it in the Gold layer using INNER JOIN with Mirror DB tables. Developed automated pipelines using Data Activators and loaded final data into On-Core tables for downstream systems and reporting.

Data Engineer at HCLTech, Aug 2021 - Apr 2025 · 3 yrs 9 mos, Chennai, Tamil Nadu, India, Sales Data Tracking and Analysis for HP In this project, I worked on developing a comprehensive system to track and analyze sales data for HP across multiple regions. The primary goal was to improve data accessibility and reliability by migrating large volumes of daily sales data from on-premises systems to a cloud-based environment. I automated the entire ETL process to ensure real-time data integration, enabling seamless updates and providing critical insights into sales performance. The project also involved enhancing data quality and reducing processing time, significantly improving reporting accuracy and driving more informed decision-making.

Education

Bachelor of Engineering - BE, computer science engineering, Saveetha School of Engineering