Headline

Data Engineer | PySpark · AWS · SQL · Airflow · GenAI Pipelines | Building Scalable Data Platforms @ TCS

About

I build data infrastructure that moves fast and breaks nothing. Over the past 3+ years, I've designed and owned end-to-end data platforms at TCS — from PySpark ETL pipelines on AWS Glue processing 10M+ records daily, to a FastAPI service that cut API latency from 10 seconds to 3. Most recently, I've been working at the intersection of data engineering and Generative AI — building agentic workflows that automate data quality validation and a natural language SQL assistant using RAG architecture. My stack: Python · PySpark · AWS (Glue, Lambda, S3, DynamoDB, Athena) · Apache Airflow · FastAPI · SQL · Power BI · GenAI I'm currently open to Senior Data Engineer and Data Platform Engineering roles at product-first companies where data is a core competitive advantage. 📩 Open to connecting — especially with engineers and teams solving hard data problems at scale.

Location

Gurugram

Work experience

Data Engineer at Tata Consultancy Services, Dec 2023 - Present · 2 yrs 7 mos, Gurugram, Haryana, India, • Designed and scaled distributed PySpark ETL pipelines on AWS Glue processing 10M+ records daily, delivering curated datasets powering 20+ Power BI dashboards for business analytics. • Built and automated 5+ production-grade data pipelines integrating AWS Glue, S3, Lambda, and DynamoDB, enabling reliable ingestion and transformation of enterprise datasets. • Built a centralized FastAPI-based service for downstream data integrations, optimizing query execution, caching, and async handling, reducing API latency from 10s to 3s. • Orchestrated streaming jobs and batch workflows using Apache Airflow, enabling automated data pipeline execution. • Optimized complex SQL queries powering Power BI dashboards, refactoring joins and indexing strategies to reduce report execution time by 30–40%. • Automated data quality validation using an agentic AI workflow, reducing manual validation efforts and eliminating operational incidents related to failed data uploads.

Engineering Associate at Innovation and Technology, Jan 2023 - Dec 2023 · 1 yr, Gurugram, Haryana, India, • Assisted in building basic ETL pipelines using Python and SQL to support internal reporting needs. • Contributed to data cleansing and validation processes to improve dataset quality and consistency. • Developed simple automation scripts to reduce manual data preparation tasks. • Supported the engineering team in preparing datasets for dashboards and business intelligence tools. • Gained hands-on exposure to AWS services such as S3 and Lambda through small configuration tasks and team collaborations

Education

Bachelor of Technology - BTech, Electrical, Electronics and Communications Engineering, Guru Gobind Singh Indraprastha University

12th, Science, dav public school