Headline

Serving Notice Period | Senior Data Engineer @ TekCor4 | IIT Kharagpur | AWS | Azure | PySpark | dbt | Redshift | Kafka | Terraform | Data Platform Architecture | ETL/ELT

About

Senior Data Engineer with 4+ years of experience building scalable, cloud-native data platforms across AWS and Azure, currently serving as System Owner for a core enterprise data platform at TekCor4. I specialize in designing production-grade ETL/ELT pipelines, modern data modeling with dbt, and distributed processing with PySpark - turning raw enterprise data into governed, analytics-ready products. Recent impact: • Architected a Change Data Capture framework that cut pipeline runtime by 95% and moved refresh frequency from weekly to daily • Migrated billions of customer invoice records from Oracle to Amazon Redshift via AWS Glue and PySpark, cutting execution time by 30% with zero critical data loss • Built a dbt Cloud project implementing Medallion Architecture (Bronze/Silver/Gold) with Row-Level Security for governed, self-serve analytics • Led 100+ automated data quality pipelines across 100+ tables and 20+ source systems at HDFC Bank, cutting validation time 90% Core stack: AWS (Glue, Redshift, SNS), Azure (Data Factory, Databricks, Blob/Data Lake Storage), PySpark, dbt, SQL, Python, Kafka, Terraform, Docker, GitLab CI/CD. I care about building data platforms that are reliable, governed, and cheap to operate - not just functional. Open to Senior/Staff Data Engineer roles at product-led, high-scale organizations solving hard distributed data problems.

Location

Gurugram

AI stack

claude code

claude

cursor

gemini

n8n

ChatGPT

Work experience

Senior Data Engineer at TekCor4, Oct 2025 - Present · 1 yr, Gurugram, Haryana, India, • System Owner for the CFA Transactional System (CTS), owning architecture, development, deployments, and operational support for the enterprise data platform powering the VBI product. • Designed and implemented the cts-dbt project in dbt Cloud using Medallion Architecture (Bronze/Silver/Gold) with Row-Level Security for governed analytics. • Architected a Change Data Capture (CDC) framework extending legacy Oracle ingestion with auditing and lineage, reducing pipeline runtime by 95% and enabling daily refreshes. • Engineered AWS Glue + PySpark pipelines migrating billions of invoice records from Oracle to Amazon Redshift, reducing execution time by 30% with zero critical data loss. • Led a team of three data engineers through technical design, sprint planning, code reviews, and production delivery.

Senior Data Engineer at HDFC Bank, Feb 2024 - Oct 2025 · 1 yr 9 mos, Bengaluru, Karnataka, India, • Led 100+ automated data quality pipelines across 100+ production tables and 20+ source systems, reducing validation effort by 90%. • Designed and implemented Azure Data Factory pipelines migrating enterprise data from Blob Storage to Azure Data Lake Storage, improving data availability by 30%. • Automated SharePoint data ingestion into a centralized datamart using PySpark on Databricks, eliminating manual effort across four data science verticals and improving data accessibility for 200+ data scientists. • Migrated Apache Airflow workflows to SSIS, reducing turnaround time by 25%. • Built Azure Logic Apps to automate VM scheduling, reducing cloud infrastructure costs by 25%.

Decision Scientist at Nation with NaMo, Dec 2023 - Feb 2024 · 3 mos, Gurugram, Haryana, India

Data Analyst at Nation with NaMo, Jun 2023 - Nov 2023 · 5 mo, Gurugram, Haryana, India

Data Scientist at Newgen Software, May 2022 - Jul 2022 · 3 mos

Research Project at Indian School of Business, Jul 2021 - Aug 2021 · 2 mos

Education

Integrated M.Sc. and M.Tech., Indian Institute of Technology, Kharagpur

Intermediate, 10+2, PCM, Saraswati Vidya Mandir, Roorkee