Headline

Senior Data Engineer | Python | SQL | PySpark | Apache Spark | AWS | Kafka | Airflow | Data Engineering

About

I'm a strong believer in continuous learning and self-improvement. I bring a critical thinking approach to challenges, tackling problems with a solutions-oriented mindset. I thrive in collaborative environments, working effectively with teammates to achieve common goals. My eagerness to learn new things ensures I'm constantly expanding my skillset, allowing me to contribute meaningfully to any project.

Location

Bengaluru

AI stack

hugging face

langchain

langgraph

openai

huggingface

ChatGPT

Work experience

Senior Associate Data Engineer at Alcon, Jun 2025 - Aug 2026 · 1 y 2 mo, Bengaluru, Karnataka, India, Designed and implemented AWS Glue (PySpark) data pipelines across HR and finance domains, processing large-scale datasets (~100M+ records) in production environments. Improved efficiency of a core HR data product by 26% by redesigning data modeling and implementing structured deduplication, reducing daily records from ~115K to ~85K while preserving complete data fidelity. Built solutions involving temporal data modeling, complex transformations, and rule-based logic to solve business-critical problems such as hierarchy mapping and KPI computation. Developed and orchestrated end-to-end ETL workflows handling high-volume batch data with monitoring, retry handling, and validation to ensure production reliability. Engineered a data health monitoring framework to validate high-volume data pipelines, detect anomalies, and provide real-time observability across production systems. Authored detailed technical documentation and architecture artifacts for data pipelines, enabling effective knowledge sharing and standardization across teams.

Data Engineer at e2open, Jul 2022 - May 2025 · 2 yrs 11 mos, Developed a scalable AWS-based data pipeline using Airflow, AWS Glue (PySpark), Lambda, and S3 with a medallion architecture. Designed modular parent-child DAG workflows enabling parallel execution and efficient orchestration of multiple data ingestion and transformation pipelines. Built a config-driven ingestion framework supporting multiple sources with schema and data validation. Implemented PySpark ETL pipelines with SCD Type 1 & 2 and incremental/full load strategies for efficient data processing. Enhanced data reliability and performance through data quality checks, partitioned Parquet storage, and improved pipeline observability.

Software Engineer at e2open, Jul 2022 - May 2025 · 2 yrs 11 mos, Bengaluru, Karnataka, India, Integration Engineering

Data Engineer at Wipro Limited, Sep 2020 - Jul 2022 · 1 yr 11 mos, Contributed to a data pipeline project utilizing AWS technologies for data staging, transformation, and reporting, ensuring seamless end-to-end processing. Managed data ingestion and staging by integrating diverse data sources into S3 buckets, enhanced data accessibility and reliability. Developed ETL jobs using AWS Glue and Athena for data validation, transformation, and cleansing.

Project Engineer at Wipro Limited, Sep 2020 - Jul 2022 · 1 yr 11 mos

Education

Professional Certificate Course In Data, Computer and Information Sciences and Support Services, ICT Academy, IIT Kanpur

Bachelor's degree, Computer Science, NIST University

Public links

github: https://github.com/kumarankit1612