Headline

Data Engineer | AWS | PySpark | Apache Airflow | ETL Pipeline Development & Data Processing

About

Results-driven Data Engineer with experience designing, developing, and optimizing end-to-end data pipelines on AWS Cloud. Proficient in PySpark for distributed data processing, Apache Airflow for scheduling and orchestration, and building reliable, scalable ETL workflows to support analytics and business intelligence.

Location

Noida

AI stack

gemini

grok

Work experience

System Engineer at Tata Consultancy Services, Nov 2022 - Present · 3 y 10 mo, Noida, Uttar Pradesh, India, • Designed and implemented scalable data pipelines on AWS Cloud to process and transform large volumes of data • Built and optimized ETL workflows using PySpark for distributed data processing • Orchestrated and scheduled data pipelines using Apache Airflow (DAGs) • Worked with AWS services such as S3, EC2, EMR/Glue, and Redshift for end-to-end data solutions • Improved data processing performance and reliability through job optimization and monitoring • Collaborated with analytics and business teams to deliver high-quality, analytics-ready datasets

Education

Bachelor of Technology - BTech, Computer Science, MORADABAD INSTITUTE OF TECHNOLOGY, MORADABAD.

S.S. CHILDREN ACADEMY