Headline

Data Engineer | Available Immediately | Remote Only | Snowflake, PySpark, Kafka | Teradata → Snowflake Migration

About

Data Engineer with 4+ years of experience building scalable ETL pipelines and real-time data ingestion systems across enterprise analytics platforms. My work primarily focuses on designing reliable data pipelines using PySpark, Kafka, and Snowflake while modernizing legacy data warehouse systems such as Teradata and Greenplum into cloud-native architectures. Key areas I work in: • Distributed ETL pipelines using PySpark • Real-time ingestion architectures using Kafka • Snowflake data warehousing and optimization • Data warehouse modernization (Teradata → Snowflake) • Data quality frameworks and automation using Python • Workflow orchestration using Autosys and CI/CD tools Technologies: PySpark • Kafka • Snowflake • Teradata • Informatica • Python • SQL • Autosys • Jenkins • Git

Location

Mumbai

AI stack

opencode

claudecode

Work experience

Data Engineer at Morgan Stanley, Sep 2023 - Present · 3 yrs, Mumbai, Maharashtra, India, Consultant – Data Engineering Wissen Technology (Client: Morgan Stanley) Working as a consultant at Morgan Stanley (client location) through Wissen Technology, contributing to large-scale enterprise data engineering and warehouse modernization initiatives. • Designed and developed distributed PySpark-based ETL pipelines supporting 40+ downstream data consumers across enterprise analytics platforms. • Led migration of 80+ dimension tables from Teradata and Greenplum to Snowflake as part of a large-scale data warehouse modernization program. • Built Kafka-based real-time ingestion architecture integrated with Spring Boot services enabling insert, update, and delete event propagation across systems. • Optimized 200+ ETL workflows and implemented 100+ Autosys schedules improving pipeline reliability, orchestration, and monitoring. • Developed Python automation frameworks for data quality validation and cross-environment synchronization, reducing manual operational effort. • Led upgrade of Informatica PowerCenter (10.2 → 10.5) ensuring stable migration and compatibility across environments.

Associate Consultant at Capgemini Invent, Jan 2022 - Apr 2023 · 1 yr 4 mos, India, • Built SQL-based data quality framework with 350+ validation checks across Snowflake layers ensuring governance and consistency. • Designed ETL pipelines and transformations supporting 65+ tables powering 250+ enterprise reports. • Developed reusable SQL modules that reduced operational effort from 15 hours to 15 minutes. • Built internal tools using Python (Flask) and Angular to improve SQL execution performance and monitoring. • Worked extensively with Snowflake and Informatica IICS for ETL development and production support.

Senior Analyst at Capgemini Invent, Nov 2020 - Jan 2022 · 1 yr 3 mos, India

Internship Trainee at Technovision Engineers Pvt. Ltd. Pune, Dec 2019 - May 2020 · 6 mos

Internship Trainee at LG Electronics, Jun 2018 - Dec 2018 · 7 mos, Pune, Trainee engineer at TV Mfg. Dept.

Education

Bachelor of Engineering, COEP (College of Engineering, Pune)