Data Engineer II @ Mastercard | 2x GCP Certified | PySpark, SQL, Airflow, Hadoop | ETL & Big Data | Fintech Domain



Pune District, Maharashtra, India

Pune District, Maharashtra, India





Bachelor of Engineering - BE, Information Technology
Government College of Engineering Aurangabad
Diploma, Information Technology
puranmal lahoti government polytechnic latur
Join Vaishnavi and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossData Engineer II @ Mastercard | 2x GCP Certified | PySpark, SQL, Airflow, Hadoop | ETL & Big Data | Fintech Domain
💳 Data Engineer at Mastercard with expertise in Hadoop, PySpark, Airflow, and Bitbucket, specializing in automation, optimization, and scalable data pipeline development. ⚡ Achieved a 4x performance boost by reducing pipeline execution time from 7 days to 3 days through advanced PySpark automation and tuning. 🔄 Built CI/CD workflows and led Airflow migration ensuring scalable, reliable, and production-ready orchestration. ☁️ Google Cloud Certified Data Engineer with prior GCP experience in cloud-based ETL, data architecture, and scalable platform design, bringing both on-premises and cloud expertise.
Pimpri Chinchwad
antigravity
cursor
Data Engineer 2 at Mastercard, Nov 2024 - Present · 1 yr 10 mos, ● Spearheaded migration of 10+ on-premise workflows to Apache Airflow, establishing GitHub repositorie, reducing deployment time by 30%. ● Automated complex data pipelines using PySpark, improving processing efficiency and scalability by 40%. ● Leveraged Gen AI for agent creation and prompt-driven solutions to optimize repetitive workflows and boost productivity.
GCP Data Engineer at Altimetrik, May 2024 - Oct 2024 · 6 mos, Worked as CW -PayPal ● Developed GCP-based data pipelines using BigQuery, Dataproc, Hadoop, and Cloud Storage. ● Deployed workflows using CI/CD pipelines for automated releases.
Data engineering Analyst at Accenture, Dec 2022 - May 2024 · 1 yr 6 mos, Pune District, Maharashtra, India, ● Designed robust pipelines with Apache Airflow and Google Cloud Dataflow using Apache Beam SDK. Ingested Pub/Sub messages into BigQuery for improved real-time processing. ● Automated data transformations and communication using ML models and Pub/Sub.
Data engineering Associate at Accenture, Oct 2021 - Nov 2022 · 1 yr 2 mos, Pune District, Maharashtra, India, ● Developed Hive queries and enhanced Hadoop YARN clusters. ● Migrated on-premises data to GCP and performed root cause analysis on failing queries. Automated QA and development with PySpark scripts, reducing time by 50%. ● Built automation scripts for verifying HDFS commands and Hive query results. ● Created ARIMA ML models to predict job execution durations for resource optimization. Automated defect analytics by parsing JIRA exports.
Blockchain & React.js Developer intern at Happymonk.ai, Apr 2021 - Jul 2021 · 4 mos
Intern at FAB SOFTWARE STOCK, Dec 2019 - Jan 2020 · 2 mos, Intern in .Net
Bachelor of Engineering - BE, Information Technology, Government College of Engineering Aurangabad
Diploma, Information Technology, puranmal lahoti government polytechnic latur