Yash Chaudhari profile photo 1 on Tal

Yash Chaudhari

Data Engineer

Pune District

3+ years of work experience

Tredence Inc.
Aug 20251 yrPresent

Pune District, Maharashtra, India

• Designed, optimized, and maintained PySpark-based ETL pipelines in Databricks, enhancing data quality and consistency across large-scale environments. • Migrated complex ETL pipelines from Azure to GCP, ensuring highly reliable data ingestion and transformation across distributed storage systems. • Automated schema mapping, validation, and reconciliation processes using PySpark, reducing manual validation by 60% and improving integrity across multiple data sources. • Improved cross-team collaboration by building structured technical documentation, validation frameworks, and operational runbooks. • Contributed to efficient analytical data models supporting business intelligence, high-volume reporting, and advanced analytics workloads. Tech Stack: Databricks, PySpark, GCP (BigQuery, Cloud Storage),Power BI Python, SQL, Data Validation, ETL Pipelines
Accenture
Oct 20231 yr 11 mosAug 2025

Pune District, Maharashtra, India

• Developed and maintained scalable data processing jobs in PySpark on Google Cloud Dataproc, handling large volumes of structured and semi-structured data (CSV, JSON, Parquet) sourced from Cloud Storage and ingested into BigQuery for downstream analytics. • Implemented efficient ETL/ELT workflows leveraging Apache Airflow (Cloud Composer) to orchestrate daily PySpark jobs on Dataproc, reducing manual effort by 80% and ensuring real-time data availability. • Optimized complex SQL queries and built star/snowflake data models in BigQuery with techniques like partitioning, clustering, and Slowly Changing Dimensions (SCD), improving report query performance and supporting self-service analytics. • Created production-ready datasets and views for the Data Science team using BigQuery, increasing model development efficiency by 30% and providing actionable insights to leadership.
Geecon Systems
Jun 20226 mosNov 2022

Mumbai, Maharashtra, India

Education

G.H. Raisoni College of Engineering(GHRCE), Nagpur

G.H. Raisoni College of Engineering(GHRCE), Nagpur

20194 yrs2023

Join Yash and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Yash Chaudhari on Tal

Headline

Data Engineer

About

I am a results-driven Data Engineer with 3 year of experience designing scalable data pipelines, managing large datasets, and implementing efficient ETL workflows. Proficient in SQL, Spark, Hive, Kafka, and cloud platforms like Google Cloud Platform (GCP) and Microsoft Azure, I specialize in delivering data solutions that drive impactful business decisions.

Location

Pune District

Work experience

Data Engineer at Tredence Inc., Aug 2025 - Present · 1 yr, Pune District, Maharashtra, India, • Designed, optimized, and maintained PySpark-based ETL pipelines in Databricks, enhancing data quality and consistency across large-scale environments. • Migrated complex ETL pipelines from Azure to GCP, ensuring highly reliable data ingestion and transformation across distributed storage systems. • Automated schema mapping, validation, and reconciliation processes using PySpark, reducing manual validation by 60% and improving integrity across multiple data sources. • Improved cross-team collaboration by building structured technical documentation, validation frameworks, and operational runbooks. • Contributed to efficient analytical data models supporting business intelligence, high-volume reporting, and advanced analytics workloads. Tech Stack: Databricks, PySpark, GCP (BigQuery, Cloud Storage),Power BI Python, SQL, Data Validation, ETL Pipelines

Software Associate at Accenture, Oct 2023 - Aug 2025 · 1 yr 11 mos, Pune District, Maharashtra, India, • Developed and maintained scalable data processing jobs in PySpark on Google Cloud Dataproc, handling large volumes of structured and semi-structured data (CSV, JSON, Parquet) sourced from Cloud Storage and ingested into BigQuery for downstream analytics. • Implemented efficient ETL/ELT workflows leveraging Apache Airflow (Cloud Composer) to orchestrate daily PySpark jobs on Dataproc, reducing manual effort by 80% and ensuring real-time data availability. • Optimized complex SQL queries and built star/snowflake data models in BigQuery with techniques like partitioning, clustering, and Slowly Changing Dimensions (SCD), improving report query performance and supporting self-service analytics. • Created production-ready datasets and views for the Data Science team using BigQuery, increasing model development efficiency by 30% and providing actionable insights to leadership.

Software Engineer at Geecon Systems, Jun 2022 - Nov 2022 · 6 mos, Mumbai, Maharashtra, India

Education

G.H. Raisoni College of Engineering(GHRCE), Nagpur

Yash Chaudhari - Data Engineer in Pune District | Tal