Yash D. profile photo 1 on Tal

Yash D.

Data Engineer | Databricks | PySpark | Python | SQL | AWS | ETL/ELT | Apache Spark | Data Pipelines

Bengaluru

7+ years of work experience

GENPACT
Jan 202610 mosPresent

Bengaluru

• Designed an enterprise Data Quality Intelligence Platform (DQIP) using Python, SQL, and AWS Redshift for automated data quality, governance, and vendor performance monitoring across 100+ data assets, receiving client executive approval for pilot implementation. • Automated multi-brand reporting workflows using Python and Power Automate, reducing manual effort by 400+ minutes per reporting cycle and significantly improving reporting turnaround. • Re-engineered legacy R-based reporting into a reusable, parameterized Python framework, reducing execution time by up to 83% while improving scalability and maintainability.
Axtria - Ingenious Insights
Jun 20241 yr 7 mosDec 2025

Bengaluru · Hybrid

• Reduced pipeline processing time by 1.5+ hours by optimizing and parallelizing high-runtime jobs. • Led migration to Databricks, enabling a 55% cost reduction through optimized architecture. • Built scalable PySpark pipelines for multi-source data ingestion into Amazon S3 (Parquet). • Designed and orchestrated workflows using Airflow DAGs, improving data reliability. • Implemented data quality frameworks via Collibra, achieving 70%+ accuracy.
Axtria - Ingenious Insights
Jun 20222 yrsMay 2024

Bengaluru · Hybrid

• Processed 500M+ data points using PySpark & SQL to drive analytics and reduce client costs by 70%. • Collaborated with product & engineering teams to define requirements and build scalable data solutions. • Built interactive Power BI dashboards and executive reports delivering actionable insights that supported business decisions and operational improvements.
DXC Technology
Jul 20192 yrs 11 mosMay 2022

Bengaluru

• Developed SQL-driven enterprise applications and backend services using SQL Server and .NET, improving operational efficiency and reducing processing time by 20%. • Automated operational workflows and SQL-based reporting processes, saving 100+ hours of manual effort per month while reducing production incidents. • Developed optimized SQL stored procedures, data validation checks, and database enhancements, reducing data-related issues by 35% and improving application reliability.
Nanyang Technological University
Dec 20172 mosJan 2018

Singapore

• Developed an 'Employee Attrition' model in R using historical workforce data to estimate employee tenure and identify key attrition drivers. • Gained foundational knowledge in Artificial Neural Networks (ANN) and Hadoop ecosystems to understand industry-standard data processing and modeling techniques.
Defense Research and Development Laboratory
Jun 20171 moJun 2017

Balasore Area, India

• Contributed to the development of a web application for streamlining employee quarter allotment, improving administrative efficiency. • Ensured strict adherence to data security protocols to maintain confidentiality and protect sensitive employee information.

Yash’s AI Stack

github copilot
github copilot
openai
openai
Microsoft Copilot
Microsoft Copilot

Education

SRM IST Chennai

Bachelor of Technology - BTech, Information Technology

SRM IST Chennai

20154 yrs2019

Join Yash and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Yash D. on Tal

Headline

Data Engineer | Databricks | PySpark | Python | SQL | AWS | ETL/ELT | Apache Spark | Data Pipelines

About

Data Engineer with 7 years of IT experience, including 4+ years focused on building scalable cloud data platforms and data pipelines. I specialise in Python, SQL, PySpark, Databricks, Apache Spark and AWS, with hands-on experience designing and optimising ETL/ELT workflows, distributed data processing, data quality frameworks and analytical data solutions. My experience includes: • Data Engineering: ETL/ELT, data pipelines, data modelling, data quality and validation • Big Data: Databricks, PySpark, Apache Spark, Parquet and large-scale data processing • Cloud: AWS S3, Glue, Redshift, EMR and Athena • Programming: Python and SQL • Orchestration & Development: Apache Airflow, Git, GitHub and CI/CD • Analytics: Analytical datasets, reporting automation and Power BI I enjoy working at the intersection of data engineering, cloud platforms and business requirements, partnering with engineering and business stakeholders to build reliable, scalable data solutions and improve data-processing performance.

Location

Bengaluru

AI stack

github copilot

openai

Microsoft Copilot

Work experience

Manager – Data Engineering / Analytics at GENPACT, Jan 2026 - Present · 10 mos, Bengaluru, • Designed an enterprise Data Quality Intelligence Platform (DQIP) using Python, SQL, and AWS Redshift for automated data quality, governance, and vendor performance monitoring across 100+ data assets, receiving client executive approval for pilot implementation. • Automated multi-brand reporting workflows using Python and Power Automate, reducing manual effort by 400+ minutes per reporting cycle and significantly improving reporting turnaround. • Re-engineered legacy R-based reporting into a reusable, parameterized Python framework, reducing execution time by up to 83% while improving scalability and maintainability.

Associate at Axtria - Ingenious Insights, Jun 2024 - Dec 2025 · 1 yr 7 mos, Bengaluru · Hybrid, • Reduced pipeline processing time by 1.5+ hours by optimizing and parallelizing high-runtime jobs. • Led migration to Databricks, enabling a 55% cost reduction through optimized architecture. • Built scalable PySpark pipelines for multi-source data ingestion into Amazon S3 (Parquet). • Designed and orchestrated workflows using Airflow DAGs, improving data reliability. • Implemented data quality frameworks via Collibra, achieving 70%+ accuracy.

Data Analyst at Axtria - Ingenious Insights, Jun 2022 - May 2024 · 2 yrs, Bengaluru · Hybrid, • Processed 500M+ data points using PySpark & SQL to drive analytics and reduce client costs by 70%. • Collaborated with product & engineering teams to define requirements and build scalable data solutions. • Built interactive Power BI dashboards and executive reports delivering actionable insights that supported business decisions and operational improvements.

Associate Software Engineer at DXC Technology, Jul 2019 - May 2022 · 2 yrs 11 mos, Bengaluru, • Developed SQL-driven enterprise applications and backend services using SQL Server and .NET, improving operational efficiency and reducing processing time by 20%. • Automated operational workflows and SQL-based reporting processes, saving 100+ hours of manual effort per month while reducing production incidents. • Developed optimized SQL stored procedures, data validation checks, and database enhancements, reducing data-related issues by 35% and improving application reliability.

Software Engineer Intern at Nanyang Technological University, Dec 2017 - Jan 2018 · 2 mos, Singapore, • Developed an 'Employee Attrition' model in R using historical workforce data to estimate employee tenure and identify key attrition drivers. • Gained foundational knowledge in Artificial Neural Networks (ANN) and Hadoop ecosystems to understand industry-standard data processing and modeling techniques.

Intern at Defense Research and Development Laboratory, Jun 2017 - Jun 2017 · 1 mo, Balasore Area, India, • Contributed to the development of a web application for streamlining employee quarter allotment, improving administrative efficiency. • Ensured strict adherence to data security protocols to maintain confidentiality and protect sensitive employee information.

Education

Bachelor of Technology - BTech, Information Technology, SRM IST Chennai