---
title: "Yash D. - Manager – Data Engineering / Analytics in Bengaluru | Tal"
description: "Meet Yash D., Data Engineer | Databricks | PySpark | Python | SQL | AWS | ETL/ELT | Apache Spark | Data Pipelines based in Bengaluru. AI stack includes github copilot, openai, and Microsoft Copilot."
image: "https://tal.club/meet/yash-didwania/share-image"
---

# Yash D\. on Tal

## Headline

Data Engineer \| Databricks \| PySpark \| Python \| SQL \| AWS \| ETL/ELT \| Apache Spark \| Data Pipelines

## About

Data Engineer with 7 years of IT experience, including 4\+ years focused on building scalable cloud data platforms and data pipelines\. I specialise in Python, SQL, PySpark, Databricks, Apache Spark and AWS, with hands\-on experience designing and optimising ETL/ELT workflows, distributed data processing, data quality frameworks and analytical data solutions\. My experience includes: • Data Engineering: ETL/ELT, data pipelines, data modelling, data quality and validation • Big Data: Databricks, PySpark, Apache Spark, Parquet and large\-scale data processing • Cloud: AWS S3, Glue, Redshift, EMR and Athena • Programming: Python and SQL • Orchestration & Development: Apache Airflow, Git, GitHub and CI/CD • Analytics: Analytical datasets, reporting automation and Power BI I enjoy working at the intersection of data engineering, cloud platforms and business requirements, partnering with engineering and business stakeholders to build reliable, scalable data solutions and improve data\-processing performance\.

## Location

Bengaluru

## AI stack

github copilot

openai

Microsoft Copilot

## Work experience

Manager – Data Engineering / Analytics at GENPACT, Jan 2026 \- Present · 10 mos, Bengaluru, • Designed an enterprise Data Quality Intelligence Platform \(DQIP\) using Python, SQL, and AWS Redshift for automated data quality, governance, and vendor performance monitoring across 100\+ data assets, receiving client executive approval for pilot implementation\. • Automated multi\-brand reporting workflows using Python and Power Automate, reducing manual effort by 400\+ minutes per reporting cycle and significantly improving reporting turnaround\. • Re\-engineered legacy R\-based reporting into a reusable, parameterized Python framework, reducing execution time by up to 83% while improving scalability and maintainability\.

Associate at Axtria \- Ingenious Insights, Jun 2024 \- Dec 2025 · 1 yr 7 mos, Bengaluru · Hybrid, • Reduced pipeline processing time by 1\.5\+ hours by optimizing and parallelizing high\-runtime jobs\. • Led migration to Databricks, enabling a 55% cost reduction through optimized architecture\. • Built scalable PySpark pipelines for multi\-source data ingestion into Amazon S3 \(Parquet\)\. • Designed and orchestrated workflows using Airflow DAGs, improving data reliability\. • Implemented data quality frameworks via Collibra, achieving 70%\+ accuracy\.

Data Analyst at Axtria \- Ingenious Insights, Jun 2022 \- May 2024 · 2 yrs, Bengaluru · Hybrid, • Processed 500M\+ data points using PySpark & SQL to drive analytics and reduce client costs by 70%\. • Collaborated with product & engineering teams to define requirements and build scalable data solutions\. • Built interactive Power BI dashboards and executive reports delivering actionable insights that supported business decisions and operational improvements\.

Associate Software Engineer at DXC Technology, Jul 2019 \- May 2022 · 2 yrs 11 mos, Bengaluru, • Developed SQL\-driven enterprise applications and backend services using SQL Server and \.NET, improving operational efficiency and reducing processing time by 20%\. • Automated operational workflows and SQL\-based reporting processes, saving 100\+ hours of manual effort per month while reducing production incidents\. • Developed optimized SQL stored procedures, data validation checks, and database enhancements, reducing data\-related issues by 35% and improving application reliability\.

Software Engineer Intern at Nanyang Technological University, Dec 2017 \- Jan 2018 · 2 mos, Singapore, • Developed an 'Employee Attrition' model in R using historical workforce data to estimate employee tenure and identify key attrition drivers\. • Gained foundational knowledge in Artificial Neural Networks \(ANN\) and Hadoop ecosystems to understand industry\-standard data processing and modeling techniques\.

Intern at Defense Research and Development Laboratory, Jun 2017 \- Jun 2017 · 1 mo, Balasore Area, India, • Contributed to the development of a web application for streamlining employee quarter allotment, improving administrative efficiency\. • Ensured strict adherence to data security protocols to maintain confidentiality and protect sensitive employee information\.

## Education

Bachelor of Technology \- BTech, Information Technology, SRM IST Chennai

[View the original profile](https://tal.club/meet/yash-didwania)

```json
{
  "@context": "https://schema.org",
  "@graph": [
    {
      "@type": "Person",
      "@id": "https://tal.club/meet/yash-didwania#person",
      "name": "Yash D.",
      "url": "https://tal.club/meet/yash-didwania",
      "image": "https://tal.club/meet/yash-didwania/profile-photo.jpg",
      "description": "Meet Yash D., Data Engineer | Databricks | PySpark | Python | SQL | AWS | ETL/ELT | Apache Spark | Data Pipelines based in Bengaluru. AI stack includes github copilot, openai, and Microsoft Copilot.",
      "jobTitle": "Manager – Data Engineering / Analytics",
      "worksFor": {
        "@type": "Organization",
        "name": "GENPACT"
      },
      "hasOccupation": {
        "@type": "Occupation",
        "name": "Manager – Data Engineering / Analytics"
      },
      "homeLocation": {
        "@type": "Place",
        "name": "Bengaluru"
      },
      "alumniOf": [
        {
          "@type": "EducationalOrganization",
          "name": "SRM IST Chennai"
        }
      ],
      "knowsAbout": [
        "github copilot",
        "openai",
        "Microsoft Copilot"
      ],
      "mainEntityOfPage": {
        "@id": "https://tal.club/meet/yash-didwania#webpage"
      }
    },
    {
      "@type": "ProfilePage",
      "@id": "https://tal.club/meet/yash-didwania#webpage",
      "url": "https://tal.club/meet/yash-didwania",
      "name": "Yash D. on Tal",
      "description": "Meet Yash D., Data Engineer | Databricks | PySpark | Python | SQL | AWS | ETL/ELT | Apache Spark | Data Pipelines based in Bengaluru. AI stack includes github copilot, openai, and Microsoft Copilot.",
      "dateModified": "2026-10-12T12:11:18.462Z",
      "isPartOf": {
        "@id": "https://tal.club/#website"
      },
      "mainEntity": {
        "@id": "https://tal.club/meet/yash-didwania#person"
      },
      "primaryImageOfPage": {
        "@type": "ImageObject",
        "url": "https://tal.club/meet/yash-didwania/profile-photo.jpg",
        "contentUrl": "https://tal.club/meet/yash-didwania/profile-photo.jpg",
        "caption": "Yash D. profile photo on Tal"
      },
      "inLanguage": "en-IN"
    }
  ]
}
```