---
title: "Shubham Y. - Senior Data Engineer in Bengaluru | Tal"
description: "Meet Shubham Y., Senior Data Engineer at Target | Ex-Walmart, Ex- TataNeu based in Bengaluru. AI stack includes claude code, cursor, and github copilot."
image: "https://tal.club/meet/shubham-yadav-12/share-image"
---

# Shubham Y\. on Tal

## Headline

Senior Data Engineer at Target \| Ex\-Walmart, Ex\- TataNeu

## About

As a Data Engineer with 6 years of experience, l excel in designing, developing, and optimizing data pipelines and workflows to ensure efficient data management and analysis\. I am highly proficient in both Azure and GCP platforms, with expertise in ETL operations, data modeling, data ingestion, data transformation, and data quality\. My experience includes using PySpark scripts for complex data manipulation and analysis\. Recently, I successfully led a project to migrate a large\-scale data warehouse from Azure to AWS, leveraging tools and technologies such as Airflow, Databricks, S3, Glue, and Snowflake\. I am committed to driving innovation and achieving meaningful results for businesses\. I strive to apply my skills and knowledge to deliver value to customers and stakeholders, while consistently learning and developing as a data professional\.

## Location

Bengaluru

## AI stack

claude code

cursor

github copilot

grok

## Work experience

Senior Data Engineer at Target, Jul 2025 \- Present · 1 yr 3 mos, Bengaluru, Karnataka, India

Data Engineer at Walmart Global Tech India, Jan 2024 \- Jul 2025 · 1 yr 7 mos, Hybrid, Spearheaded the upgrade of data pipelines from ORC file format to Apache Hudi slashing runtime by 30% and unlocking advanced capabilities such as upserts, deletes, and time\-travel queries, which enhanced data management flexibility and reduced operational overhead\. transformative redesign of pipeline workflows, shifting from full load to incremental delta load processing in incremental data processing throughput\. Engineered secure, scalable data pipelines for shipment and payment datasets, integrating near\-real\-time \(NRT\) streaming and batch processing capabilities with robust validation checks, ensuring data accuracy and supporting mission\-critical business operations\. Designed and deployed a suite of interactive, data\-driven reports, delivering actionable insights to cross\-functional stakeholders\.

Data Engineer\- L2 at Tata Digital, Jul 2020 \- Dec 2023 · 3 y 5 mo, Bengaluru, Karnataka, India, • Collect requirements and design pipelines to ingest data from different sources and publishing the data as is in raw layer\. • Created and managed GMV and NMV data\-mart which is currently being used for billing with the respective brand\. • Independently engaged with business, architectural, cross\-brand and cross team stake holders to gather and implement pipeline and data\-mart requirements\. • Solutioning , developing and implementing modern data warehouse in Azure Cloud\. • Interacting with multiple downstream partners on daily basis like Chat Bot, Customer service, Data Science, Analytics, Reporting team to solve any issue related to the data\. • Developing ETL to handle multiple file\-formats e\.g\. parquet, delta lake, avro, csv, Json, XMLs for data ingestion thru ADF and Databricks\. • Real time data ingestion through streaming from Event\-Hub and Cosmos DB and loading them to DataLake and Datawarehouse\. • Developed data pipelines in ADF to interact with multiple source systems ensuring smooth flow of large\-scale data\. • Working with Data Architect to build Data Models for Data\-Warehousing\.

## Education

Master of Computer Applications \- MCA, National Institute of Technology, Tiruchirappalli

[View the original profile](https://tal.club/meet/shubham-yadav-12)

```json
{
  "@context": "https://schema.org",
  "@graph": [
    {
      "@type": "Person",
      "@id": "https://tal.club/meet/shubham-yadav-12#person",
      "name": "Shubham Y.",
      "url": "https://tal.club/meet/shubham-yadav-12",
      "image": "https://tal.club/meet/shubham-yadav-12/profile-photo.jpg",
      "description": "Meet Shubham Y., Senior Data Engineer at Target | Ex-Walmart, Ex- TataNeu based in Bengaluru. AI stack includes claude code, cursor, and github copilot.",
      "jobTitle": "Senior Data Engineer",
      "worksFor": {
        "@type": "Organization",
        "name": "Target"
      },
      "hasOccupation": {
        "@type": "Occupation",
        "name": "Senior Data Engineer"
      },
      "homeLocation": {
        "@type": "Place",
        "name": "Bengaluru"
      },
      "alumniOf": [
        {
          "@type": "EducationalOrganization",
          "name": "National Institute of Technology, Tiruchirappalli"
        }
      ],
      "knowsAbout": [
        "claude code",
        "cursor",
        "github copilot",
        "grok"
      ],
      "mainEntityOfPage": {
        "@id": "https://tal.club/meet/shubham-yadav-12#webpage"
      }
    },
    {
      "@type": "ProfilePage",
      "@id": "https://tal.club/meet/shubham-yadav-12#webpage",
      "url": "https://tal.club/meet/shubham-yadav-12",
      "name": "Shubham Y. on Tal",
      "description": "Meet Shubham Y., Senior Data Engineer at Target | Ex-Walmart, Ex- TataNeu based in Bengaluru. AI stack includes claude code, cursor, and github copilot.",
      "dateModified": "2026-09-04T13:38:58.739Z",
      "isPartOf": {
        "@id": "https://tal.club/#website"
      },
      "mainEntity": {
        "@id": "https://tal.club/meet/shubham-yadav-12#person"
      },
      "primaryImageOfPage": {
        "@type": "ImageObject",
        "url": "https://tal.club/meet/shubham-yadav-12/profile-photo.jpg",
        "contentUrl": "https://tal.club/meet/shubham-yadav-12/profile-photo.jpg",
        "caption": "Shubham Y. profile photo on Tal"
      },
      "inLanguage": "en-IN"
    }
  ]
}
```