Vishal Gupta profile photo 1 on Tal

Vishal Gupta

Data & AI Engineer | Databricks · Azure · Snowflake · LangChain · RAG | Agentic AI · ETL Pipelines · PySpark | 2× Databricks Certified|250+ DSA Leetcode

Noida

3+ years of work experience

Tata Consultancy Services
Sep 20251 yr 1 moPresent

🔹 Engineered end-to-end ETL pipelines using Azure Data Factory and Azure Databricks to migrate 240+ GB of enterprise data across 34 on-premise tables into Azure Data Lake Storage Gen2 — achieving zero data loss and full data quality validation at scale. 🔹 Architected Delta Lake Bronze–Silver–Gold Medallion framework with a strong focus on data modeling and data warehousing, integrating Gold-layer datasets with Azure Synapse Analytics to enable BI and analytics consumption for 5+ business teams. 🔹 Optimised PySpark transformations for high-volume datasets including individual tables exceeding 13+ GB, reducing processing time by ~40% and enforcing coding standards across all pipeline modules. 🔹 Designed a cross-cloud healthcare data pipeline ingesting FHIR data from GCP BigQuery into Azure Databricks, supporting ML-driven risk stratification and gap-in-care prediction for 10,000+ patient records. 🔹 Delivered analytics-ready datasets enabling downstream ML workflows that contributed to reduced PMPM (Per Member Per Month) healthcare costs through improved patient risk categorisation. 🔹 Built a client-facing Generative AI POC using Python and LangChain for intelligent natural language querying of structured enterprise data via REST APIs — reducing analyst query time by ~50%. 🔹 Developed automated data validation and quality frameworks using Python and SQL across 34+ pipeline tables, reducing data quality incidents by ~60% in production environments. 🔹 Collaborated with analysts, ML engineers, and business stakeholders to translate requirements into 3+ production-ready data solutions, delivered within Agile sprint timelines.
Tata Consultancy Services
Mar 20241 yr 7 mosSep 2025

GeeksforGeeks
Nov 20231 yr 1 moNov 2024

Noida, Uttar Pradesh, India

Authored 10+ technical articles on Python, Flask,JavaScript for GeeksforGeeks, reaching a combined audience of 50,000+ monthly readers.
Chawla Ispat Private Limited
Jul 20239 mosMar 2024

Rudrapur, Uttarakhand, India

I am mostly working on the backend. I have created two big projects. In the first project I created API for salary calculation and automated active and deactivated users; in the second project, I created API for godown and vendor management.
KiwiTech
Jul 20222 mosAug 2022

Noida, Uttar Pradesh, India

In this internship, I am a python developer intern. Responsibility to connect the web pages to the Django framework. It helps me helped in developing the soft skills that are much needed in the workplace and in leadership positions.

Vishal’s AI Stack

antigravity
antigravity
claude code
claude code
gemini
gemini
langchain
langchain
langgraph
langgraph
mcp
mcp

Education

Ims engineering college

B.tech, Computer Science

Ims engineering college

20194 yrs2023

Join Vishal and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Vishal Gupta on Tal

Headline

Data & AI Engineer | Databricks · Azure · Snowflake · LangChain · RAG | Agentic AI · ETL Pipelines · PySpark | 2× Databricks Certified|250+ DSA Leetcode

About

I build data systems that actually make it to production — and AI layers on top of them that deliver real business value. At Tata Consultancy Services, I work across the full stack of modern data & AI engineering: designing Medallion Architecture pipelines on Databricks, engineering Snowflake data warehouses, and building LangChain-powered agentic workflows. My work spans both sides of the stack — clean, reliable data infrastructure and intelligent AI systems on top of it. On the Data side, I've migrated 240+ GB of enterprise data into Azure Data Lake, built watermark-based incremental ETL pipelines with ADF, and cut BI query times by ~30% through Snowflake schema optimization and clustering strategies. On the AI side, I've delivered production agentic workflows for a US healthcare client (Humana) — including a FHIR appointment booking agent with multi-step tool calling, a .NET Package Upgrader Agent, and a RAG-based clinical NLP system using LangChain and Azure OpenAI. The GenAI POC earned me the TCS Warrior Award. I've also built cross-cloud healthcare pipelines connecting GCP BigQuery → Databricks → Snowflake, feeding patient risk stratification models. Certifications: Databricks Data Engineer Associate · Databricks GenAI Developer Associate · Microsoft AZ-900 · AI-900 📍 Noida, India · Open to Data Engineer, AI/ML Engineer, and GenAI Developer roles — India or remote/global opportunities.

Location

Noida

AI stack

antigravity

claude code

gemini

langchain

langgraph

mcp

Work experience

Data Engineer | System Engineer at Tata Consultancy Services, Sep 2025 - Present · 1 yr 1 mo, 🔹 Engineered end-to-end ETL pipelines using Azure Data Factory and Azure Databricks to migrate 240+ GB of enterprise data across 34 on-premise tables into Azure Data Lake Storage Gen2 — achieving zero data loss and full data quality validation at scale. 🔹 Architected Delta Lake Bronze–Silver–Gold Medallion framework with a strong focus on data modeling and data warehousing, integrating Gold-layer datasets with Azure Synapse Analytics to enable BI and analytics consumption for 5+ business teams. 🔹 Optimised PySpark transformations for high-volume datasets including individual tables exceeding 13+ GB, reducing processing time by ~40% and enforcing coding standards across all pipeline modules. 🔹 Designed a cross-cloud healthcare data pipeline ingesting FHIR data from GCP BigQuery into Azure Databricks, supporting ML-driven risk stratification and gap-in-care prediction for 10,000+ patient records. 🔹 Delivered analytics-ready datasets enabling downstream ML workflows that contributed to reduced PMPM (Per Member Per Month) healthcare costs through improved patient risk categorisation. 🔹 Built a client-facing Generative AI POC using Python and LangChain for intelligent natural language querying of structured enterprise data via REST APIs — reducing analyst query time by ~50%. 🔹 Developed automated data validation and quality frameworks using Python and SQL across 34+ pipeline tables, reducing data quality incidents by ~60% in production environments. 🔹 Collaborated with analysts, ML engineers, and business stakeholders to translate requirements into 3+ production-ready data solutions, delivered within Agile sprint timelines.

Assistant System Engineer at Tata Consultancy Services, Mar 2024 - Sep 2025 · 1 yr 7 mos

Technical content writer at GeeksforGeeks, Nov 2023 - Nov 2024 · 1 yr 1 mo, Noida, Uttar Pradesh, India, Authored 10+ technical articles on Python, Flask,JavaScript for GeeksforGeeks, reaching a combined audience of 50,000+ monthly readers.

Software Developer at Chawla Ispat Private Limited, Jul 2023 - Mar 2024 · 9 mos, Rudrapur, Uttarakhand, India, I am mostly working on the backend. I have created two big projects. In the first project I created API for salary calculation and automated active and deactivated users; in the second project, I created API for godown and vendor management.

Python trainee at KiwiTech, Jul 2022 - Aug 2022 · 2 mos, Noida, Uttar Pradesh, India, In this internship, I am a python developer intern. Responsibility to connect the web pages to the Django framework. It helps me helped in developing the soft skills that are much needed in the workplace and in leadership positions.

Education

B.tech, Computer Science, Ims engineering college

Public links

github: https://github.com/v889