---
title: "Soumya Bhadani - Data Engineer in Hyderabad | Tal"
description: "Meet Soumya Bhadani, GCP Data Engineer | BigQuery | Pyspark | Dataproc | Cloud Composer (Airflow) | Python | SQL based in Hyderabad. AI stack includes claude code, openai, and ChatGPT."
image: "https://tal.club/meet/soumya-bhadani/share-image"
---

# Soumya Bhadani on Tal

## Headline

GCP Data Engineer \| BigQuery \| Pyspark \| Dataproc \| Cloud Composer \(Airflow\) \| Python \| SQL

## About

Hey, I’m Soumya, a Data Engineer with 5\+ years of experience building end\-to\-end data platforms and analytics solutions on Google cloud Platform \(GCP\) using Google BigQuery, Dataproc \(PySpark\), Cloud Composer \(Managed Airflow\), Databricks, SQL\. I have worked across the entire data lifecycle—from API\-driven and enterprise data ingestion, data modeling, transformation, and orchestration to delivering curated insight layers, executive dashboards, and scalable data products\. My experience includes workforce analytics, security\-focused data initiatives, SharePoint integrations, and large\-scale reporting solutions supporting global business stakeholders\. I enjoy designing reliable data architectures, optimizing performance, and turning complex data into actionable insights that drive business decisions\. Outside of technology, I am passionate about continuously learning and solving challenging data problems through modern data engineering practices\.

## Location

Hyderabad

## AI stack

claude code

openai

ChatGPT

## Work experience

Data Engineer at Accenture, Aug 2021 \- Present · 5 yrs 4 mos, Hyderabad, Telangana, India

Engineering Analyst at Accenture Solutions Pvt\. Ltd\., Aug 2021 \- Present · 5 yrs 4 mos, Data Ingestion & Streaming ● Built a Python\-based ingestion pipeline extracting 17\+ Identity and Access Management \(IAM\) metrics from Microsoft Graph API on a 2\-hour refresh cycle, transforming data with Pandas and publishing to Kafka topics in AVRO format, feeding BigQuery to power a real\-time Global IT Security dashboard\. ● Created a reusable Kafka producer\-consumer framework for streaming ingestion, saving the client approximately $25K annually by eliminating dependency on licensed connectors\. ● Ingested and consolidated data from diverse sources including APIs, flat files, and SQL Servers into BigQuery, enabling centralized analytics and self\-service BI dashboards\. Data Transformation & Reporting ● Led end\-to\-end GCP data engineering initiatives — from requirement gathering and architecture design to project setup and ETL pipeline development, integrating BigQuery and Cloud Functions to produce Power BI dashboards backed by BigQuery Insight tables, accelerating business decisions by 90%\. ● Delivered a scalable reporting solution that reduced turnaround time by 40% and improved report accuracy, enabling faster, data\-driven decision\-making\. ● Automated ETL workflows using Apache Airflow \(Cloud Composer\) and BigQuery, reducing pipeline execution time from 2 hours to 2 minutes — a 98% performance improvement\. ● Designed and implemented incremental historical tables with Change Data Capture \(CDC\) for daily dataset refresh, ensuring compliance with PII data handling and retention policies\. ● Developed and optimized 100\+ SQL scripts and Python data parsers for flat files and XML datasets, improving data accuracy to 90%\+ and reducing query latency by 30%\. Data Quality, Monitoring & Reconciliation ● Built a data\-patrolling framework running on a 4\-hour cadence to validate raw table refresh status, row counts, and schema consistency before downstream pipelines execute, with post\-run checks confirming table\-wise row deltas — preventing pipeline execution on stal

## Education

Bachelor of Engineering, Electronics, AISSMS Institute of Information Technology

[View the original profile](https://tal.club/meet/soumya-bhadani)

```json
{
  "@context": "https://schema.org",
  "@graph": [
    {
      "@type": "Person",
      "@id": "https://tal.club/meet/soumya-bhadani#person",
      "name": "Soumya Bhadani",
      "url": "https://tal.club/meet/soumya-bhadani",
      "image": "https://tal.club/meet/soumya-bhadani/profile-photo.jpg",
      "description": "Meet Soumya Bhadani, GCP Data Engineer | BigQuery | Pyspark | Dataproc | Cloud Composer (Airflow) | Python | SQL based in Hyderabad. AI stack includes claude code, openai, and ChatGPT.",
      "jobTitle": "Data Engineer",
      "worksFor": {
        "@type": "Organization",
        "name": "Accenture"
      },
      "hasOccupation": {
        "@type": "Occupation",
        "name": "Data Engineer"
      },
      "homeLocation": {
        "@type": "Place",
        "name": "Hyderabad"
      },
      "alumniOf": [
        {
          "@type": "EducationalOrganization",
          "name": "AISSMS Institute of Information Technology"
        }
      ],
      "knowsAbout": [
        "claude code",
        "openai",
        "ChatGPT"
      ],
      "mainEntityOfPage": {
        "@id": "https://tal.club/meet/soumya-bhadani#webpage"
      }
    },
    {
      "@type": "ProfilePage",
      "@id": "https://tal.club/meet/soumya-bhadani#webpage",
      "url": "https://tal.club/meet/soumya-bhadani",
      "name": "Soumya Bhadani on Tal",
      "description": "Meet Soumya Bhadani, GCP Data Engineer | BigQuery | Pyspark | Dataproc | Cloud Composer (Airflow) | Python | SQL based in Hyderabad. AI stack includes claude code, openai, and ChatGPT.",
      "dateModified": "2026-11-09T00:20:18.360Z",
      "isPartOf": {
        "@id": "https://tal.club/#website"
      },
      "mainEntity": {
        "@id": "https://tal.club/meet/soumya-bhadani#person"
      },
      "primaryImageOfPage": {
        "@type": "ImageObject",
        "url": "https://tal.club/meet/soumya-bhadani/profile-photo.jpg",
        "contentUrl": "https://tal.club/meet/soumya-bhadani/profile-photo.jpg",
        "caption": "Soumya Bhadani profile photo on Tal"
      },
      "inLanguage": "en-IN"
    }
  ]
}
```