Headline

Data Engineer | GCP & Azure ETL Pipelines for Banking Enterprose | BigQuery, Airflow, PySpark, Jenkins, ETL

About

I like fixing things that are slow, broken, or silently wrong — and in data engineering, that's most of the job. I'm a Data Engineer based in Hyderabad, currently working with GCP on enterprise banking data at HSBC through Sparta Global, where I build the pipelines that turn messy source data into something analysts and reporting teams can actually trust. Most of my day-to-day lives in BigQuery and Apache Airflow: designing SCD Type 1/2 tables, mapping source-to-target transformations, and orchestrating end-to-end ETL workflows with proper dependency management. I also spend a lot of time on the unglamorous but critical stuff — data validation, reconciliation, and catching quality issues before they become someone else's problem downstream. Jenkins handles my CI/CD so deployments to production don't turn into fire drills. Before this, I worked on the Azure side at Data Maxis, building batch and near real-time ingestion pipelines with Azure Data Factory and Databricks, and processing structured and semi-structured data through Synapse Analytics and Delta Lake. That mix of GCP and Azure experience means I don't get tunnel vision on one cloud's way of doing things — I've had to solve the same kinds of problems (partitioning, performance tuning, reliable ingestion) in two very different ecosystems. A few things I'm solid at: → Building and orchestrating ETL/ELT pipelines (Airflow, ADF, PySpark) → Cloud data warehousing (BigQuery, Synapse, Azure SQL) → Data validation, reconciliation, and quality checks at scale → CI/CD for data workflows (Jenkins, Git) I'm at a point where I want to go deeper into large-scale data platform work — bigger datasets, more complex orchestration, and teams that care as much about pipeline reliability as I do. If you're hiring for a Data Engineer role and think there's a fit, I'd genuinely like to hear from you. Reach me at bommishettisamanth4@gmail.com or connect here on LinkedIn — happy to chat.

Location

Warangal

AI stack

claude code

claude

codex

cursor

github copilot

Work experience

Data Engineer at Sparta Global, Jan 2026 - Present · 11 mos, Hyderabad, Telangana, India, Develop and optimize scalable ETL/ELT pipelines on Google Cloud Platform (GCP) for enterprise banking applications. Build and maintain Apache Airflow DAGs for workflow scheduling, orchestration, dependency management, and production monitoring. Design and optimize BigQuery SQL transformations for the Curated Data Layer (CDL), supporting downstream analytics and reporting. Implement automated CI/CD deployment pipelines using Jenkins for production data workflows. Work extensively with Google Cloud Storage, BigQuery, and Airflow to process and manage large-scale banking datasets. Perform data validation, reconciliation, and quality checks to ensure reliable and consistent data delivery.

Junior Data Engineer at DATAMAXIS, Inc, Dec 2024 - Jan 2026 · 1 yr 2 mos, Hyderabad, Telangana, India

Fresher at Ai Variant, Nov 2023 - Feb 2024 · 4 mos, Bengaluru, Karnataka, India

Education

B.tech, Electrical and Electronics Engineering, Vaagdevi Engineering College

Bachelor of Technology, Electrical and Electronics Engineering, Vaagdevi Engineering College