Shubham Patel profile photo 1 on Tal

Shubham Patel

Engineering Leader | Data & Backend Systems | Scalable Infrastructure | AdTech | IIT Madras | LG Ad Solutions

Bangalore Urban, Karnataka
Hiring

Software Engineer 2

LG Ad Solutions

LG Ad Solutions logo

Build and scale data pipelines to drive advertising insights for our global connected TV platform.

Bengaluru

24–35 INR / yearly

CTC

2–4 years

Exp

Wfo

Work mode

About Shubham

LG Ad Solutions
Apr 20251 yr 4 mosPresent

Bengaluru, Karnataka, India

- Leading efforts on the migration of on-prem Hadoop, Spark, Kafka, and Elasticsearch-driven data-compute ecosystem to Databricks-based cloud infra. - Coaching and mentoring sub-teams rebuilding data pipelines, improving cross-region collaboration. - Contributing to defining modern data platform and infra. Focused on building CCPA/GDPR compliance, Data Governance and Data Observability.
LG Ad Solutions
Apr 20232 yrs 3 mosJun 2025

Bengaluru, Karnataka, India

- Leading a high-performing team of 9 engineers across data and backend systems, driving mentorship, performance reviews, and cross-functional roadmap execution. - Scaled an Elasticsearch cluster from 30 to 75 nodes with comprehensive monitoring and automated detection of SSD degradation. - Optimized a Spark Streaming pipeline, increasing throughput from 1.4M to 3M events per 250 seconds and improving ingestion latency from 18 hours to real-time. - Improved SLAs and eliminated critical production incidents by redesigning pipelines, tuning retries, and scaling infrastructure. - Led the development of revenue data pipelines to automate financial and invoicing flows across product lines. - Delivered a high-throughput pixel enhancement server (25K QPS) using Golang, Redis, and Kafka, supporting real-time partner reporting. - Contributed to the hiring process by conducting 20+ interviews, including data structures, system design, and cultural fit evaluations.
LG Ad Solutions
Jul 20193 yrs 9 mosMar 2023

Bengaluru, Karnataka, India

- Built and maintained ETL pipelines processing over 4TB of data per day, contributing to $138M in annual revenue for the programmatic ad business. - Developed real-time data pipelines using Apache Spark, Kafka, Elasticsearch, and Filebeat, reducing data latency from hours to seconds. - Designed and implemented a distributed fan-out HTTP service handling 100K RPS input and 1M RPS output, improving SSAI efficiency by 20%. - Launched cloud infrastructure (EC2, ELB, security groups, subnets) on AWS for an in-house SSP; supported load testing and pixel infrastructure. - Refactored and stabilized existing Pixel and ACR pipelines, fixing data gaps and improving data quality. - Built metadata crawlers and ranking pipelines for OTT platforms like Netflix, Prime Video, and Zee5, serving 100K+ connected TVs across India.

I'm the person in every team who…

Who shows High Agency, Extreme ownership, Drive technical decision, Build consensus, Build Vision, Regularly reflect on what I do.

What's hard for others but easy for me…

Sitting and digging into code for long hours. Building great relationships across Engineering.

My hot take about working with AI is…

You still need to understand code till one layer goes down. Use for augmentation and refinement, but not intelligence replacement.

The role I'd take a 20% pay cut for

Result in significant increase in ownership for the outcomes, should reflect for both financially and workwise. Has to be a potentially rocketship.

Shubham’s AI Stack

antigravity
antigravity
claude code
claude code
codex
codex
gemini
gemini

Education

Indian Institute of Technology, Madras

Master of Technology - MTech, Computer Science

Indian Institute of Technology, Madras

20172 yrs2019
Institute of Engineering & Technology DAVV, Indore

Bachelor’s Degree, Information Technology

Institute of Engineering & Technology DAVV, Indore

20134 yrs2017

Join Shubham and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss
TAL BY GRAPEVINE
Message Shubham

Shubham Patel on Tal

Headline

Engineering Leader | Data & Backend Systems | Scalable Infrastructure | AdTech | IIT Madras | LG Ad Solutions

About

I am an engineering leader with over 7 years of experience specializing in high-throughput backend systems and large-scale data infrastructure. My expertise lies in designing distributed systems, real-time data pipelines, and cloud-native architectures that drive business impact. With a proven track record in both people management and technical architecture, I thrive in fast-paced environments where I can lead high-performing teams, mentor engineering talent, and bridge the gap between complex technical challenges and strategic product goals.

Location

Bangalore Urban, Karnataka

AI stack

antigravity

claude code

codex

gemini

Work experience

Senior Engineering Manager at LG Ad Solutions, Apr 2025 - Present · 1 yr 4 mos, Bengaluru, Karnataka, India, - Leading efforts on the migration of on-prem Hadoop, Spark, Kafka, and Elasticsearch-driven data-compute ecosystem to Databricks-based cloud infra. - Coaching and mentoring sub-teams rebuilding data pipelines, improving cross-region collaboration. - Contributing to defining modern data platform and infra. Focused on building CCPA/GDPR compliance, Data Governance and Data Observability.

Engineering Manager at LG Ad Solutions, Apr 2023 - Jun 2025 · 2 yrs 3 mos, Bengaluru, Karnataka, India, - Leading a high-performing team of 9 engineers across data and backend systems, driving mentorship, performance reviews, and cross-functional roadmap execution. - Scaled an Elasticsearch cluster from 30 to 75 nodes with comprehensive monitoring and automated detection of SSD degradation. - Optimized a Spark Streaming pipeline, increasing throughput from 1.4M to 3M events per 250 seconds and improving ingestion latency from 18 hours to real-time. - Improved SLAs and eliminated critical production incidents by redesigning pipelines, tuning retries, and scaling infrastructure. - Led the development of revenue data pipelines to automate financial and invoicing flows across product lines. - Delivered a high-throughput pixel enhancement server (25K QPS) using Golang, Redis, and Kafka, supporting real-time partner reporting. - Contributed to the hiring process by conducting 20+ interviews, including data structures, system design, and cultural fit evaluations.

Technologist at LG Ad Solutions, Jul 2019 - Mar 2023 · 3 yrs 9 mos, Bengaluru, Karnataka, India, - Built and maintained ETL pipelines processing over 4TB of data per day, contributing to $138M in annual revenue for the programmatic ad business. - Developed real-time data pipelines using Apache Spark, Kafka, Elasticsearch, and Filebeat, reducing data latency from hours to seconds. - Designed and implemented a distributed fan-out HTTP service handling 100K RPS input and 1M RPS output, improving SSAI efficiency by 20%. - Launched cloud infrastructure (EC2, ELB, security groups, subnets) on AWS for an in-house SSP; supported load testing and pixel infrastructure. - Refactored and stabilized existing Pixel and ACR pipelines, fixing data gaps and improving data quality. - Built metadata crawlers and ranking pipelines for OTT platforms like Netflix, Prime Video, and Zee5, serving 100K+ connected TVs across India.

Education

Master of Technology - MTech, Computer Science, Indian Institute of Technology, Madras

Bachelor’s Degree, Information Technology, Institute of Engineering & Technology DAVV, Indore

Profile highlights

I'm the person in every team who…: Who shows High Agency, Extreme ownership, Drive technical decision, Build consensus, Build Vision, Regularly reflect on what I do.

What's hard for others but easy for me…: Sitting and digging into code for long hours. Building great relationships across Engineering.

My hot take about working with AI is…: You still need to understand code till one layer goes down. Use for augmentation and refinement, but not intelligence replacement.

The role I'd take a 20% pay cut for: Result in significant increase in ownership for the outcomes, should reflect for both financially and workwise. Has to be a potentially rocketship.

Public links

medium: https://medium.com/@CodeKrafter

github: https://github.com/shubhampatel94