Engineering Leader | Data & Backend Systems | Scalable Infrastructure | AdTech | IIT Madras | LG Ad Solutions

Bengaluru, Karnataka, India

Bengaluru, Karnataka, India

Bengaluru, Karnataka, India
I'm the person in every team who…
Who shows High Agency, Extreme ownership, Drive technical decision, Build consensus, Build Vision, Regularly reflect on what I do.
What's hard for others but easy for me…
Sitting and digging into code for long hours. Building great relationships across Engineering.
My hot take about working with AI is…
You still need to understand code till one layer goes down. Use for augmentation and refinement, but not intelligence replacement.
The role I'd take a 20% pay cut for
Result in significant increase in ownership for the outcomes, should reflect for both financially and workwise. Has to be a potentially rocketship.





Master of Technology - MTech, Computer Science
Indian Institute of Technology, Madras

Bachelor’s Degree, Information Technology
Institute of Engineering & Technology DAVV, Indore
Join Shubham and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossEngineering Leader | Data & Backend Systems | Scalable Infrastructure | AdTech | IIT Madras | LG Ad Solutions
I am an engineering leader with over 7 years of experience specializing in high-throughput backend systems and large-scale data infrastructure. My expertise lies in designing distributed systems, real-time data pipelines, and cloud-native architectures that drive business impact. With a proven track record in both people management and technical architecture, I thrive in fast-paced environments where I can lead high-performing teams, mentor engineering talent, and bridge the gap between complex technical challenges and strategic product goals.
Bangalore Urban, Karnataka
antigravity
claude code
codex
gemini
Senior Engineering Manager at LG Ad Solutions, Apr 2025 - Present · 1 yr 4 mos, Bengaluru, Karnataka, India, - Leading efforts on the migration of on-prem Hadoop, Spark, Kafka, and Elasticsearch-driven data-compute ecosystem to Databricks-based cloud infra. - Coaching and mentoring sub-teams rebuilding data pipelines, improving cross-region collaboration. - Contributing to defining modern data platform and infra. Focused on building CCPA/GDPR compliance, Data Governance and Data Observability.
Engineering Manager at LG Ad Solutions, Apr 2023 - Jun 2025 · 2 yrs 3 mos, Bengaluru, Karnataka, India, - Leading a high-performing team of 9 engineers across data and backend systems, driving mentorship, performance reviews, and cross-functional roadmap execution. - Scaled an Elasticsearch cluster from 30 to 75 nodes with comprehensive monitoring and automated detection of SSD degradation. - Optimized a Spark Streaming pipeline, increasing throughput from 1.4M to 3M events per 250 seconds and improving ingestion latency from 18 hours to real-time. - Improved SLAs and eliminated critical production incidents by redesigning pipelines, tuning retries, and scaling infrastructure. - Led the development of revenue data pipelines to automate financial and invoicing flows across product lines. - Delivered a high-throughput pixel enhancement server (25K QPS) using Golang, Redis, and Kafka, supporting real-time partner reporting. - Contributed to the hiring process by conducting 20+ interviews, including data structures, system design, and cultural fit evaluations.
Technologist at LG Ad Solutions, Jul 2019 - Mar 2023 · 3 yrs 9 mos, Bengaluru, Karnataka, India, - Built and maintained ETL pipelines processing over 4TB of data per day, contributing to $138M in annual revenue for the programmatic ad business. - Developed real-time data pipelines using Apache Spark, Kafka, Elasticsearch, and Filebeat, reducing data latency from hours to seconds. - Designed and implemented a distributed fan-out HTTP service handling 100K RPS input and 1M RPS output, improving SSAI efficiency by 20%. - Launched cloud infrastructure (EC2, ELB, security groups, subnets) on AWS for an in-house SSP; supported load testing and pixel infrastructure. - Refactored and stabilized existing Pixel and ACR pipelines, fixing data gaps and improving data quality. - Built metadata crawlers and ranking pipelines for OTT platforms like Netflix, Prime Video, and Zee5, serving 100K+ connected TVs across India.
Master of Technology - MTech, Computer Science, Indian Institute of Technology, Madras
Bachelor’s Degree, Information Technology, Institute of Engineering & Technology DAVV, Indore
I'm the person in every team who…: Who shows High Agency, Extreme ownership, Drive technical decision, Build consensus, Build Vision, Regularly reflect on what I do.
What's hard for others but easy for me…: Sitting and digging into code for long hours. Building great relationships across Engineering.
My hot take about working with AI is…: You still need to understand code till one layer goes down. Use for augmentation and refinement, but not intelligence replacement.
The role I'd take a 20% pay cut for: Result in significant increase in ownership for the outcomes, should reflect for both financially and workwise. Has to be a potentially rocketship.
medium: https://medium.com/@CodeKrafter
github: https://github.com/shubhampatel94