Rohith Bala profile photo 1 on Tal

Rohith Bala

ML Platform Engineer | Scaling Real-Time ML Systems | @Zepto | Ex-PhonePe

Bengaluru

5+ years of work experience

Zepto
Apr 20266 moPresent

Bengaluru

Senior ML Platform Engineer
Zepto
Jul 20241 yr 9 mosMar 2026

Bengaluru, Karnataka, India

Powered billions of daily inferences across fraud, search, ads, and ETA systems. Achieved P99 <10ms and sub-5ms feature retrieval using KServe, RayServe, Databricks, Kafka, and Aerospike. Slashed model rollout time from days to minutes and cut deployment time by 60% by building custom CI/CD pipelines and deployment frameworks. Successfully onboarded 80+ real-time and async models (ranking, embeddings, computer vision) onto Kubernetes (EKS), optimizing costs with AWS Inferentia.
PhonePe
Jul 20213 yrs 1 moJul 2024

Bengaluru, Karnataka, India

PhonePe
Mar 20215 mosJul 2021

Bangalore Urban, Karnataka, India

International Institute of Information Technology Bangalore
Jul 20192 mosAug 2019

Greater Bengaluru Area

Rohith’s AI Stack

claude code
claude code
hugging face
hugging face
Modal
Modal
Qwen
Qwen
Vercel AI SDK
Vercel AI SDK
vLLM
vLLM

Education

Ramaiah Institute Of Technology

Bachelor's Degree, Electronics and Instrumentation Engineering

Ramaiah Institute Of Technology

20174 yrs2021

Join Rohith and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Rohith Bala on Tal

Headline

ML Platform Engineer | Scaling Real-Time ML Systems | @Zepto | Ex-PhonePe

About

MLOps Engineer at Zepto

Location

Bengaluru

AI stack

claude code

hugging face

Modal

Qwen

Vercel AI SDK

vLLM

Work experience

Senior Software Engineer at Zepto, Apr 2026 - Present · 6 mo, Bengaluru, Senior ML Platform Engineer

Software Engineer II at Zepto, Jul 2024 - Mar 2026 · 1 yr 9 mos, Bengaluru, Karnataka, India, Powered billions of daily inferences across fraud, search, ads, and ETA systems. Achieved P99 <10ms and sub-5ms feature retrieval using KServe, RayServe, Databricks, Kafka, and Aerospike. Slashed model rollout time from days to minutes and cut deployment time by 60% by building custom CI/CD pipelines and deployment frameworks. Successfully onboarded 80+ real-time and async models (ranking, embeddings, computer vision) onto Kubernetes (EKS), optimizing costs with AWS Inferentia.

Software Engineer at PhonePe, Jul 2021 - Jul 2024 · 3 yrs 1 mo, Bengaluru, Karnataka, India

Intern at PhonePe, Mar 2021 - Jul 2021 · 5 mos, Bangalore Urban, Karnataka, India

Intern at International Institute of Information Technology Bangalore, Jul 2019 - Aug 2019 · 2 mos, Greater Bengaluru Area

Education

Bachelor's Degree, Electronics and Instrumentation Engineering, Ramaiah Institute Of Technology

Rohith Bala - Senior Software Engineer in Bengaluru | Tal