---
title: "Rohith Bala - Senior Software Engineer in Bengaluru | Tal"
description: "Meet Rohith Bala, ML Platform Engineer | Scaling Real-Time ML Systems | @Zepto | Ex-PhonePe based in Bengaluru. AI stack includes claude code, hugging face, and Modal."
image: "https://tal.club/meet/rohith-bala/share-image"
---

# Rohith Bala on Tal

## Headline

ML Platform Engineer \| Scaling Real\-Time ML Systems \| @Zepto \| Ex\-PhonePe

## About

MLOps Engineer at Zepto

## Location

Bengaluru

## AI stack

claude code

hugging face

Modal

Qwen

Vercel AI SDK

vLLM

## Work experience

Senior Software Engineer at Zepto, Apr 2026 \- Present · 6 mo, Bengaluru, Senior ML Platform Engineer

Software Engineer II at Zepto, Jul 2024 \- Mar 2026 · 1 yr 9 mos, Bengaluru, Karnataka, India, Powered billions of daily inferences across fraud, search, ads, and ETA systems\. Achieved P99 <10ms and sub\-5ms feature retrieval using KServe, RayServe, Databricks, Kafka, and Aerospike\. Slashed model rollout time from days to minutes and cut deployment time by 60% by building custom CI/CD pipelines and deployment frameworks\. Successfully onboarded 80\+ real\-time and async models \(ranking, embeddings, computer vision\) onto Kubernetes \(EKS\), optimizing costs with AWS Inferentia\.

Software Engineer at PhonePe, Jul 2021 \- Jul 2024 · 3 yrs 1 mo, Bengaluru, Karnataka, India

Intern at PhonePe, Mar 2021 \- Jul 2021 · 5 mos, Bangalore Urban, Karnataka, India

Intern at International Institute of Information Technology Bangalore, Jul 2019 \- Aug 2019 · 2 mos, Greater Bengaluru Area

## Education

Bachelor's Degree, Electronics and Instrumentation Engineering, Ramaiah Institute Of Technology

[View the original profile](https://tal.club/meet/rohith-bala)

```json
{
  "@context": "https://schema.org",
  "@graph": [
    {
      "@type": "Person",
      "@id": "https://tal.club/meet/rohith-bala#person",
      "name": "Rohith Bala",
      "url": "https://tal.club/meet/rohith-bala",
      "image": "https://tal.club/meet/rohith-bala/profile-photo.jpg",
      "description": "Meet Rohith Bala, ML Platform Engineer | Scaling Real-Time ML Systems | @Zepto | Ex-PhonePe based in Bengaluru. AI stack includes claude code, hugging face, and Modal.",
      "jobTitle": "Senior Software Engineer",
      "worksFor": {
        "@type": "Organization",
        "name": "Zepto"
      },
      "hasOccupation": {
        "@type": "Occupation",
        "name": "Senior Software Engineer"
      },
      "homeLocation": {
        "@type": "Place",
        "name": "Bengaluru"
      },
      "alumniOf": [
        {
          "@type": "EducationalOrganization",
          "name": "Ramaiah Institute Of Technology"
        }
      ],
      "knowsAbout": [
        "claude code",
        "hugging face",
        "Modal",
        "Qwen",
        "Vercel AI SDK",
        "vLLM"
      ],
      "mainEntityOfPage": {
        "@id": "https://tal.club/meet/rohith-bala#webpage"
      }
    },
    {
      "@type": "ProfilePage",
      "@id": "https://tal.club/meet/rohith-bala#webpage",
      "url": "https://tal.club/meet/rohith-bala",
      "name": "Rohith Bala on Tal",
      "description": "Meet Rohith Bala, ML Platform Engineer | Scaling Real-Time ML Systems | @Zepto | Ex-PhonePe based in Bengaluru. AI stack includes claude code, hugging face, and Modal.",
      "dateModified": "2026-08-02T04:19:59.996Z",
      "isPartOf": {
        "@id": "https://tal.club/#website"
      },
      "mainEntity": {
        "@id": "https://tal.club/meet/rohith-bala#person"
      },
      "primaryImageOfPage": {
        "@type": "ImageObject",
        "url": "https://tal.club/meet/rohith-bala/profile-photo.jpg",
        "contentUrl": "https://tal.club/meet/rohith-bala/profile-photo.jpg",
        "caption": "Rohith Bala profile photo on Tal"
      },
      "inLanguage": "en-IN"
    }
  ]
}
```