Headline

Software Engineer II @ Microsoft | 4+ yrs building Hyperscale Distributed Systems & Backend Platforms | Ex-Urban Company | IIT Kanpur

About

Software Engineer with 4+ years building and scaling backend platforms that process billions of events per minute. Currently at Microsoft (M365 Security), where I own hyperscale ingestion and middleware systems protecting Microsoft's internal server fleet. I work at the intersection of distributed systems, cloud infrastructure, and reliability — turning high-scale, high-stakes problems into resilient, cost-efficient platforms. What I do: • Critical owner of a security-telemetry platform handling 4B+ events/min and a middleware API at 500M+ requests/min. • Design event-driven pipelines on Apache Spark, Azure Event Hubs, and Kafka with Near-Real-Time SLAs. • Lead large-scale migrations — currently Service Fabric (Windows) → Azure Kubernetes Service / AKS (Linux), driving ~40% infra cost reduction. Earlier at Urban Company, I built developer infrastructure used across 150+ microservices — an ORM wrapper, the open-source "Flash" caching library, an MTTR system that cut outage RCA from ~30–60 min to ~1 min, and Kubernetes infra load-tested at 5× traffic. Tech I work with: C#/.NET, Python, TypeScript, Scala, Apache Spark, Kafka, Azure (AKS, Event Hubs, Service Fabric, Kusto), AWS (EKS, ECS), Docker, Terraform, Prometheus, Grafana. Recognized with 2× Microsoft Spot Awards. IIT Kanpur graduate. Always open to conversations on large-scale backend, distributed systems, and platform engineering.

Location

India

AI stack

antigravity

codex

Work experience

Software Engineer II at Microsoft, Jul 2024 - Present · 2 yrs 2 mos, Core owner of a hyperscale security-telemetry platform protecting Microsoft's internal fleet (Exchange, Teams, Skype). • Own the ingestion ecosystem (4B+ events/min) and middleware API (500M+ requests/min). • Sustained Near-Real-Time SLAs across 400+ Apache Spark pipelines; tuned jobs & partitioning to kill recurring alerts and prevent data loss. • Leading Service Fabric (Windows) → AKS (Linux) migration — ~4× throughput via concurrency/batch tuning, targeting ~40% infra cost reduction. • Hardened auth fleet-wide: long-lived secrets/certs → Managed Identity + Federated Identity Credentials (FIC); isolated IDNA/ESTS/MSA onto dedicated Event Hubs. • Technical anchor for the US→India (IDC) transition of the 5PB Vanquish platform; enabled single-click IaC onboarding for US Sovereign Clouds (weeks → 2–3 days, 16 clouds). 2× Microsoft Spot Award (2025, 2026).

Software Engineer at Urban Company, May 2022 - Jun 2024 · 2 yrs 2 mos, Gurugram, Platform engineer across data privacy, reliability, and developer infra. • Built a PII detection & encryption system — inter-service traffic capture, graph-based data-flow mapping, OpenAI-based DB scanning for compliance. • Built the MTTR system from scratch: outage RCA time 30–60 min → ~1 min. • Shipped an ORM wrapper (Sequelize/Mongoose + TS) adopted by 150+ microservices; open-sourced the "Flash" caching library used by 40+. • Owned A/B experimentation + alerting and centralized Rate Limiter & Distributed Lock Manager. • Stood up staging Kubernetes infra (ELK, Kafka, Prometheus, Grafana, Thanos, Vault); Locust load-tested 200+ services at 5× traffic. Cut AWS cost ~$33K.

Software Engineering Intern at Peakflo, May 2021 - Jul 2021 · 3 mos

Education

Bachelor of Science - BS, Indian Institute of Technology, Kanpur

Public links

github: https://github.com/manish193