Headline

Senior Backend Engineer | Distributed Systems | Python/FastAPI, Java/Spring Boot, Kafka, AI Workflows, Kubernetes | IIT BHU

About

Senior Backend Engineer with 3+ years of experience building distributed backend systems, workflow orchestration platforms, and cloud-native microservices for enterprise-scale environments. I specialize in Java/Spring Boot, Python/FastAPI, Kafka, Redis, PostgreSQL, Kubernetes, distributed locking, concurrency control, scheduling systems, observability, and AI-driven automation workflows. At KPIT Technologies, I work on backend platforms supporting large-scale automotive engineering and virtualization use cases for global enterprise clients including Mercedes-Benz, BMW, and Ford. My work focuses on designing reliable backend systems that handle long-running workflows, resource admission, task orchestration, CI/CD automation, human-in-the-loop execution, and production observability. Key impact areas: • Architected a task orchestration engine running 30+ concurrent tasks with priority scheduling, queueing, polling, graceful cancellation, and workflow state management. • Re-architected job scheduling across 6 microservices by removing repeated DB lookups and config parsing from the hot path, improving reliability under high queue depth. • Built batch license and resource admission systems using reservation ledgers, TTL-based holds, SERIALIZABLE isolation, Kubernetes CPU/RAM checks, and reconciliation watchdogs. • Led database normalization and migration across 10+ core tables with zero data loss, improving query performance by 30–40%. • Introduced Redis caching across 5+ services, reducing p99 latency by approximately 35% and database load by 40%+. • Implemented Kafka consumer throttling for approximately 30K events/day and built Grafana/DLQ monitoring across 20+ metrics, reducing incident detection time by 50%. • Delivered backend services supporting 10M+ annual API requests across enterprise automotive platforms. My core engineering strengths include backend architecture, distributed systems, API design, event-driven systems, high-concurrency workflows, Kubernetes-based resource management, database optimization, cloud-native development, and observability. I am interested in backend engineering, distributed systems, platform engineering, AI workflow automation, and scalable cloud-native architectures.

Location

Mumbai

AI stack

anthropic apis

claude code

claude

codex

cursor

claudecode

Work experience

Senior Software Engineer at KPIT, Oct 2025 - Present · 11 mos, Pune Camp, • Architected a task orchestration engine running 30+ concurrent tasks with priority scheduling, queueing, polling, graceful cancellation, and workflow state management, unifying AI-driven automation, CI/CD agents, and human-in-the-loop workflows. • Re-architected job scheduling across 6 microservices by normalizing license and resource profiles at upload time, eliminating repeated DB lookups and config parsing from the hot path. • Replaced single-pipeline locking with atomic batch admission, enabling 30+ concurrent tasks to be admitted reliably while preventing linear degradation under queue depth. • Developed a batch license admission engine using reservation ledgers, license-profile hashing, SERIALIZABLE isolation, and TTL-based holds to safely compute max-runnable capacity and reduce lock contention. • Engineered a Python/FastAPI resource admission layer with batch CPU/RAM checks across Kubernetes clusters, per-pipeline safety buffers, atomic reservations, and a 60-second reconciliation watchdog to self-heal expired or orphaned holds. • Led database normalization and migration across 10+ core tables with zero data loss, improving query performance by 30–40%. • Introduced Redis caching across 5+ services, reducing p99 latency by approximately 35% and database load by 40%+. • Implemented partition-based throttling for Kafka consumers processing approximately 30K events/day. • Established Grafana and DLQ-based alerts across 20+ production metrics, reducing incident detection time by 50%.

Software Engineer 2 at KPIT, Oct 2024 - Sep 2025 · 1 yr, Pune District, • Served as a Forward Deployed Engineer for Mercedes-Benz, BMW, and Ford, converting 3+ proof-of-concepts into long-term enterprise deployments. • Delivered backend services using Java/Spring Boot and Python/FastAPI, supporting 10M+ annual API requests across enterprise automotive platforms. • Created a global hardware management platform supporting 1,000+ hardware devices across multiple regions with secure provisioning, monitoring, and lifecycle operations. • Integrated Kafka-based asynchronous messaging across 5+ microservices, improving fault tolerance, service decoupling, and long-running workflow reliability. • Optimized secure access workflows using Apache Guacamole, reducing login latency by 85% and improving developer productivity. • Collaborated with enterprise stakeholders to convert customer requirements into scalable backend services, deployment workflows, and production-ready platform features.

Software Developer 1 at KPIT, Jun 2023 - Dec 2024 · 1 yr 7 mos, Pune District, • Led backend development for a Unified Portal managing 1,000+ cloud and on-premise environments globally. • Enhanced 8+ microservices for environment provisioning, telemetry, orchestration, and virtual test-environment management. • Implemented distributed locking and multi-region workflows to improve reliability under high-concurrency access patterns. • Automated CI/CD pipelines using GitLab CI/CD, Docker, and Kubernetes, reducing deployment time by 65%. • Built REST APIs and backend workflows for environment lifecycle operations, access control, provisioning, and monitoring. • Improved backend reliability, API performance, and deployment consistency across cloud-native and on-premise environments.

SWE Intern at KPIT, May 2022 - Jul 2022 · 3 mos, Pune District, • Contributed to a microservices-based SaaS platform focused on backend performance, fault tolerance, and service-to-service communication. • Developed REST APIs and inter-service communication flows to improve service integration and reduce latency. • Gained hands-on experience in backend development, API design, microservices, debugging, and performance optimization.

Education

Bachelor of Technology, Indian Institute of Technology (Banaras Hindu University), Varanasi

Jawahar Navodaya Vidyalaya - JNV

Public links

github: https://github.com/2002atulyadav