Software Engineer - AI Software & Platform @ Cisco | Ex-Mahindra AI, Bosch | Backend & Distributed Systems | Production LLM Infrastructure | FastAPI, Kubernetes, Redis | Knight @Leetcode (Top 4.6% Worldwide)

Bengaluru, Karnataka, India



Bengaluru, Karnataka, India

Bengaluru, Karnataka, India







Bachelor of Technology - BTech, Computer Science
Reva University

kendriya vidyalaya
Join Abhay and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossSoftware Engineer - AI Software & Platform @ Cisco | Ex-Mahindra AI, Bosch | Backend & Distributed Systems | Production LLM Infrastructure | FastAPI, Kubernetes, Redis | Knight @Leetcode (Top 4.6% Worldwide)
Software Engineer at Cisco (AI Software & Platform) specializing in backend infrastructure and production AI systems. Experienced in designing scalable distributed services, multi-tenant retrieval systems, and enterprise LLM platforms using Python, FastAPI, Redis, Kubernetes, and cloud-native infrastructure. At Mahindra AI, I led development of production-scale AI systems including: • Multi-tenant RAG platforms optimized for latency, scalability, and infrastructure cost • Enterprise AI applications serving 1200+ users across multiple business units • ML pipelines processing large-scale financial document workflows • Automation platforms generating INR 9+ Cr annual business impact My work focuses on distributed systems, backend architecture, AI platform engineering, retrieval systems, and high-performance APIs. Interested in solving large-scale engineering problems involving scalability, reliability, inference systems, and production AI infrastructure.
Bengaluru
anthropic apis
antigravity
claude code
claude
codex
cursor
Software Engineer - AI Software & Platform at Cisco, Jun 2026 - Present · 3 mos, Bengaluru, Karnataka, India, • Developing distributed document processing and retrieval services for multi-product AI Assistants using vector databases, ETL pipelines, and Retrieval-Augmented Generation (RAG) architectures. • Building scalable ingestion, indexing, and retrieval workflows supporting enterprise knowledge systems, semantic search, and low-latency AI inference.
Software Engineer (AI Systems & Platform Engineering) at Mahindra Group, Jul 2024 - Jun 2026 · 2 yrs, • Designed and led development of a multi-tenant RAG platform for enterprise-scale LLM applications, reducing inference latency by 35% and infrastructure cost by 28%, delivering INR 9+ Cr projected annual business impact. • Engineered distributed retrieval infrastructure with semantic search, Redis caching, containerized deployments, and Kubernetes orchestration using Jenkins CI/CD pipelines across GCP and Azure. • Led development and deployment of MPlot, a large-scale vehicle test analytics platform serving 1200+ enterprise users and automating high-volume reporting workflows, generating INR 6.23 Cr annual savings. • Built backend infrastructure for SmartBudget AI, an enterprise budget forecasting and retrieval platform that reduced manual planning effort by 80% and improved budget optimization by 15%. • Improved platform reliability and security posture through SAST/DAST analysis, cloud cost optimization, and remediation of critical production vulnerabilities. • Designed scalable ML/LLM pipelines including experiment tracking, model versioning, feature orchestration, and automated retraining workflows using cloud-native infrastructure. • Conducted technical interviews and performed code reviews across backend, AI, and full-stack production systems. • Presented AI platform architectures and engineering impact metrics to senior leadership and cross-functional stakeholders, driving enterprise-wide adoption across multiple business units. • Mentored interns and junior engineers across backend and AI engineering projects.
Software Development Trainee at Mahindra Group, Jul 2023 - Jun 2024 · 1 yr, • Developed MIDI, a production ML pipeline for Mahindra Finance processing 10K+ financial documents monthly through OCR-based transactional data extraction and classification pipelines. • Built NLP extraction systems achieving 94% accuracy on digital bank statements and 82% accuracy on scanned statements across multiple financial document formats. • Worked on backend APIs, document processing workflows, and scalable inference pipelines for enterprise financial automation systems.
SDE Intern at Bosch Global Software Technologies, Jun 2023 - Aug 2023 · 3 mos, Bengaluru, Karnataka, India, • Performed static code analysis and debugging for safety-critical automotive systems, improving compliance quality and software reliability. • Contributed to standards-compliant embedded software workflows and code quality processes for production automotive systems.
AI/ML Research Intern at REVA University, Jan 2023 - Dec 2023 · 1 yr, Bengaluru, Karnataka, India, • Designed OCR and transliteration pipelines for Sharada Script manuscripts using deep learning and NLP techniques, achieving 84% accuracy. • Published Sanskrit NLP research presented at the International Sanskrit Conference 2023, achieving 71.87% state-of-the-art accuracy for sandhi-viccheda tasks. • Contributed to digital preservation initiatives for ancient Indic manuscripts through applied machine learning and sequence modeling approaches.
Bachelor of Technology - BTech, Computer Science, Reva University
kendriya vidyalaya
github: https://github.com/labhayl
leetcode: https://leetcode.com/labhayl