Headline

Senior Software Engineer III - AI | Distributed Systems | LLM, RAG & Agentic Workflows | High Throughput Backend | AWS, GCP, Kubernetes

About

I am a Senior Software Engineer with 5+ years of experience building scalable backend systems, distributed architectures, and AI driven platforms. Currently, I architect and deploy large scale Conversational AI systems powered by LLMs, custom RAG pipelines, and agentic workflows. My work supports tens of billions of API requests and over 120B monthly events, with a strong focus on reliability, low latency inference, and production grade AI evaluation. My core expertise includes: Distributed systems and high throughput backend design LLM and RAG engineering Agentic AI workflows and orchestration Microservices and event driven architecture Vector search, re ranking, and evaluation frameworks Reliability engineering and production scaling I have experience building systems that process 100K+ messages per hour, migrating monoliths to microservices, and designing reusable integration architectures across enterprise systems. I enjoy solving complex system design problems, scaling platforms under real traffic growth, and owning systems end to end from architecture to production stability. Tech Stack: Java, Python, JavaScript, Node.js, LLMs, LangChain, LangGraph, PostgreSQL, MongoDB, Redis, AWS, GCP, Docker, Kubernetes.

Location

Bengaluru

AI stack

claude code

claude

deepseek

hugging face

langfuse

Work experience

Lead Engineer, Senior at HighLevel, Nov 2024 - Present · 1 y 10 mo, United States, • Architected and deployed multichannel Conversational AI systems using custom RAG pipelines enabling contextual, multi turn AI interactions • Designed scalable AI infrastructure supporting 40B+ API requests and 120B+ monthly events • Built AI evaluation frameworks to benchmark outputs, reduce hallucinations, and improve response quality • Scaled the agentic platform to support 800K+ unique sessions with ~20 percent MoM growth • Owned end to end architecture from design to production reliability

Software Engineer at inFeedo, Dec 2023 - Nov 2024 · 1 yr, Bengaluru, Karnataka, India, Infeedo is a leading HR tech company revolutionizing employee engagement, with its flagship product Amber, an AI-powered employee experience platform. Areas Worked On: • Spearheaded the development of key features for Amber, including real-time feedback mechanisms and personalized engagement modules, enhancing user experience and retention. • Collaborated with cross-functional teams to architect and implement scalable solutions, optimizing performance and reliability of the platform. • Led initiatives to refactor legacy codebase, improving code quality and maintainability while reducing technical debt. • Contributed to the innovation pipeline by researching and implementing cutting-edge technologies, ensuring Infeedo remains at the forefront of HR innovation.

Software Development Engineer II at Yocket, Apr 2022 - Nov 2023 · 1 yr 8 mos, Mumbai, Maharashtra, India, -Designed and Developed Messaging Service with features like One To One Chat, Group Chat, Join/Leave Group, Block Users and Messages, Reply on Message, Attachments and many more. -Implemented a Notifications Service for sending chats and other notifications to the users. -Developed a portal “SuperRocket” which helped counsellors reducing their average per student engagement time from 150 hours to 48 hours.

Software Engineer at OpsHub, Inc., May 2020 - Apr 2022 · 2 yrs, Ahmedabad, Gujarat, India, Areas Worked On: • Recovery Management • Conflict Management • SCM Migration Algorithm • Reconciliation • Caching • Large Scale Data Synchronization -End-to-End deployment of the product by modelling their use-cases and requirements according to product capabilities and configuring product in their environment and ensuring on-time delivery of their requirement. -Working with customers to deliver project on-time in challenging and deadline-oriented environment. -Using various OOPs concepts and design patterns to implement various frameworks like Rest Requestor Framework, EAI Architecture, etc. -Automated integrated testing for development functionalities using TestNG and Selenium. -Design and Development of features, scalable solutions and bugs solving in the product. -Mentoring Interns and New Joiners and conducting training sessions for them.

Software Engineer Intern at OpsHub, Inc., Jan 2020 - Apr 2020 · 4 mos, Ahmedabad, Gujarat, India

Software Engineer - Intern at OpsHub, Inc., May 2019 - Jul 2019 · 3 mos, Greater Ahmedabad Area, -Upgraded the company’s product frontend from Angular 2 to Angular 7. -Written UI Automation test cases using Selenium. -Received Pre-Placement Offer (PPO) for Winter Internship and Full Time Employment. -Technologies Worked On: Angular, Java, MySQL, PgSQL, Selenium

Education

M.Sc IT, Information Technology, Dhirubhai Ambani University

Bachelor of Science, Computer Applications & Information Technology, K S School of Business Management