Headline

Senior Software Engineer | AI Engineer

About

Hi, I’m Shyam, a Software Engineer|AI Engineer specializing in distributed systems, data platforms, and AI. I enjoy solving complex engineering problems by building scalable systems that combine big data technologies with modern AI architectures. My experience spans real-time streaming systems, data platforms, generative ai, agent frameworks, and machine learning. Over the years, I’ve worked extensively with distributed data systems and open-source technologies, including Apache Kafka, Hadoop, Airflow, Trino, and Presto, to build high-throughput systems capable of handling large-scale data and real-time workloads. I currently work on AI infrastructure and developer platforms, building systems such as prompt management frameworks, multi-agent orchestration platforms, and micro-frontend architectures used internally by engineering teams. Experience Highlights Walmart Global Tech - Built Prompt-Engine, a prompt storage and generation framework that helps engineers manage, discover, and reuse prompts efficiently. - Developed a multi-agent orchestration platform with agent registry, MCP registry, centralized session store, and tracing infrastructure. - Designed a micro-frontend framework adopted across Walmart Marketplace engineering teams. Zoho Corporation - Built industrial monitoring and integration systems enabling communication between factory equipment and software platforms. - Developed ZBDaaS, a multi-tenant on-premises enterprise data platform for storing and retrieving massive volumes of unstructured data. Core Areas of Expertise • Distributed Systems • Data Engineering & Streaming Systems • AI Infrastructure & Agentic Systems • System Design (HLD / LLD) • Large-Scale Data Platforms Technologies Core Java, Rust, Python, Kafka, Airflow, Hadoop, Trino, Presto, SQL/NoSQL systems, distributed storage systems, and modern AI frameworks.

Location

Bengaluru

AI stack

anthropic apis

livekit

ollama

LiteLLM

llama.cpp

Zed

Work experience

Senior Software Engineer at Walmart Global Tech India, May 2026 - Present · 5 mos, Bengaluru, Karnataka, India

Software Engineer III at Walmart Global Tech India, Jun 2024 - May 2026 · 2 yrs, Bengaluru, Karnataka, India, Team: Walmart Marketplace - Designed and implemented AI-driven developer tooling, including prompt management systems and multi-agent orchestration frameworks to streamline internal engineering workflows. - Engineered and delivered features for UDH (Unified DevOps Hub), an internal platform used by Walmart Marketplace teams to monitor infrastructure and provision resources in real time. - Led the zero-downtime migration of a production MongoDB cluster to Azure Cosmos DB (Request Unit architecture), improving scalability, reliability, and operational efficiency. - Built Apache Airflow ETL pipelines to generate semantic embeddings for change requests, enabling AI-powered search and contextual retrieval using the Milvus vector database. - Developed UI enhancements for ATLAS, Walmart’s internal Distribution Center management platform, enabling onboarding of new distribution centers and reducing operational errors for Marketplace DevOps teams from ~90% to near zero.

Member of Technical Staff at Zoho, Dec 2022 - Jun 2024 · 1 yr 7 mos, Chennai, Tamil Nadu, India, Team: DFS (Distributed File Systems) Architected and developed an on-premise append-only big data storage system for storing unstructured data in near real-time. (ZBDaaS) Responsibilities * Designed, evaluated, and developed high-efficiency SDKs and servers. The system can handle up to 2 billion rows for each service in Zoho. * Integrated two real-time query engines, Trino and Pinot, for use case-specific clients in Zoho. * Managed formidable teams effectively utilizing ZBDaaS (ZohoCRM, ZohoCreator, ManageEngine, and Zoho Sites). These platforms enabled the push of voluminous high-velocity data and real-time queries. Hands-on Experience: * Apache projects: Kafka, Kafka Streams, Kafka Connect, KSQL DB. * Distributed caching: Redis * Distributed querying engines: Apache Trino and Pinot * Distributed storage system: Hadoop * File formats: Apache ORC (Optimized row columnar) * Programming language: Core Java

Software Developer at Meglak, Apr 2022 - Nov 2022 · 8 mos, Remote, Integration Gateway: ‣ Engineered and developed an Integration Gateway capable of integrating with real-world equipment, devices, and sensors. ‣ The framework supports File-Based, RabbitMQ Queue, TCP Server, and Client integration. ‣ Wrote custom reusable frameworks and class libraries for logging, RabbitMQ publishers, custom event handlers, and PostgreSQL database query builders. Dashify: ‣ Constructed a real-time dashboard web application that assists in monitoring equipment, devices, or sensors. ‣ Backend: Utilized Nest.js to construct event-driven microservices with RabbitMQ. ‣ Frontend: Designed in Figma using the grid design pattern and implemented with Next.js and Tailwind CSS for the user-facing dashboard application. ‣ Integration Gateway and Dashify were deployed in the PCB manufacturing SMT line, enabling operators to track the manufacturing process from start to end, thereby reducing manual work by 80%.

Software Trainee at Mero systems, Jun 2021 - Mar 2022 · 10 mos, Chennai, Tamil Nadu, India, Responsibilities: - Developed automation scripts and schedulers jobs utilizing Airflow. - Constructed custom logging frameworks employing Serilog and integrated with CI/CD pipelines in GitHub Actions. - Provided continuous support throughout the software development lifecycle. - Proficient in Python, Airflow, Deno.js, REST APIs, GraphQL, and Flutter.

Education

Bachelor's degree, Automobile, Dr.Mahalingam College of Engineering and Technology

Public links

github: https://github.com/ShyamGurunath