---
title: "Ajay Balu Kumar Mithireddy - Software Engineer in Hyderabad | Tal"
description: "Meet Ajay Balu Kumar Mithireddy, Software Engineer @ CloudTern Solutions | Agentic AI | Generative AI | AI Agents | LLMs | MCP | Anthropic Claude Certified | GitHub Certified: Agentic AI Developer | Microsoft Certified AI-103 | Azure | AWS based in Hyderabad. AI stack includes claude code, claude,..."
image: "https://tal.club/meet/ajay-balu-kumar-mithireddy/share-image"
---

# Ajay Balu Kumar Mithireddy on Tal

## Headline

Software Engineer @ CloudTern Solutions \| Agentic AI \| Generative AI \| AI Agents \| LLMs \| MCP \| Anthropic Claude Certified \| GitHub Certified: Agentic AI Developer \| Microsoft Certified AI\-103 \| Azure \| AWS

## About

Generative AI and Agentic AI Engineer \| LangChain • LangGraph • RAG • MCP • Azure • AWS I am a Software Engineer dedicated to bridging the gap between robust Cloud Infrastructure and the next generation of AI\. At Cloudtern Solutions, I specialize in architecting RAG\-based \(Retrieval\-Augmented Generation\) applications that move beyond simple chat—transforming raw data into knowledge\-grounded, high\-accuracy LLM responses\. Worked on AI agents: designing end\-to\-end LLM workflows and multi\-agent systems, optimizing vector search pipelines \(using Weaviate, ChromaDB, Pinecone, and Milvus\) with hybrid dense and sparse search and re\-ranking, and pushing boundaries with MCP \(Model Context Protocol\) and A2A \(Agent\-to\-Agent\) to enable multi\-tasking capabilities in intelligent bots\. My Technical Foundation: Generative AI: Hands\-on implementation of LangChain and LangGraph for complex agentic RAG architectures, with tool calling, prompt engineering, and role\-based MCP servers\. Vector Intelligence: Deep experience in document ingestion, chunking strategies, embedding optimization, and graph\-based retrieval with Neo4j\. Evaluation & Safety: RAGAS and LangSmith for evaluating and tracing LLM output, with guardrails against hallucinations and prompt injection, and AI governance practices\. Document Intelligence: OCR\-based extraction with MinerU, PaddleOCR, and Docling, and self\-hosted LLM serving with vLLM on Dockerized RunPod GPU workers\. Cloud & DevOps: Azure AI Foundry, Azure OpenAI Service, and Amazon Bedrock\. Prior to my AI focus, I completed intensive training in the Revature Azure Cohort, mastering full\-stack deployments with AKS, Terraform, and MySQL, and monitoring with GitHub, Prometheus, and Grafana for production\-ready scalability\. Built: Ansera \(agentic RAG search for websites\), AEO and GEO scoring tools, PolisIQ \(insurance document intelligence\), and an AI Resume Tracker\. Certified: Microsoft Azure AI Apps and Agents Developer Associate \(AI\-103\), GitHub Agentic AI Developer \(GH\-600\), Oracle Agentic AI Foundations Associate\. Open to Generative AI Engineer and Agentic AI Engineer roles in Hyderabad, Bengaluru, Pune, Chennai, and remote\. Let's build something intelligent\!

## Location

Hyderabad

## AI stack

claude code

claude

codex

langgraph

mcp

mistral

## Work experience

Software Engineer at CloudTern Solutions, Feb 2025 \- Present · 1 y 9 mo, Hyderabad, Ansera, Agentic RAG search platform \- Architected an agentic RAG search engine with LangChain and LangGraph that turns client websites into conversational interfaces, delivering answers in 3 s instead of multi\-click link navigation across 500\+ client sites\. \- Raised top\-5 retrieval precision from 72% to 91% with hybrid dense and sparse search and a re\-ranking layer, with p95 retrieval latency under 1 s\. \- Built multi\-tenant ingestion pipelines on Weaviate with incremental updates, audio/video transcription and OCR extraction across 3,000\+ pages of website content\. \- Raised RAGAS faithfulness from 90% to 97% with prompt engineering workflows and governance guardrails\. \- Built an AEO and GEO scoring tool for 500\+ client websites, using MCP for tool access and A2A for inter\-agent communication\. \- Automated site onboarding with Webflow and WordPress APIs, replacing 10\+ manual steps with one click\. MCP servers \- Built an authenticated, role\-based MCP server giving natural\-language access to website analytics for 500\+ client sites\. \- Built Calendar and Calendly MCP tools that handle 100\+ bookings per month inside chat\. PolisIQ, insurance document intelligence \- Built LangGraph agent workflows and MinerU OCR pipelines extracting structured data at 95% field\-level accuracy for 1,000\+ documents per month\. \- Deployed Gemma 4 12B with vLLM on Dockerized RunPod GPU workers with dynamic batching and on\-demand scaling\. Resume Tracker, AI resume search \- Built a LangGraph and Neo4j resume search; LLM\-generated Cypher queries cut candidate discovery from minutes to 4 s across 4,000\+ profiles\.

Site Reliability Engineer Intern at Revature, Apr 2024 \- Aug 2024 · 5 mos, Chennai, Completed hands\-on training in cloud and DevOps through Revature's Azure Cohort, gaining practical skills in full\-stack application development with Azure tools like AKS, MySQL, and Terraform\. Enhanced expertise in GitHub version control and monitoring using Prometheus and Grafana, managing end\-to\-end deployments\. This experience solidified my foundation in cloud infrastructure and DevOps practices\.

## Education

Bachelor of Technology \- BTech, Cse, Pragati University

[View the original profile](https://tal.club/meet/ajay-balu-kumar-mithireddy)

```json
{
  "@context": "https://schema.org",
  "@graph": [
    {
      "@type": "Person",
      "@id": "https://tal.club/meet/ajay-balu-kumar-mithireddy#person",
      "name": "Ajay Balu Kumar Mithireddy",
      "url": "https://tal.club/meet/ajay-balu-kumar-mithireddy",
      "image": "https://tal.club/meet/ajay-balu-kumar-mithireddy/profile-photo.jpg",
      "description": "Meet Ajay Balu Kumar Mithireddy, Software Engineer @ CloudTern Solutions | Agentic AI | Generative AI | AI Agents | LLMs | MCP | Anthropic Claude Certified | GitHub Certified: Agentic AI Developer | Microsoft Certified AI-103 | Azure | AWS based in Hyderabad. AI stack includes claude code, claude,...",
      "jobTitle": "Software Engineer",
      "worksFor": {
        "@type": "Organization",
        "name": "CloudTern Solutions"
      },
      "hasOccupation": {
        "@type": "Occupation",
        "name": "Software Engineer"
      },
      "homeLocation": {
        "@type": "Place",
        "name": "Hyderabad"
      },
      "alumniOf": [
        {
          "@type": "EducationalOrganization",
          "name": "Pragati University"
        }
      ],
      "knowsAbout": [
        "claude code",
        "claude",
        "codex",
        "langgraph",
        "mcp",
        "mistral"
      ],
      "mainEntityOfPage": {
        "@id": "https://tal.club/meet/ajay-balu-kumar-mithireddy#webpage"
      }
    },
    {
      "@type": "ProfilePage",
      "@id": "https://tal.club/meet/ajay-balu-kumar-mithireddy#webpage",
      "url": "https://tal.club/meet/ajay-balu-kumar-mithireddy",
      "name": "Ajay Balu Kumar Mithireddy on Tal",
      "description": "Meet Ajay Balu Kumar Mithireddy, Software Engineer @ CloudTern Solutions | Agentic AI | Generative AI | AI Agents | LLMs | MCP | Anthropic Claude Certified | GitHub Certified: Agentic AI Developer | Microsoft Certified AI-103 | Azure | AWS based in Hyderabad. AI stack includes claude code, claude,...",
      "dateModified": "2026-11-04T16:28:07.815Z",
      "isPartOf": {
        "@id": "https://tal.club/#website"
      },
      "mainEntity": {
        "@id": "https://tal.club/meet/ajay-balu-kumar-mithireddy#person"
      },
      "primaryImageOfPage": {
        "@type": "ImageObject",
        "url": "https://tal.club/meet/ajay-balu-kumar-mithireddy/profile-photo.jpg",
        "contentUrl": "https://tal.club/meet/ajay-balu-kumar-mithireddy/profile-photo.jpg",
        "caption": "Ajay Balu Kumar Mithireddy profile photo on Tal"
      },
      "inLanguage": "en-IN"
    }
  ]
}
```