Vivek Venu profile photo 1 on Tal

Vivek Venu

Senior Backend Engineer | Golang • Python • Agentic AI • LLM Observability • RAG • Distributed Systems • Evaluations

Bengaluru

4+ years of work experience

Digio.in
Sep 20261 moPresent

Bengaluru

Netra
Dec 20259 mosAug 2026

Kochi, Kerala, India

Built core platform capabilities for Netra, an LLM observability platform that helps teams debug, evaluate, and improve production AI applications through tracing, experimentation, and analytics. • Architected immutable prompt versioning with protected production deployments, trace linkage, and reproducible prompt rollouts. • Designed a multi-turn agent evaluation framework supporting configurable personas, LLM-as-judge evaluation, and automated regression testing. • Built an insights pipeline using embeddings, K-Means, HDBSCAN, and statistical baselines to surface semantic clusters, behavioral drift, latency anomalies, and tool usage trends. • Extended the asynchronous trace ingestion pipeline built on BullMQ and ClickHouse, contributing to a platform processing ~8 million spans per month. • Worked across backend architecture, API design, database modeling, frontend contracts, and AI workflows to deliver production-ready platform capabilities.
KeyValue Software Systems
Dec 20259 mosAug 2026

Kochi, Kerala, India

• Building an end-to-end LLM observability platform for production AI systems, covering tracing, evaluation, and experimentation workflows. • Implemented prompt versioning and tracking to enable reproducible deployments, controlled rollouts, and regression analysis. • Developed large-scale simulation and evaluation pipelines for agent workflows using scenario datasets, enabling automated scoring and performance benchmarking.
KeyValue Software Systems
May 20241 yr 9 mosJan 2026

Kochi, Kerala, India

- Leading development of a domain-specific Knowledge Graph using GraphRAG, improving contextual reasoning and data discovery. - Built an AI Twin platform leveraging RAG, LangGraph, and Qdrant to deliver text + voice assistants on user data. - Developed a Slack AI Agent for automated meeting scheduling, migrating from LangChain to LangGraph to improve accuracy and maintainability.
KeyValue Software Systems
Aug 20221 yr 10 mosMay 2024

Kochi, Kerala, India

- Developed an admin dashboard with optimized PostgreSQL queries, reducing query times by 40%. - Automated tasks using Kubernetes cron jobs and built a Redis-backed PDF generation system integrated with Digio.

Vivek’s AI Stack

anthropic apis
anthropic apis
langfuse
langfuse
langgraph
langgraph
openai
openai
LiteLLM
LiteLLM
Qdrant
Qdrant

Education

Government Engineering College, Thrissur

Bachelor of Technology - BTech, Computer Science

Government Engineering College, Thrissur

20184 yrs2022
Chinmaya Vidyalaya

Computer Science

Chinmaya Vidyalaya

200413 yrs2017

Join Vivek and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Vivek Venu on Tal

Headline

Senior Backend Engineer | Golang • Python • Agentic AI • LLM Observability • RAG • Distributed Systems • Evaluations

About

Backend Software Engineer with 4 years of experience building distributed systems, backend platforms, and production AI infrastructure. My recent work has focused on LLM observability, evaluation frameworks, prompt versioning, RAG pipelines, agent workflows, vector databases, semantic search, and AI analytics. I've built backend services that process millions of AI trace events, designed high-throughput ingestion pipelines, and worked on systems for prompt management, experimentation, and production monitoring. I primarily work with Golang and Python, building scalable APIs, event-driven systems, and distributed services using PostgreSQL, Redis, ClickHouse, Docker, and cloud platforms. I also have experience integrating OpenAI, Anthropic, and Gemini models using LangChain and LangGraph. I'm particularly interested in backend engineering, AI infrastructure, AI observability, evaluation systems, retrieval systems, and developer platforms that help teams build reliable production AI applications.

Location

Bengaluru

AI stack

anthropic apis

langfuse

langgraph

openai

LiteLLM

Qdrant

Work experience

AI Engineer at Digio.in, Sep 2026 - Present · 1 mo, Bengaluru

Senior Software Engineer at Netra, Dec 2025 - Aug 2026 · 9 mos, Kochi, Kerala, India, Built core platform capabilities for Netra, an LLM observability platform that helps teams debug, evaluate, and improve production AI applications through tracing, experimentation, and analytics. • Architected immutable prompt versioning with protected production deployments, trace linkage, and reproducible prompt rollouts. • Designed a multi-turn agent evaluation framework supporting configurable personas, LLM-as-judge evaluation, and automated regression testing. • Built an insights pipeline using embeddings, K-Means, HDBSCAN, and statistical baselines to surface semantic clusters, behavioral drift, latency anomalies, and tool usage trends. • Extended the asynchronous trace ingestion pipeline built on BullMQ and ClickHouse, contributing to a platform processing ~8 million spans per month. • Worked across backend architecture, API design, database modeling, frontend contracts, and AI workflows to deliver production-ready platform capabilities.

Senior Software Engineer at KeyValue Software Systems, Dec 2025 - Aug 2026 · 9 mos, Kochi, Kerala, India, • Building an end-to-end LLM observability platform for production AI systems, covering tracing, evaluation, and experimentation workflows. • Implemented prompt versioning and tracking to enable reproducible deployments, controlled rollouts, and regression analysis. • Developed large-scale simulation and evaluation pipelines for agent workflows using scenario datasets, enabling automated scoring and performance benchmarking.

Software Engineer at KeyValue Software Systems, May 2024 - Jan 2026 · 1 yr 9 mos, Kochi, Kerala, India, - Leading development of a domain-specific Knowledge Graph using GraphRAG, improving contextual reasoning and data discovery. - Built an AI Twin platform leveraging RAG, LangGraph, and Qdrant to deliver text + voice assistants on user data. - Developed a Slack AI Agent for automated meeting scheduling, migrating from LangChain to LangGraph to improve accuracy and maintainability.

Associate Software Engineer at KeyValue Software Systems, Aug 2022 - May 2024 · 1 yr 10 mos, Kochi, Kerala, India, - Developed an admin dashboard with optimized PostgreSQL queries, reducing query times by 40%. - Automated tasks using Kubernetes cron jobs and built a Redis-backed PDF generation system integrated with Digio.

Education

Bachelor of Technology - BTech, Computer Science, Government Engineering College, Thrissur

Computer Science, Chinmaya Vidyalaya