Headline

Head of Engineering, Data Platforms, Large-scale Backend Architecture | AI Engineering, Multi-Agentic Data Platforms (RAG, MCP, Agent Orchestration) | Cloud, Data, Streaming at Peta-byte scale | Ex-Amazon (20+)

About

* Last 23+ years - I loved working back from customer problems, scaled and built user-facing software products, transformational large-scale peta-byte scale big/fast data, streaming, messaging platforms through generational tech shifts (relational warehouse, map-reduce, cloud-native, lake, lakehouse, managed, serverless) empowering data democratization throughout. Set and executed tech strategies for billion $$ global businesses. * AI Driven Platform Modernization - In Wayfair, i led GenAI leveraged modernization of data platform from legacy to cloud-native (GCP stack) and converted 10000s of legacy data pipelines to GCP tech stack. Restructured operating models across Data Engineering, Analytics and AI Engineering to de-centralize data ownership (Data Contracts, Data Mesh, Medallion Architecture) while driving data democratization through AI driven analytics. * Now in the AI era, building at the frontier of Agentic AI and real-time data platforms. Currently deep in hands-on AI engineering — designing and building multi-agent data systems using LangGraph, Claude API, Evals and MCP (Model Context Protocol), with RAG pipelines on ChromaDB and Neo4j knowledge graphs for semantic and relationship-aware retrieval. * Always passionate about high-velocity data, built and continue to master/build/implement production-grade sub-second real-time streaming — Kafka and Apache Flink at internet scale and event-driven architecture. Building AI engineered Agentic Kafka/Flink streaming pipelines and reducing human-in-loop in managing, running large-scale streaming techs... * As an accomplished GCC leader (almost for a decade now), i have built high-performant engineering teams and fostered a culture of quality, speed, and technical rigor. Drove a Innovation first culture (patent in data systems - US9092472) and helped people expand their scope, create larger impact and grow. * High Quality Operator, Decision Maker, High-performant Org builder of bootstrapping and scaling engineering organizations of 100+ engineers. Tech Stacks: LangGraph · Claude API · MCP · RAG · ChromaDB · Neo4j · Kafka · Flink · Delta Lake · Spark · AWS · Airflow · dbt · FastAPI · Python

Location

Greater Bengaluru Area

AI stack

anthropic apis

claude code

claude

langgraph

Supabase

Work experience

Self-directed at Agentic AI Engineering, Streaming Systems, Mar 2026 - Present · 6 mos, Independent Study & Hands-on Build, Self-directed and building Agentic AI applications and MLOps through structured project-based learning.

Professional development at Career Break, Mar 2026 - Present · 6 mos, Bengaluru, Karnataka, India, * Designing and building a modern NL2SQL Agent - a multi-agent LangGraph orchestrated NL2SQL Data platform leveraging Claude API, MCP, RAG-powered, ReACT Agentic Loop, Eval and Human-in-Loop constructs. * Designing an autonomous multi-agent data pipeline system that builds pipelines (data contracts, ingest, curate, anlayze, store, compute) triggered from a business inputs (ex. RFC, BRD..). Creates e2e pipelines across Kafka, Flink, Clickhouse, Iceberg, S3, modern Data Lakehouse architecture and orchestrated by LangGraph. * Built an end-to-end RAG pipeline with ChromaDB for vector search and Neo4j for knowledge graph traversal — enabling semantic and relationship-aware retrieval over operational data with advanced patterns including CRAG and Agentic RAG with ReAct loops.

Head of Engineering, Data and Messaging Platforms – Wayfair, Inc at Wayfair, Aug 2025 - Feb 2026 · 7 mos, Greater Bengaluru Area, Venkatesh was the global head of engineering of Wayfair’s Data and Messaging platforms. His team owned, built, maintained and run large-scale data and messaging platform (Kafka) for Wayfair. * He led the modernization of WF’s legacy data and messaging platform architecture into GCP tech stack driving innovation across large-scale data storage, compute, orchestration and consumption tech stacks. * He drove Data Mesh architecture driving federation and de-centralization of data empowering WF businesses with scalable tools around GenAI based contracts, quality, discovery, access, lineage and other data constructs. * He drove the team to leverage GenAI capabilities to innovate and accelerate Data Mesh eliminating months of tech efforts and democratized data in the hands of tech, science, business, marketing and product customers. * He drove site reliability, observability, scalability by incorporating best of SRE practices while improving availability of tech stacks. ** He led re-architecture, de-centralization and federation of Messaging platform of WF thereby accelerating real-time signals reach downstream Personalization, Ad, Marketing, Recommendation platforms in seconds against months improving WF personalized contextual CX.

Head of Engineering and Data Platform - Amazon Prime at Amazon, Aug 2015 - May 2025 · 9 yrs 10 mos, Bengaluru Area, India, Amazon Prime is the 3rd strategic business pillar for Amazon next to Retail and AWS. I was the global Head of Engineering and Data Platform for WW Amazon Prime’s and was responsible for three charters: 1. Event-Based Real-time Platform Engineering and Services – I led team of senior engineers, managers, product and program managers that built large-scale event-based real-time streaming platform and software services that processed billions of real-time amazon events data and transformed them into real-time intelligent signals consumed by upstream systems. This high-speed cloud-native architecture had built-in fault-tolerant, low-latent (push and pull APIs/Notification), highly-reliable pub-sub messaging systems (Kafka, Kinesis) and large-scale data transformation (KDA with Flink, Apache Spark) system designs that guaranteed reliable delivery of intelligent signals while processing a peak of 15K-20K TPS. This platform also powered Amazon’s WW Event business performance monitoring processing billions of events data. This multi-tenant, hands-off-the-wheel platform empowered 100s of software engineers who brought their streaming data and self-operated by ingesting, curating and consuming intelligence. 2. Prime Data, Analytics Platform and Data Products – [Platform] I led a team of Senior managers, Principal/Senior engineers and PMs that built cloud-native data platform that transformed, stored and enabled data democratization on ‘00s of PB of amazon datasets. This team innovated and delivered scalable capabilities on all aspects of data governance and data-as-products across quality, reliability, security, lineage, discovery, sel-service, experimentation, segmentation, GenAI based data bots. 3. Customer 360 Data Cloud: He led a global team of analytics engineers (US, India, APAC, MENA) and data scientists that built customer 360 data intelligence that unlocked variety of personalization CX for WW Prime business.

Sr.Manager, Amazon Enterprise Big Data Architecture and Platform at Amazon, May 2012 - Jul 2015 · 3 yrs 3 mos, Hyderabad Area, India, I owned, designed and built the next generation Apache Hadoop/AWS Redshift, EMR cloud based Amazon Enterprise Data Platform, Architecture and Services. Led the team to own, build and transform Amazon's data architecture into cloud based infrastructure thereby scaling amazon data and BI services to web-scale volumes. Responsible for building teams, strategizing next generation EDW, continuous improvements to make data workflows high scalable, building and executing multi year roadmaps. Own support function to make sure we deliver the data ontime to our customers. Responsible for end-to-end Data and Analytics solutions for a multi billion dollar business of Amazon.com. Responsible for leading a team of data engineers, business intelligence engineers, business analysts and support engineers. Built scalable real time analytics solutions based on Oracle, Redshift, EMR, Microstrategy/Tableau, Elastic Search/Kibana on billions/peta bytes of data.

Head of Data Platforms - Amazon Prime at Amazon, Oct 2005 - Apr 2025 · 19 yrs 7 mos

Senior Manager at Amazon Enterprise Data, Oct 2005 - Jul 2015 · 9 yrs 10 mos, One of the four founding members of Amazon Enterprise Big Data (EBD) platform team that was boot-strapped and built from scratch.

Education

Master's degree, Computer Science, The University of Texas at Dallas

MS, Computer Science, The University of Texas at Dallas