Nilesh Sharma profile photo 1 on Tal

Nilesh Sharma

Principal AI/Data Architect | GenAI & Agentic AI Platform Engineering Leader | LangGraph, Enterprise GenAI, RAG, LLMOps

Bengaluru

15+ years of work experience

Central Retail Digital
Jun 20214 yrs 10 mosMar 2026

Bangkok, Bangkok City, Thailand

Architected and led delivery of a Enterprise AI Agentic Platform — a unified enterprise GenAI system for Thailand's largest retail conglomerate (2,200+ stores, 65+ brands, $5B+ revenue) — now serving 50M+ customers at 3,000+ peak QPS with 100% auditability. Built a privacy-first trust layer (PII detection, masking, tokenization, encryption) and a Llama Guard 3 safety layer (content safety, jailbreak detection, prompt-injection defense, continuous bias auditing). Built a hybrid RAG grounding spine: Milvus vector search fused with BM25 lexical search and reranking, a Neo4j knowledge graph, and BGE-M3 multilingual embeddings with BGE Reranker V2 cross-encoding — across product, customer, supplier, and inventory data. Architected stateful multi-agent orchestration (LangGraph state machines + CrewAI role-based collaboration) with a DSPy-optimized prompt engine, powering 15+ production domain agents (Support, Chat & Shop, Merchandising) fine-tuned on Llama 3.1 8B/70B with human-in-the-loop escalation, sustaining 99.9% uptime. Instituted an end-to-end LLMOps lifecycle — LangFuse observability (tracing, cost, latency), RLHF/DPO alignment, LoRA/QLoRA fine-tuning, and automated regression testing/CI-CD — and self-hosted inference on NVIDIA NIM, cutting LLM costs roughly 40% (~$11.2M annually) versus commercial API pricing. Architected a unified Lakehouse foundation on GCP (BigQuery, Dataflow) processing 5TB+ daily through 200+ real-time pipelines; led migration off legacy AWS Athena/MuleSoft, cutting operational costs 25%. Established enterprise data and AI governance (automated quality/lineage checks, red-teaming and penetration testing, PDPA and ECOA/Reg B compliance) across 65+ brands. Partnered with the CEO and Board to align an $80M+ annual technology budget and a 50+ person cross-functional org around the Lakehouse and Agentic AI roadmap.
Alshaya Group
May 20201 yr 2 mosJun 2021

Dubai, United Arab Emirates

In a short and focused period, led the Data & AI transformation for Alshaya’s global retail portfolio — including H&M, Foot Locker, Pottery Barn, Bath & Body Works, Mothercare, American Eagle, Victoria’s Secret, and other major brand websites across MENA. Delivered Dynamic Yield–powered personalization, elevating customer engagement and marketing performance across all digital channels. Designed and built the MarTech Data Lake, integrating CRM, marketing, and ecommerce data while enabling leadership through unified BI dashboards, real-time KPIs, and cross-brand insights. Launched automated marketing feeds and data pipelines, improving campaign accuracy, product freshness, and operational efficiency across brand sites. Partnered with marketing, product, and retail leaders to ensure AI and data initiatives directly supported brand growth and Omnichannel strategy.
JRD Group
Jul 20145 yrs 11 mosMay 2020

Dubai, United Arab Emirates

During my time at JRD Group, I had the privilege of leading various Departments like Data, AI, Engineering and IT Ops for in-house products JustProperty.com, PropSpace.com, and JustRentals.com. My focus was on enabling teams, simplifying complexity, and building technology that could grow with the business. Key Highlights: Led with clarity and collaboration, ensuring engineering, product, commercial, and operations teams were aligned behind a common mission. Scaled platforms to support high growth, building systems that were fast, reliable, and resilient under increasing marketplace traffic. Guided major technical transformations, shaping data, search, and infrastructure capabilities that supported the business’s long-term strategy. Fostered a culture of shared ownership, where outcomes were driven not by individual effort but by collective belief and teamwork. Strengthened platform trust and reliability, ensuring consistently smooth experiences for brokers, partners, and property seekers. Enabled the strategic evolution of the business, contributing to the platforms becoming part of a regional PropTech unicorn PropertyFinder Group — a validation of years of disciplined engineering and collaborative leadership. Balanced vision with execution, focusing on delivering both short-term operational excellence and long-term technical foundations.
Dubizzle.com
Jan 20113 yrs 7 mosJul 2014

Dubai, UAE

As a Senior Software Engineer at Dubizzle, I was responsible for: Driving monetization strategies and optimizing revenue streams. Enhancing system performance and database efficiency for critical business functions. Leading improvements in search algorithms and SEO across the platform. Elevating content quality through innovative scoring systems. Overseeing API development and seamless integration for real-time data synchronization. In this role, I focused on leveraging technology to drive business growth, improve user experience, and ensure platform scalability and efficiency.

Nilesh’s AI Stack

claude
claude
langchain
langchain
langfuse
langfuse
langgraph
langgraph
langsmith
langsmith
openai
openai

Education

Indraprastha Institute of Information Technology, Delhi

Master of Technology (M.Tech.), Computer Science

Indraprastha Institute of Information Technology, Delhi

20102 yrs2012
Hindustan College of science and technology

Bachelor of Technology (B.Tech.), Computer Science

Hindustan College of science and technology

20054 yrs2009

Join Nilesh and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Nilesh Sharma on Tal

Headline

Principal AI/Data Architect | GenAI & Agentic AI Platform Engineering Leader | LangGraph, Enterprise GenAI, RAG, LLMOps

About

Principal Data & AI Architect with 15+ years of engineering leadership, including 4+ years architecting and shipping production-grade GenAI and agentic AI systems for a $5B+, 65-brand, 50M+-customer retail enterprise. I designed and led delivery of a Enterprise Grade AI Agentic Platform spanning multi-modal ingestion, hybrid RAG grounding (vector search, lexical search, and knowledge graphs), multi-agent orchestration (LangGraph, CrewAI, DSPy), model fine-tuning and alignment (LoRA/QLoRA, RLHF/DPO), and full-stack AI safety and governance (PII de-identification, prompt-injection defense, content-safety guardrails, bias auditing) — serving 50M+ customers at 3,000+ peak QPS with 100% auditability and roughly $11.2M (40%) in annual inference cost savings via self-hosted NVIDIA NIM. Deep hands-on expertise across the modern data stack (GCP, AWS, Apache Spark, Kafka, dbt, Airflow), paired with experience owning multi-million-dollar technology budgets ($80M+) and scaling engineering organizations (15 to 50+ FTE). I'm now focused on engineering leadership roles —VP/SVP of Engineering building production GenAI and agentic AI platforms.

Location

Bengaluru

AI stack

claude

langchain

langfuse

langgraph

langsmith

openai

Work experience

VP - Principal Architect — Data & AI Foundations (GenAI & Agentic AI Platforms) at Central Retail Digital, Jun 2021 - Mar 2026 · 4 yrs 10 mos, Bangkok, Bangkok City, Thailand, Architected and led delivery of a Enterprise AI Agentic Platform — a unified enterprise GenAI system for Thailand's largest retail conglomerate (2,200+ stores, 65+ brands, $5B+ revenue) — now serving 50M+ customers at 3,000+ peak QPS with 100% auditability. Built a privacy-first trust layer (PII detection, masking, tokenization, encryption) and a Llama Guard 3 safety layer (content safety, jailbreak detection, prompt-injection defense, continuous bias auditing). Built a hybrid RAG grounding spine: Milvus vector search fused with BM25 lexical search and reranking, a Neo4j knowledge graph, and BGE-M3 multilingual embeddings with BGE Reranker V2 cross-encoding — across product, customer, supplier, and inventory data. Architected stateful multi-agent orchestration (LangGraph state machines + CrewAI role-based collaboration) with a DSPy-optimized prompt engine, powering 15+ production domain agents (Support, Chat & Shop, Merchandising) fine-tuned on Llama 3.1 8B/70B with human-in-the-loop escalation, sustaining 99.9% uptime. Instituted an end-to-end LLMOps lifecycle — LangFuse observability (tracing, cost, latency), RLHF/DPO alignment, LoRA/QLoRA fine-tuning, and automated regression testing/CI-CD — and self-hosted inference on NVIDIA NIM, cutting LLM costs roughly 40% (~$11.2M annually) versus commercial API pricing. Architected a unified Lakehouse foundation on GCP (BigQuery, Dataflow) processing 5TB+ daily through 200+ real-time pipelines; led migration off legacy AWS Athena/MuleSoft, cutting operational costs 25%. Established enterprise data and AI governance (automated quality/lineage checks, red-teaming and penetration testing, PDPA and ECOA/Reg B compliance) across 65+ brands. Partnered with the CEO and Board to align an $80M+ annual technology budget and a 50+ person cross-functional org around the Lakehouse and Agentic AI roadmap.

AVP - Head of Digital Transformation (Data, AI & MarTech) at Alshaya Group, May 2020 - Jun 2021 · 1 yr 2 mos, Dubai, United Arab Emirates, In a short and focused period, led the Data & AI transformation for Alshaya’s global retail portfolio — including H&M, Foot Locker, Pottery Barn, Bath & Body Works, Mothercare, American Eagle, Victoria’s Secret, and other major brand websites across MENA. Delivered Dynamic Yield–powered personalization, elevating customer engagement and marketing performance across all digital channels. Designed and built the MarTech Data Lake, integrating CRM, marketing, and ecommerce data while enabling leadership through unified BI dashboards, real-time KPIs, and cross-brand insights. Launched automated marketing feeds and data pipelines, improving campaign accuracy, product freshness, and operational efficiency across brand sites. Partnered with marketing, product, and retail leaders to ensure AI and data initiatives directly supported brand growth and Omnichannel strategy.

Head of Data, AI & IT Ops at JRD Group, Jul 2014 - May 2020 · 5 yrs 11 mos, Dubai, United Arab Emirates, During my time at JRD Group, I had the privilege of leading various Departments like Data, AI, Engineering and IT Ops for in-house products JustProperty.com, PropSpace.com, and JustRentals.com. My focus was on enabling teams, simplifying complexity, and building technology that could grow with the business. Key Highlights: Led with clarity and collaboration, ensuring engineering, product, commercial, and operations teams were aligned behind a common mission. Scaled platforms to support high growth, building systems that were fast, reliable, and resilient under increasing marketplace traffic. Guided major technical transformations, shaping data, search, and infrastructure capabilities that supported the business’s long-term strategy. Fostered a culture of shared ownership, where outcomes were driven not by individual effort but by collective belief and teamwork. Strengthened platform trust and reliability, ensuring consistently smooth experiences for brokers, partners, and property seekers. Enabled the strategic evolution of the business, contributing to the platforms becoming part of a regional PropTech unicorn PropertyFinder Group — a validation of years of disciplined engineering and collaborative leadership. Balanced vision with execution, focusing on delivering both short-term operational excellence and long-term technical foundations.

Senior Software Engineer at Dubizzle.com, Jan 2011 - Jul 2014 · 3 yrs 7 mos, Dubai, UAE, As a Senior Software Engineer at Dubizzle, I was responsible for: Driving monetization strategies and optimizing revenue streams. Enhancing system performance and database efficiency for critical business functions. Leading improvements in search algorithms and SEO across the platform. Elevating content quality through innovative scoring systems. Overseeing API development and seamless integration for real-time data synchronization. In this role, I focused on leveraging technology to drive business growth, improve user experience, and ensure platform scalability and efficiency.

Education

Master of Technology (M.Tech.), Computer Science, Indraprastha Institute of Information Technology, Delhi

Bachelor of Technology (B.Tech.), Computer Science, Hindustan College of science and technology