Headline

Senior AI Product Operations Leader | LLM Evaluation | AI Quality Ops | Knowledge Systems| Product Operations | Human-in-the-Loop (HITL) | Ex-Flipkart | Ex-Yahoo | Lean SixSigma Black Belt

About

I build and scale the operational systems that enable AI products to deliver reliable, high-quality outcomes. I am a Product Operations and AI/ML Operations leader with 20+ years of experience building large-scale data, knowledge, and content ecosystems across Flipkart and Yahoo. My expertise spans Human-in-the-Loop (HiTL) systems, LLM evaluation, AI quality operations, search relevance, and AI training data infrastructure powering large-scale ML and Generative AI products. At Flipkart, I have led AI-driven catalog intelligence and automation programs, delivering measurable impact including ₹14 Cr cost savings, improved metadata accuracy, and scalable content operations across multiple languages. I specialize in: ● AI/ML Data Operations • LLM Evaluation • AI Quality Operations ● Search relevance & query intent mapping ● AI-powered Content Intelligence & Data Quality ● Vendor ecosystem management at scale ● Building high-performing global teams ● Driving operational efficiency and cost optimization I enjoy solving complex problems at the intersection of AI, data, and operations, and translating them into scalable, high-impact solutions. Beyond technology, I enjoy partnering with Product, Engineering, and Data Science teams, coaching future leaders, and building operational systems that help AI products scale globally. Currently building and experimenting with Generative AI applications, LLM feedback systems, AI agents, and intelligent automation for product operations. 📩 Open to leadership roles in AI/ML Operations, Product Operations, Program Mangement, and GenAI Programs.

Location

Bengaluru

AI stack

claude

gemini

hugging face

lovable

n8n

notebooklm

Work experience

Health and well-being at Career Break, May 2026 - Present · 5 mos, Bengaluru, Karnataka, India, • Personal care and wellbeing • Dedicated to targeted technical upskilling, deep-tuning domain expertise in LLM validation frameworks, agentic workflows, and GenAI product operations. • Conducting independent research into scalable Human-in-the-Loop (HiTL) quality governance to map operational frameworks against evolving enterprise AI demands.

Sr Manager II: Catalog Product Operations at Flipkart, Jan 2021 - Apr 2026 · 5 yrs 4 mos, Bengaluru, Karnataka, India, ● Architected end-to-end HiTL (Human-in-the-Loop) frameworks for ML model training and evaluation, reducing model iteration cycles by ~30% and enabling zero-defect GTM launches for 5+ GenAI features and A/B experiments annually. ● Managed CV (Computer Vision) and LLM-based automation within QC workflows, delivering ₹14 Cr in annual Catalog QC cost savings while maintaining rigorous data integrity standards for zero-human touch across multiple QC guidelines. ● Improved model accuracy across 4 high-impact AI use cases — conversational assistants, automated invoice extraction, content moderation, and visual search — by partnering with Product, Engineering, and Data Science teams to close annotation gaps and refine ground truth datasets. ● People Leadership of 17 FTEs (incl. 1M, 2 AMs, 3 TLs) across simultaneous delivery of complex knowledge programs. Lead hiring, mentorship, diversity balance, retention, OKR setting, KPI tracking and structured periodic business review. ● Scaled and governed a 100+ agent vendor ecosystem across annotation, validation, and AI model evaluation programs, establishing SLA frameworks and quality rubrics that maintained <5% defect rate at scale. ● Scaled content operations to 7,000+ optimized product descriptions per month, directly contributing to an 8–10 bps uplift in user conversion rates by improving content quality, storytelling of the static attributes, SEO alignment, and category-specific relevance for brand-store creation.

Sr Manager: Catalog Product Operations at Flipkart, Mar 2017 - Jan 2021 · 3 yrs 11 mos, Greater Bengaluru Area, ● Expanded platform reach with a 7% DAU share increase by developing and operationalizing a vernacular content strategy across 12 Indic languages, enabling first-language shopping experiences for non-English users. ● Boosted catalog completeness by 25 bps and sustained 90% metadata accuracy by designing and operationalizing attribute enrichment pipelines covering millions of SKUs across high-velocity product categories. ● Managed a 30+ vendor team and collaborated with business teams to develop structured ground-truth dataset pipelines and evaluation workflows strengthening attribute classification and catalog intelligence systems. ● Orchestrated cross-functional catalog readiness program for Grocery vertical launch, aligning Sourcing, Cataloging, and Tech teams to deliver fully attributed, search-optimized catalog ahead of launch deadline.

Manager - Search Quality Analysis Operations at Flipkart, Nov 2015 - Mar 2017 · 1 yr 5 mos, Bengaluru, Karnataka, India, ● Optimized search relevance by 5–8% through the implementation of semantic query quality analysis and intent mapping for "top and torso" search traffic. Enhanced product discoverability and navigation experience. ● Reduced cold-start search latency for newly listed mobile SKUs by designing rapid- intent mapping with search keys and indexing workflows, cutting average time-to-discovery from listing by an estimated 35%. ● Analysed the Product Recommendation suggestions to improve CTR by 5-8%

Manager, Editorial - Search, Marketplaces and Platform at Yahoo! at Yahoo! SDC, Bangalore, Nov 2006 - Nov 2015 · 9 yrs 1 mo, Bengaluru, Karnataka, India, ● Led global search quality evaluation programs across web, multimedia, and commerce platforms (Y! Search, Y! Shopping, Y! Answers, Y! Travel) ● Built training data frameworks for next-generation search systems ● Managed cross-region teams (APAC, EMEA, US) for platform quality and UI validation ● Collaborated with product and engineering teams to ensure high-quality search experience ● Managed a vendor team to deliver on the structured data extraction context for building rich search results

Team Leader-Web content Copyright Quality Control at INTRASOFT TECHNOLOGIES (I) PVT. LTD., Kolkata, India, Jun 2003 - Nov 2006 · 3 yrs 6 mos, ● Led editorial research and compliance operations for the eGreetings portal: www.123Greetings.com ● Managed content audits ensuring data integrity and copyright compliance

Intern at BHW Home Finance Ltd. (Formerly Birla Home Finance Ltd), Apr 2002 - Apr 2003 · 1 yr 1 mo, Kolkata, West Bengal, India, Maintained the customer collateral security deposit details as part of the loan appraisal and disbursement process.

Education

PG DIPLOMA, Public Relations, Annamalai university

Bachelor of Arts, Calcutta University, Kolkata

Public links

github: https://github.com/biswanathkar-oss

biswanathkar.lovable.app: https://biswanathkar.lovable.app/