Rohit Jha profile photo 1 on Tal

Rohit Jha

Building Scalable SAAS AI-Powered Platforms | Solution Architect | AI Engineer | Node.js | AWS | RAG | LLMs

Bengaluru, Karnataka

9+ years of work experience

Nexxio Technologies
Mar 20233 yrs 5 mosPresent

Bengaluru

70+ MSMEs | 3M+ users | 6Cr+ monthly transactions Core Engineering: Architected and scaled B2B SaaS platforms using Node.js, AWS, microservices, serverless Built Employee Connect, Dealer Connect, Partner Connect → 3M+ users Reduced cloud cost by 40%, improved reliability through serverless and infra redesign Owned engineering strategy, roadmap, hiring, and delivery management AI/ML Engineering (2024-Present): RAG-Based Knowledge Systems: Built enterprise knowledge bases using vector databases (Pinecone, Weaviate) and LLM orchestration, enabling natural language queries across 100K+ documents LLM Fine-tuning: Fine-tuned open-source models (Llama, Mistral) for MSME-specific tasks including invoice processing, compliance checks, and automated reporting—improving accuracy from 65% to 92% Conversational AI: Developed AI-powered chat support systems using GPT-4 and Claude, reducing customer support response time by 70% and handling 50K+ monthly conversations Predictive Analytics: Implemented ML pipelines for demand forecasting, inventory optimization, and churn prediction using scikit-learn, XGBoost—improving forecast accuracy by 35% AI Infrastructure: Built MLOps pipelines with model versioning, A/B testing, monitoring, and automated retraining workflows using AWS SageMaker and Lambda Vector Search: Implemented semantic search capabilities across product catalogs, reducing search-to-purchase time by 45% Leadership & Collaboration: Collaborated with founders on product vision, AI strategy, GTM planning, and investor documentation Led AI adoption workshops for engineering teams, establishing best practices for LLM integration and prompt engineering Evaluated and integrated AI APIs (OpenAI, Anthropic, AWS Bedrock) for production use cases
GoodWorker
Sep 20211 yr 7 mosMar 2023

Bengaluru, Karnataka, India

Founding backend engineer for a job platform used by millions - Designed secure, high-availability microservices + scalable APIs - Owned API architecture, low-latency services, and system optimization - Led backend integrations across product, data, mobile, and infra teams
Appnow technologies
Jun 20183 yrs 4 mosSep 2021

Bengaluru, Karnataka, India

- Scaled chat platform to 20M+ monthly transactions - Built SaaS commerce and chatbot products delivering high uptime - Led backend architecture improvements to support multi-tenant deployments
Accenture
Jan 20185 mosMay 2018

Accenture
Nov 20161 yr 3 mosJan 2018

Bangalore

- Improved backend performance for Cisco Webex - Enhanced scalability, reliability, and security for ETS (TOEFL/GRE) systems

Rohit’s AI Stack

cursor
cursor
langchain
langchain
ollama
ollama
openai
openai

Education

Veer Surendra Sai University Of Technology ( Formerly UCE ), Burla

Bachelor's degree, Information Technology

Veer Surendra Sai University Of Technology ( Formerly UCE ), Burla

20124 yrs2016

High School, Junior High/Intermediate/Middle School Education and Teaching

Maharshi College of Natural Law, BBSR, Khurda

20092 yrs2011

Join Rohit and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Rohit Jha on Tal

Headline

Building Scalable SAAS AI-Powered Platforms | Solution Architect | AI Engineer | Node.js | AWS | RAG | LLMs

About

I am a Principal Backend Engineer and Technical Lead with over 8 years of experience building scalable, cloud-native SaaS platforms. I specialize in designing distributed systems, event-driven microservices, and high-impact AI solutions, including RAG-based architectures and LLM fine-tuning. Throughout my career, I have successfully scaled platforms to support 3 million+ users and 60 million+ monthly transactions while optimizing infrastructure costs through serverless transitions. I combine deep backend engineering expertise with strategic leadership, mentoring teams and guiding product-driven AI innovation to deliver reliable, production-grade systems.

Location

Bengaluru, Karnataka

AI stack

cursor

langchain

ollama

openai

Work experience

Engineering Technical Lead at Nexxio Technologies, Mar 2023 - Present · 3 yrs 5 mos, Bengaluru, 70+ MSMEs | 3M+ users | 6Cr+ monthly transactions Core Engineering: Architected and scaled B2B SaaS platforms using Node.js, AWS, microservices, serverless Built Employee Connect, Dealer Connect, Partner Connect → 3M+ users Reduced cloud cost by 40%, improved reliability through serverless and infra redesign Owned engineering strategy, roadmap, hiring, and delivery management AI/ML Engineering (2024-Present): RAG-Based Knowledge Systems: Built enterprise knowledge bases using vector databases (Pinecone, Weaviate) and LLM orchestration, enabling natural language queries across 100K+ documents LLM Fine-tuning: Fine-tuned open-source models (Llama, Mistral) for MSME-specific tasks including invoice processing, compliance checks, and automated reporting—improving accuracy from 65% to 92% Conversational AI: Developed AI-powered chat support systems using GPT-4 and Claude, reducing customer support response time by 70% and handling 50K+ monthly conversations Predictive Analytics: Implemented ML pipelines for demand forecasting, inventory optimization, and churn prediction using scikit-learn, XGBoost—improving forecast accuracy by 35% AI Infrastructure: Built MLOps pipelines with model versioning, A/B testing, monitoring, and automated retraining workflows using AWS SageMaker and Lambda Vector Search: Implemented semantic search capabilities across product catalogs, reducing search-to-purchase time by 45% Leadership & Collaboration: Collaborated with founders on product vision, AI strategy, GTM planning, and investor documentation Led AI adoption workshops for engineering teams, establishing best practices for LLM integration and prompt engineering Evaluated and integrated AI APIs (OpenAI, Anthropic, AWS Bedrock) for production use cases

Senior Software Engineer at GoodWorker, Sep 2021 - Mar 2023 · 1 yr 7 mos, Bengaluru, Karnataka, India, Founding backend engineer for a job platform used by millions - Designed secure, high-availability microservices + scalable APIs - Owned API architecture, low-latency services, and system optimization - Led backend integrations across product, data, mobile, and infra teams

Full Stack Developer at Appnow technologies, Jun 2018 - Sep 2021 · 3 yrs 4 mos, Bengaluru, Karnataka, India, - Scaled chat platform to 20M+ monthly transactions - Built SaaS commerce and chatbot products delivering high uptime - Led backend architecture improvements to support multi-tenant deployments

System Developer at Accenture, Jan 2018 - May 2018 · 5 mos

Development Associate at Accenture, Nov 2016 - Jan 2018 · 1 yr 3 mos, Bangalore, - Improved backend performance for Cisco Webex - Enhanced scalability, reliability, and security for ETS (TOEFL/GRE) systems

Education

Bachelor's degree, Information Technology, Veer Surendra Sai University Of Technology ( Formerly UCE ), Burla

High School, Junior High/Intermediate/Middle School Education and Teaching, Maharshi College of Natural Law, BBSR, Khurda