Headline

Technical Lead @ Sigmoid | Data Engineering, Solution Architecture

About

Technical Lead and Senior Data Engineer with over 12 years of experience specializing in architecting enterprise AI/ML systems and scalable cloud infrastructure. Proven track record in building production-grade RAG solutions, multi-agent LLM platforms, and optimizing data pipelines for cost efficiency and high performance. Skilled in leading cross-functional teams to modernize legacy data systems and deploy automated DevOps workflows that significantly reduce operational overhead and infrastructure costs. Committed to driving digital transformation through strategic cloud architecture and intelligent automation.

Location

Bengaluru, Karnataka

AI stack

hugging face

langchain

langgraph

openai

Work experience

Technical Lead at Sigmoid, Feb 2025 - Present · 1 yr 6 mos, Bengaluru, Karnataka, India, Responsible for architecting enterprise AI/ML systems, cloud automation platforms, and production RAG solutions with focus on multi-agent AI systems and scalable infrastructure. Deployed production RAG system using GPT-4 multi-agent routing (BOM, RAG, Metadata agents) with Azure AI Search HNSW indexing across 2M+ chunks, achieving less than 1 second response time and 95%+ accuracy. Engineered Smart Insights 2.0 FastAPI backend with multi-agent AI system using LangGraph, integrating Okta authentication, PostgreSQL, and Databricks for real-time analytics with WebSocket streaming. Developed RAPID cloud automation platform with multi-stage approval workflows, Terraform provisioning, and component-level cost estimation, supporting 15+ Azure services (AKS, PostgreSQL, CosmosDB, Key Vault). Built AI Store Backend providing unified LLM access (GPT-4, Llama-3, Mistral) with semantic caching using 85% similarity threshold, reducing API costs and improving response times. Achievements: Reduced infrastructure deployment time from 3-5 days to less than 2 hours (70% DevOps effort reduction). Achieved less than 1s query response with 95%+ accuracy across 2M+ document chunks.

Asst Dir Senior software Engineer at Moody's Analytics, Sep 2019 - Sep 2024 · 5 yrs 1 mo, Bengaluru Area, India, • Led migration of Hive and SQL jobs to AWS EMR, reducing operational costs and enhancing availability. • Identified unused AWS resources, implemented S3 bucket expiration policies, saving over $50,000 annually. • Developed in-house Spark ETL tool for AWS pipeline creation using human-readable config file. • Designed and implemented a centralized data lake architecture using AWS S3 and Glue for scalable and cost-effective data storage. Streamlined data ingestion processes to support seamless analytics and reporting. • Enhanced data lake lifecycle management by setting up automated archival and tiered storage policies, reducing costs by 20%. • Upgraded existing infrastructure for mongoDB migration and enhancement.

Big Data analyst at Accenture, Oct 2016 - Sep 2019 · 3 yrs, Bengaluru Area, India, Work closely with various teams across the company to identify and solve business challenges utilizing large structured, semi-structured, and unstructured data in a distributed processing environment. Worked on hadoop 2.6 ,cloudera. Experienced in Hive , Pig sqoop for data manipulation and ETL workflows. Designing data Pipeline for E2E projects. Enhanced data lake performance by implementing efficient data partitioning and indexing strategies using Hive.

Software Engineer at Tech Mahindra, Aug 2013 - Sep 2016 · 3 yrs 2 mos, Pune Area, India, Develops information systems by designing, developing, and installing software solutions.Creating a dynamic end to end map connecting business process to the IT infrastructure that supports it. Also developing in depth technical views for day to day operation and also executive or higher level views for business analysis and managerial tasks.Working experience in PIG, HIVE, Map Reduce and Hadoop Distributed File Systems (HDFS) .Knowledge in setting Hadoop Cluster .Developed scripts, numerous batch jobs to schedule various Hadoop programs.Experience in analyzing data using Hive QL, PIG Latin, and custom Map Reduce programs in Java.Worked on importing and exporting data from different databases like Oracle, MySQL into HDFS and Hive using Sqoop.Experience in collecting and storing stream data like log data in HDFS using Flume. Written Hive and PIG queries for data analysis to meet the business requirements. Experience with Oozie Workflow Engine to automate and parallelize Hadoop Map/Reduce, Hive and PIG jobs. Involved in writing data transformations, data cleansing using PIG operations.Completed Linux Professional training, LPIC-01and LPIC-02 training and earned an Bachelor’s degree in IT. Completed ITIL Foundation Certification and Training.

Education

Bachelor's degree, Information Technology, Maharashtra Institute of Technology

PGP in data science in association with IBM, Aegis School of Business, Data Science & Telecommunication