Software Engineer @ optum

Greater Bengaluru Area

Bangalore Urban, Karnataka, India

Bengaluru, Karnataka, India

Bengaluru, Karnataka, India





Bachelor of Technology - BTech, Electrical and Electronics Engineering
National Institute of Technology Karnataka
Join Harshith and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossSoftware Engineer @ optum
Bengaluru
claude
notebooklm
ollama
Chroma
Software Engineer at Optum, Oct 2025 - Present · 1 yr 2 mos, Greater Bengaluru Area, •Designed and built an end-to-end LLM testing and evaluation framework to validate agent-based AI systems with a focus on quality, reliability, and reproducibility. •Developed the backend using FastAPI, integrating DeepEval for automated LLM evaluation and LangChain + LangGraph for building and orchestrating multi-agent workflows. •Implemented custom evaluation metrics and test suites to assess LLM responses across correctness, relevance, hallucinations, and reasoning quality. •Built and managed agent-based architectures using LangGraph, enabling complex decision flows, tool usage, and stateful interactions. •Integrated evaluation pipelines with LLM test execution enabling scalable and repeatable testing of prompts, chains, and agents. •Collaborated on the frontend built with React, enabling users to trigger tests, visualize evaluation results, and analyze metrics through an interactive UI •Worked closely with cross-functional teams to align AI quality standards, test coverage, and deployment readiness.
Freelance Data Analyst at Rammina Dev & Design, Jan 2025 - Sep 2025 · 9 mos, Bangalore Urban, Karnataka, India, • Designed and deployed scalable ETL pipelines in Python and SQL for data ingestion, transformation, and validation • Built automated data quality checks integrated into development workflows, ensuring consistency across datasets • Developed interactive dashboards using Python and Tableau to surface business metrics and support decision-making
SDET at Moolya, Oct 2023 - Jul 2024 · 10 mos, Bengaluru, Karnataka, India, •Engineered Python and SQL scripts to automate validation of speech-to-text feature outputs across 4 product features •Integrated automated testing into Jenkins/Git CI/CD pipelines, reducing deployment errors by 30% •Collaborated with engineering teams to identify and resolve data quality issues, improving product reliability
Software Engineer at Honeywell, Jul 2022 - Aug 2023 · 1 yr 2 mos, Bengaluru, Karnataka, India, •Implemented and optimized 25 RESTful APIs for user management and network control using Python and SQL •Built and maintained automated test suites covering 120+ APIs using Robot Framework and Python, ensuring production-grade quality •Designed and executed Smoke and Regression test pipelines via Jenkins with nightly automated runs •Containerized system performance testing across 5–120 user scenarios using Docker •Reduced manual reporting effort by 30% through Python scripting and automation
Bachelor of Technology - BTech, Electrical and Electronics Engineering, National Institute of Technology Karnataka
github: https://github.com/SriHarshith1