Lead QA Engineer | LLM Eval & Hallucination Testing | Playwright · Braintrust · MCP | Agentic Automation | Ex-Amazon | ClickUp

Coimbatore

Chennai

Greater Chennai Area

Chennai, Tamil Nadu, India




Bachelor of Engineering (BE), ENGINEERING
Anna university
St.Paul's Matriculation Higher Secondary School , Neyveli
Join Nelson and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossLead QA Engineer | LLM Eval & Hallucination Testing | Playwright · Braintrust · MCP | Agentic Automation | Ex-Amazon | ClickUp
I build automation systems that don't just catch bugs — they evaluate AI. Lead Automation Engineer with 9+ years of experience across Web, API, and AI testing specializing at Amazon and ClickUp, I specialize in the intersection of traditional engineering rigor and modern AI quality: designing LLM evaluation pipelines, detecting hallucinations at scale, and building agentic test frameworks using MCP + Playwright. What I do at ClickUp: Leading a team of 7 QA engineers, I architected and scaled automation frameworks using Playwright (TypeScript) and Cypress (JavaScript), reducing regression cycle time and enabling parallel test execution across web and API layers via GitHub Actions and Jenkins CI/CD pipelines. I integrated MCP (Model Context Protocol) servers with Playwright to create context-aware, agent-driven test execution, a capability most QA teams haven't considered yet. I built LLM eval pipelines using Braintrust to measure factuality, hallucination rates, and task accuracy for non-deterministic AI features — bringing scientific rigor to a space that most teams treat as untestable. I also led OWASP-based security testing for AI-powered features using BurpSuite. What I built at Amazon (7+ years): Validated entitlement services, paywall logic, and AWS backend integrations (DynamoDB, SQS, Lambda, API Gateway) using REST Assured and Postman across thousands of data-driven test scenarios. Conducted load testing for Kindle Direct Publishing cover services via API Gateway, visual regression testing using Cypress for image comparison workflows, and PostgreSQL-based data validation to verify content metadata accuracy. Triaged security vulnerabilities to maintain system compliance and operated in a shift-left model, embedding QA into early sprint cycles to reduce defect escape rates. Core Stack: Playwright · Cypress · TypeScript · Java · REST Assured · Braintrust · MCP · GitHub Actions · Jenkins · AWS (DynamoDB, SQS, Lambda, S3) · Postman · BurpSuite · Datadog · Appium · BDD/Cucumber · PostgreSQL Open to Senior/Staff Automation Engineer, QA Lead, SDET, or AI Quality Engineering roles. Feel free to reach out — I'm always happy to connect with teams pushing the boundaries of quality engineering."
Chennai
antigravity
cursor
claudecode
Lead Software Quality Engineer at ClickUp, Mar 2024 - Present · 2 yrs 6 mos, Coimbatore
Senior Quality Assurance Engineer at Amazon, Mar 2021 - Feb 2024 · 3 yrs, Chennai
Quality Assurance Engineer at Amazon, Oct 2018 - Feb 2021 · 2 yrs 5 mos, Greater Chennai Area
Quality Assurance Analyst at Amazon, Jul 2016 - Sep 2018 · 2 yrs 3 mos, Chennai, Tamil Nadu, India
Bachelor of Engineering (BE), ENGINEERING, Anna university
St.Paul's Matriculation Higher Secondary School , Neyveli