Nelson P profile photo 1 on Tal

Nelson P

Lead QA Engineer | LLM Eval & Hallucination Testing | Playwright · Braintrust · MCP | Agentic Automation | Ex-Amazon | ClickUp

Chennai

10+ years of work experience

ClickUp
Mar 20242 yrs 6 mosPresent

Coimbatore

Amazon
Mar 20213 yrsFeb 2024

Chennai

Amazon
Oct 20182 yrs 5 mosFeb 2021

Greater Chennai Area

Amazon
Jul 20162 yrs 3 mosSep 2018

Chennai, Tamil Nadu, India

Nelson’s AI Stack

antigravity
antigravity
cursor
cursor
claudecode
claudecode

Education

Anna university

Bachelor of Engineering (BE), ENGINEERING

Anna university

20104 yrs2014

St.Paul's Matriculation Higher Secondary School , Neyveli

Join Nelson and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Nelson P on Tal

Headline

Lead QA Engineer | LLM Eval & Hallucination Testing | Playwright · Braintrust · MCP | Agentic Automation | Ex-Amazon | ClickUp

About

I build automation systems that don't just catch bugs — they evaluate AI. Lead Automation Engineer with 9+ years of experience across Web, API, and AI testing specializing at Amazon and ClickUp, I specialize in the intersection of traditional engineering rigor and modern AI quality: designing LLM evaluation pipelines, detecting hallucinations at scale, and building agentic test frameworks using MCP + Playwright. What I do at ClickUp: Leading a team of 7 QA engineers, I architected and scaled automation frameworks using Playwright (TypeScript) and Cypress (JavaScript), reducing regression cycle time and enabling parallel test execution across web and API layers via GitHub Actions and Jenkins CI/CD pipelines. I integrated MCP (Model Context Protocol) servers with Playwright to create context-aware, agent-driven test execution, a capability most QA teams haven't considered yet. I built LLM eval pipelines using Braintrust to measure factuality, hallucination rates, and task accuracy for non-deterministic AI features — bringing scientific rigor to a space that most teams treat as untestable. I also led OWASP-based security testing for AI-powered features using BurpSuite. What I built at Amazon (7+ years): Validated entitlement services, paywall logic, and AWS backend integrations (DynamoDB, SQS, Lambda, API Gateway) using REST Assured and Postman across thousands of data-driven test scenarios. Conducted load testing for Kindle Direct Publishing cover services via API Gateway, visual regression testing using Cypress for image comparison workflows, and PostgreSQL-based data validation to verify content metadata accuracy. Triaged security vulnerabilities to maintain system compliance and operated in a shift-left model, embedding QA into early sprint cycles to reduce defect escape rates. Core Stack: Playwright · Cypress · TypeScript · Java · REST Assured · Braintrust · MCP · GitHub Actions · Jenkins · AWS (DynamoDB, SQS, Lambda, S3) · Postman · BurpSuite · Datadog · Appium · BDD/Cucumber · PostgreSQL Open to Senior/Staff Automation Engineer, QA Lead, SDET, or AI Quality Engineering roles. Feel free to reach out — I'm always happy to connect with teams pushing the boundaries of quality engineering."

Location

Chennai

AI stack

antigravity

cursor

claudecode

Work experience

Lead Software Quality Engineer at ClickUp, Mar 2024 - Present · 2 yrs 6 mos, Coimbatore

Senior Quality Assurance Engineer at Amazon, Mar 2021 - Feb 2024 · 3 yrs, Chennai

Quality Assurance Engineer at Amazon, Oct 2018 - Feb 2021 · 2 yrs 5 mos, Greater Chennai Area

Quality Assurance Analyst at Amazon, Jul 2016 - Sep 2018 · 2 yrs 3 mos, Chennai, Tamil Nadu, India

Education

Bachelor of Engineering (BE), ENGINEERING, Anna university

St.Paul's Matriculation Higher Secondary School , Neyveli