Headline

QA Automation Lead | SDET | Playwright | Selenium | API Testing | Power BI | Azure DevOps | CI/CD | 11+ Years Experience

About

I'm a Senior SDET with 11+ years embedded full-time with Microsoft product engineering teams as an LTIMindtree engineer. For the last five years I've focused on test automation for Power BI, after coming up through desktop and app-compatibility testing. Most of my attention now is on a newer question for product teams: how do you measure whether an AI feature is good enough to ship? On Power BI Copilot, I led the QA-side evaluation work as part of the wider engineering team. We built an evaluation suite that scores Copilot answers against 200+ golden prompt and Q&A pairs using LLM-as-judge and rubric scoring, checks RAG attribution, and looks for groundedness gaps, hallucination, Responsible AI issues, and PII leakage on Azure OpenAI. It runs in CI and flags answer-quality regressions before release, so problems inform the go/no-go decision instead of surfacing after customers hit them. AI quality engineering and LLM evaluation are where I want to keep growing. Automation at scale. I rebuilt the team's E2E framework on Playwright and TypeScript. It now drives Power BI Desktop, SaaS, and the native Microsoft Teams client, with coverage up from 25% to 80% and 500+ scenarios behind Azure DevOps quality gates. Faster, safer releases. API and contract testing plus a request-mocking layer that reduced backend flakiness helped take pipelines roughly 50% faster and production defects down 35%, supporting a weekly release cadence. Leadership. I'm technical lead for a 15-engineer QA team, working on test strategy with Microsoft engineering and product managers. The onboarding playbook I wrote cut new-engineer ramp time by about 40%. Because client work is hard to show directly, I keep two public projects that use the same patterns: llm-eval-harness: a provider-agnostic LLM evaluation gate with golden datasets, LLM-as-judge, RAG attribution, drift tracking, and a CI gate. playwright-automation-framework: a Playwright and TypeScript reference framework with accessibility, visual, performance, and security checks. I'm open to Senior SDET, QA Automation Lead, and AI Quality Engineering roles with product companies and GCCs in Pune, Bangalore, Hyderabad, or remote. If your team is working on AI quality or test automation, I'd be glad to connect. github.com/yousufwaqar

Location

Pune/Pimpri-Chinchwad Area

AI stack

claude code

claude

deepseek

grok

kimi

manus

Work experience

Team Lead at QualityAI, Jul 2026 - Present · 2 mos

Senior Technical Specialist at LTM, Jan 2021 - Jun 2026 · 5 yrs 6 mos, Pune, Maharashtra, India, Led the QA-side evaluation work for Power BI Copilot as part of the engineering team: prompt regression on 200+ golden pairs, LLM-as-judge and rubric scoring, RAG attribution, and checks for groundedness, hallucination, Responsible AI, and PII leakage on Azure OpenAI. The suite runs in CI and flags answer-quality regressions before release. Rebuilt the team's E2E framework on Playwright and TypeScript inside the Power BI monorepo, with page objects, data-driven fixtures, and parallel execution. The same framework now drives Power BI Desktop, Power BI SaaS, and the native Microsoft Teams desktop client. Embedded full-time in the Microsoft engineering team: sprint ceremonies, automation roadmap, and direct work with Microsoft SDEs and PMs. Took automated coverage from 25% to 80%. Landed 500+ Playwright scenarios behind Azure DevOps quality gates, cut manual validation 60%, and reduced pipeline time about 50%, which helped support a weekly release cadence. Cut production defects 35% with Postman-based API and contract testing and by pulling QA into sprint planning, design reviews, and triage. Built the request-mocking layer that reduced SaaS E2E flakiness. Stood up the native Teams desktop test harness: a dual-target Playwright project (MSIX/WebView2 over Chrome DevTools Protocol, plus Teams web) with C# bridges and a UI Automation Azure AD sign-in driver. Tech lead for a 15-engineer QA team in India, including Hyderabad. Drive code reviews, WCAG accessibility remediation (Trusted Tester certified), and test strategy with Microsoft engineering and product management. The onboarding playbook I wrote cut new-engineer ramp time by about 40%.

Senior Quality Assurance Engineer at LTIMindtree, Nov 2017 - Dec 2020 · 3 yrs 2 mos, Pune, Maharashtra, India, Validated hundreds of line-of-business apps against pre-release Windows, Office, and browser builds and unblocked them for large internal rollouts (App Compatibility program, team of 30). Wrote desktop and browser automation in C#, Selenium WebDriver, Coded UI, WinAppDriver, and Mita across IE, Edge, and Windows desktop apps. Built PowerShell tooling that cut routine reporting effort about 30%. Ran defect triage and root-cause sessions with engineering leads, and provisioned end-to-end Windows Virtual Desktop test environments (VMs, networking, Azure subscriptions) so the team always had clean repro setups.

Quality Assurance Engineer at Mindtree, Apr 2015 - Oct 2017 · 2 yrs 7 mos, Pune, Maharashtra, India, Validated public-facing web platforms for functional accuracy, cross-browser compatibility, and accessibility ahead of each release. Owned test plans, scripts, and data for the main web modules. Tracked defects in TFS and worked across time zones with global teams on requirement reviews and bug closures, supporting predictable Agile/Scrum release cycles.

Education

Bachelor of Technology - BTech, Computer Science, Institute of technology and management

Bachelor of Technology, rajasthan technical university

Public links

github: https://github.com/yousufwaqar