Headline

Principal SDET @PubMatic | 9+ Years in Test Automation | Python | Playwright | PyTest | API, UI & GenAI Testing | CI/CD | Building Scalable Quality Engineering Solutions

About

I am working as Principal SDET in PubMatic. GenAI Automation Initiatives: - • Designed and developed a GVal-based GenAI Chatbot Automation Framework to evaluate chatbot accuracy, consistency, and contextual response quality. • Implemented GVal metric scoring automation for chatbot responses, enabling quantitative evaluation of GenAI performance (fluency, relevance, and factual accuracy). • Integrated GenAI test framework into CI/CD pipeline to ensure every chatbot model release is validated against benchmark GVal scores. • Collaborated with data scientists and GenAI developers to improve model finetuning and reduce response variance across multiple environments. • Due to end-to-end GenAI automation, the team achieved faster release cycles and improved quality confidence for GenAI-based products. • Automated GVal report generation and Slack notifications for score regression, improving release visibility and accountability. API Automation : - • Architected and implemented an organization-wide API automation framework using PyTest, enabling 10+ teams to standardize testing and improve reusability. • Designed generic configurations (conftest.py) and utilities for DB operations, JSON validation, Slack alerts, and reporting, reducing onboarding time by 50%. • Integrated Allure reporting for enhanced test visibility and traceability across CI/CD pipelines. • Developed and maintained Integration API Test Framework that allows data sharing between teams, improving integration test reliability and speed. • Utilized MySQL for storing and fetching shared test data across services, automating inter-team data flow. UI Automation : - • Built and maintained WDIO UI Test Framework using the Page Object Model, creating reusable UI component libraries that improved script reusability by 60%. • Published internal UI automation libraries with pre-built utilities for dropdowns, input fields, and search components. • Led the Tech Upgrade Team, ensuring timely upgrades of Jenkins, PyTest, WDIO, and Selenium infrastructure across all QA environments. • Provided mentorship and technical guidance to SDETs across teams, conducting code reviews and framework workshops.

Location

Pune

AI stack

claude code

claude

cursor

gemini

windsurf

ChatGPT

Work experience

Principal Software Engineer in Test at PubMatic, Sep 2024 - Present · 2 yrs, Pune District, GenAI Automation : • Designed and built a GVal-based GenAI Chatbot Automation Framework — one of the first SDET-led GenAI evaluation initiatives — to quantitatively measure chatbot accuracy, fluency, relevance, and factual consistency. • Integrated GenAI test framework into CI/CD (Jenkins) so that every chatbot model release is automatically validated against benchmark GVal scores before deployment. • Automated GVal report generation and Slack score-regression alerts, giving product and engineering teams real-time quality visibility. API Automation : • Architected an organization-wide PyTest-based API automation framework adopted by 10+ internal teams, establishing a single standard for API test development and data validation across the company. • Designed modular conftest.py configurations and utility libraries for DB operations, JSON schema validation, Slack alerts, and Allure reporting - cutting SDET onboarding time by 50%. • Built an Integration API Test Framework for cross-team data sharing, significantly improving end-toend integration test reliability and execution speed. • Used MySQL to automate inter-team test data flow, eliminating manual data setup steps across multiple service validations. UI Automation : • Built and owned a scalable Playwright-based UI automation framework using Page Object Model (POM), reducing test script duplication by ~60% and enabling faster test development across teams. • Developed a shared library of reusable UI components (dropdowns, search workflows, input handlers) published internally to standardize UI test patterns company-wide. • Led framework modernization: upgraded Jenkins pipelines, PyTest configurations, and browser automation tooling - improving pipeline stability and execution speed. • Mentored SDETs through structured code reviews, best practice sessions, and hands-on workshops, improving code quality and accelerating automation adoption across the team.

Software Engineer in Test - II at PubMatic, Jan 2023 - Sep 2024 · 1 yr 9 mos, Pune, Maharashtra, India

Senior QA Automation Engineer at PubMatic, Jun 2022 - Jan 2023 · 8 mos, Pune, Maharashtra, India

Senior engineer in testing at FIS, Jun 2017 - Jun 2022 · 5 yrs 1 mo, Pune District, API & UI Automation : • Built and maintained comprehensive automated test suites across backend API and UI layers using PyTest, Selenium, and Python - covering regression, smoke, and integration scenarios for financial software products serving enterprise clients. • Constructed a Smoke Test Automation pipeline on TeamCity that auto-triggered pre-patch validation across multiple services, reducing manual regression effort by 70% and significantly accelerating release confidence. • Wrote unit tests using pytest-mock and integrated full regression suites into TeamCity CI/CD, eliminating dependency on manual pre-release checks and improving deployment reliability. Framework & Reporting : • Maintained and improved a legacy keyword-driven automation framework in TestComplete (VBScript), refactoring scripts for better modularity, stability, and long-term maintainability. • Delivered structured HTML-based test execution reports for every test run, giving business stakeholders clear visibility into release quality and test coverage. • Collaborated closely with developers and business analysts to align test coverage with release scope, preventing scope gaps that previously caused post-release defects.

Intern at InnoBytes Technologies, Aug 2016 - Jul 2017 · 1 yr, Pune, Maharashtra, India

Education

Bachelor of Engineering (BE), Computer Engineering, Pune Institute of Computer Technology