Atul Singh profile photo 2 on Tal
Atul Singh profile photo 1 on Tal
Atul Singh profile photo 2 on Tal
Atul Singh profile photo 1 on Tal

Atul Singh

Senior SDET | Test Automation Architecture | AI/LLM & Agentic QA | Python | Playwright | Selenium | API | CI/CD | Apache Airflow

Bengaluru

8+ years of work experience

Astronomer
Sep 20242 yrs 3 mosPresent

Hyderabad

• Own and maintain the Apache Airflow 3.3 QA Test Plan covering Regression, UI Sanity, Migration and API testing across the release cycle. • Designed and shipped an autonomous AI-agent-driven QA system using Claude Agent SDK + Vertex AI for Astro Runtime release validation, including DAG triage, cross-cloud log retrieval, Airflow 2→3 migration testing and headless UI validation. • Converted 150+ manually tested QA scenarios into continuous CI coverage across 10+ major Airflow features. • Reviewed and merged 173 automation PRs across the Astronomer organization, enforcing framework and test-quality standards. • Built Playwright UI automation and Locust-based performance testing for Apache Airflow. • Root-caused release-blocking issues involving Airflow migrations, runtime dependencies and webserver readiness. • Improved CI reliability across Jenkins/GitHub Actions and resolved recurring infrastructure and test-loading failures.
SymphonyAI
Jul 20231 yr 2 mosAug 2024

Bengaluru

• Owned Python automation framework for AI Copilot products • Designed prompt/response evaluation testing • Tested LLM-generated responses for correctness and consistency • Performed hallucination and factual-accuracy testing • Tested RAG retrieval accuracy and answer grounding • Led CI/CD failure triage and regression testing • Reviewed automation contributions and mentored engineers
Planview, Inc.
Jul 20229 mosMar 2023

Bengaluru, Karnataka, India

PlanSource
Apr 20224 mosJul 2022

PlanSource
Jun 202111 mosApr 2022

Bengaluru, Karnataka, India

Sapiens
Sep 20173 yrs 10 mosJun 2021

Bengaluru Area, India

Atul’s AI Stack

anthropic apis
anthropic apis
claude code
claude code
cursor
cursor
github copilot
github copilot
ChatGPT
ChatGPT
Ragas
Ragas

Education

Centre for Development of Advanced Computing (C-DAC)

Post Graduation Diploma, Computer Science

Centre for Development of Advanced Computing (C-DAC)

20172017
Rajiv Gandhi Prodyogiki Vishwavidyalaya

Bachelor's degree, Computer Engineering

Rajiv Gandhi Prodyogiki Vishwavidyalaya

20094 yrs2013

Join Atul and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Atul Singh on Tal

Headline

Senior SDET | Test Automation Architecture | AI/LLM & Agentic QA | Python | Playwright | Selenium | API | CI/CD | Apache Airflow

About

Engineer with 9+ years of experience building test automation systems, quality engineering practices, and CI/CD pipelines across SaaS, AI, data, and cloud platforms. Currently working at Astronomer, focused on QA automation for Apache Airflow and Astro Runtime. Some of the work I'm currently involved in: • Leading regression automation across major Apache Airflow features and converting 150+ manual QA scenarios into continuous CI coverage • Building AI-agent-driven QA automation using Claude Agent SDK + Vertex AI for end-to-end release validation • Building Playwright-based UI automation and Python API automation • Developing Locust-based performance testing for Airflow APIs • Improving CI/CD reliability across Jenkins, GitHub Actions and other automation infrastructure • Reviewing automation PRs on framework and quality standards I also have experience testing AI/LLM applications, including prompt/response evaluation, hallucination detection, factual-accuracy testing and RAG pipeline validation. Core stack: Python | Java | JavaScript | Playwright | Selenium | PyTest | API Testing | Jenkins | GitHub Actions | CircleCI | Git | SQL | JIRA | Azure DevOps | Locust | AI/LLM QA I'm particularly interested in SDET Lead, Senior SDET, QA Automation Lead, Test Automation Architect and AI/LLM Quality Engineering opportunities.

Location

Bengaluru

AI stack

anthropic apis

claude code

cursor

github copilot

ChatGPT

Ragas

Work experience

Senior Software Development Engineer Test at Astronomer, Sep 2024 - Present · 2 yrs 3 mos, Hyderabad, • Own and maintain the Apache Airflow 3.3 QA Test Plan covering Regression, UI Sanity, Migration and API testing across the release cycle. • Designed and shipped an autonomous AI-agent-driven QA system using Claude Agent SDK + Vertex AI for Astro Runtime release validation, including DAG triage, cross-cloud log retrieval, Airflow 2→3 migration testing and headless UI validation. • Converted 150+ manually tested QA scenarios into continuous CI coverage across 10+ major Airflow features. • Reviewed and merged 173 automation PRs across the Astronomer organization, enforcing framework and test-quality standards. • Built Playwright UI automation and Locust-based performance testing for Apache Airflow. • Root-caused release-blocking issues involving Airflow migrations, runtime dependencies and webserver readiness. • Improved CI reliability across Jenkins/GitHub Actions and resolved recurring infrastructure and test-loading failures.

Senior SDET | AI/LLM Quality Engineering at SymphonyAI, Jul 2023 - Aug 2024 · 1 yr 2 mos, Bengaluru, • Owned Python automation framework for AI Copilot products • Designed prompt/response evaluation testing • Tested LLM-generated responses for correctness and consistency • Performed hallucination and factual-accuracy testing • Tested RAG retrieval accuracy and answer grounding • Led CI/CD failure triage and regression testing • Reviewed automation contributions and mentored engineers

SDET at Planview, Inc., Jul 2022 - Mar 2023 · 9 mos, Bengaluru, Karnataka, India

Senior Software QA Engineer at PlanSource, Apr 2022 - Jul 2022 · 4 mos

Software QA Engineer at PlanSource, Jun 2021 - Apr 2022 · 11 mos, Bengaluru, Karnataka, India

Quality Analyst at Sapiens, Sep 2017 - Jun 2021 · 3 yrs 10 mos, Bengaluru Area, India

Education

Post Graduation Diploma, Computer Science, Centre for Development of Advanced Computing (C-DAC)

Bachelor's degree, Computer Engineering, Rajiv Gandhi Prodyogiki Vishwavidyalaya