Senior Software Engineer - Frameworks | AI LLM - Evaluation



Bengaluru, Karnataka, India · Hybrid

Bengaluru, Karnataka, India · Hybrid

Hyderabad, Telangana, India

Hyderabad, Telangana, India

Hyderabad, Telangana, India

Chennai, Tamil Nadu, India






PG Diploma in Natural Language Processing (Artificial Intelligence)
Annamalai university

Bachelor of Technology (B.Tech), Electrical and Electronics Engineering
JNTU Anantapur
Join Harshavardhan and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossSenior Software Engineer - Frameworks | AI LLM - Evaluation
Greetings, This is 𝑯𝒂𝒓𝒔𝒉𝒂𝒗𝒂𝒓𝒅𝒉𝒂𝒏{70% Abstract thinker & 30% Concrete thinker}. I am a Quality Assurance Engineer experienced in UI, API, LLM, Cloud and Database testing. I chose a career in tech because it plays a pivotal role in reshaping civilization and driving human progress. 𝑻𝒆𝒄𝒉 𝑺𝒕𝒂𝒄𝒌 ➣ LLMs : OpenAI, Google Gemini, Grok ➣ Agent AI : Browser Use ➣ Programming language : Typescript, Java ➣ Scripting language : Python ➣ UI automation : Playwright, Selenium ➣ API automation : Postman, SoapUI, RestAssured ➣ Service virtualisation : Wiremock ➣ Database : SQL, Maria DB, IBM DB2 ➣ Cloud : Salesforce, Azure ➣ Data warehouse : Snowflake ➣ Contract Management : LinkSquare ➣ Cross browser testing : BrowserStack ➣ Performance testing : google lighthouse, artillery ➣ Domains : Retail, Manufacturing, Insurance, Energy, Travel, Observability Technology ➣ Project Management : Agile, Waterfall ➣ Test Management : Jira, QTest, Octane ➣ Other tools : Duckcreek, Guideware, Splunk, Git, bitbucket, Excelegy, EDSN, Apigee, github, Litmus, Figma, Miro, Confluence etc 𝑷𝒆𝒓𝒔𝒐𝒏𝒂𝒍 𝑺𝒊𝒅𝒆 As I reflect on my journey thus far, I recognize that my character is defined by a set of core qualities : antifragility, adaptability, compassion, creativity, diligence, fortitude, proactiveness & unwavering resolve. I have honed my ability to navigate uncertainty through my experiences. Despite being raised in a semi-feudal society, I possess the courage to pursue actions that may invite criticism. 𝑪𝒓𝒆𝒂𝒕𝒊𝒗𝒆 𝑺𝒊𝒅𝒆 ✦ Read my Thoughts at : https://www.yourquote.in/harshavardhan-sivadi-btbpl/quotes ✦ View my Photography at : https://www.instagram.com/harshavardhan_reddy_sivadi/ ✦ Poems : https://poetizer.com/author/69484 ✦ Books : The First Step, Flavors & The Dream Catcher ✦ Twitter : https://twitter.com/harsha_sivadi ✦ Quora : https://www.quora.com/profile/Harshavardhan-Reddy-Sivadi-1 ⦿ My motto : "Technology has the potential to light up even the darkest places of the Earth." ⦿ Enthusiastic about : Algorithms, Artificial Intelligence, Quantum Computing & Nuclear Fission ⦿ Influenced by : Sri Krishna, Dattatreya, Adi Sankaracharya, Ramakrishna paramahamsa, Vishwamitra & Ramana maharshi #BiasForAction . . . #Gravitas . . . #Adaptability . . . #Resolve . . . #Fortitude . . . #Relentless . . . #Antifragility
Bengaluru
antigravity
claude code
claude
github copilot
langsmith
Senior Software Engineer - Frameworks at New Relic, Jul 2025 - Oct 2026 · 1 yr 4 mos, - zuora validation:paywall (soft,hard,no paywall ),dunning process for combinations 0-15 days, 30 days due, 30-60 due, more than 60 days due and its effects on access to platform, notification, account suspension etc, email triggers AGent AI:POC -crew.ai & VS code+playwright MCP+github co-pilot BP executions - validated rollover funds, credits, prepaid funds drawdown, credit drawdown in all possible combinations - (rollover funds+no rollover credits+no prepaid credits+prepaid funds, no rollover funds+ rollover credits+etc) - marketplace type combinations : method 1-reseller(AWS, azure, GCP), method 2 -marketplace etc - commitment invoice, usage invoice, minimum commitments for all products , payments(check, credit card - with due dates : net 15, net 30 ,net 45, net 90), commitment funds drawdown, total consumption amount etc - E2E flow for all possible combinations : netsuite invoice sync, account sync etc, invoice validations PDFs E2E SFDC + BP + Netsuite - validated the above all combinations in end to end flow : sfdc--> BP --> netsuite - validated the features: amend contract, cancel contract(full cancellations, future cancellations, future cancellation at contract end date), Ramp orders(change in billing schedulers:quarterly payment), co-term amendment : (product changes[pro to enterprise,vice-versa,data to data plus,vice-versa),product rerates: change in price with proration combination) - reverse invoice sync, total consumption amount sync from BP to SFDC, - change of account information, address, etc sync from SFDC to BP after the quote is generated and E2E process is complete
Senior Software Engineer - Frameworks at New Relic, Feb 2025 - Jul 2025 · 6 mos, - workato migration : snowflake, boomi, x-ray - validated the boomi integration between snowflake & linksquare for various legal contracts emails - validated data integrity, order of precedence, error management(boomi - email address error, connection error & snowflake - SQL compilation error), scheduled email processing & manual email execution workflows. - validated system logs, events ensuring proper monitoring and tracking of all integration activities. Boomi Integration & SOA(schedule of authority)(SFDC) - coordinated with various stakeholders to solve data discrepancy issues - SOA: users commited & uncommitted floor price validation across various contracts(multiyear) & payment methods - validated the Quotes, single CCID accounts, account hierarchy with all features related to : - buying program(savings, volume, PayG), product combinations(users+data, compute+data, synthetics/additional checks/discounts), regions(US/EU/non-regional), - contract dates (prorated, full month, multi year contract) - various contract types : savings and volume in combinations of various billing frequencies(upfront full prepay, flexi-[quarterly, semi annual, multi year, annual upfront], monthly in arrears - SFDC CPQ PSO : professional service offering for - audit package, quick start package, new relic observablity package - SFDC: 1 normal plan(savings,volume,payG)+PSO plan : with various combinations on normal plan like - payment method: (credit card / check), billing type(in-advance, in-arrears), subscription(new, existing), variuos product SKUs : users(pro,enterprise), compute(pro, enterprise, pro core, enterprise core, pro Olly for all, enterprise Olly for all), billing frequency(annual upfront, upfront for full prepay, monthly in arrears, semi-annual , quarterly) - order processing workflow to support PSO, sync from SFDC - zuora - netsuite, invoices, orders(normal & PSO), order details etc in zuora & netsuite - regression: SFDC CPQ - data integrity in zuora&netsuite
Associate IT Consultant at ITC Infotech, Apr 2023 - Feb 2025 · 1 yr 11 mos, Bengaluru, Karnataka, India · Hybrid, Account : Amadeus Domain : Travel and Tourism Model : Scaled Agile Impact : Project : API lifecycle management & Portal evolution (PAD) • New feature validation • Leveraging LLM and Generative AI solutions to streamline workflows, eliminate bottlenecks, and deliver significant cost and time savings. • Selenium migration to vs code from playwright - integrated github copilot to selenium • Automation migration from Selenium to Playwright - github copilot & prompt engineering • POC & Implementation of LLMs - error analysis, code generation, code optimization, test case design & secure coding practices • POC & Implementation : playwright + browser use(LLM) - no code automation, AI Agent • Parallel testing - new versions of components, gateways etc • Release testing : cryptics, interfaces, logs, applications, companies, documentation, selfservice and enterprise users, ICPs etc • end to end testing, Upgrade testing, redirection testing (ayima redirection extension) • Configuration testing (ACO, 1A ,AIT and DIS users), blog & documentation testing • Extranet Regression testing - playwright automation with Typescript • Intranet Regression testing - selenium automation with Java • design and development of new playwright scripts • Angular migration testing - intranet : documentation, prospects, applications etc • API automation / API testing using RestAssured and postman • Regression validation - API, enterprise users(1A, AIT and DIS), documentation, 3rd party user etc • Automation Script creation, execution, maintenance and peer review in Bitbucket • Test plan creation, maintenance/improving , migration, addition and review in Octane • APIGEE testing & combinatorial testing on portal - UI, API • Database testing MariaDB – administration using HeidiSQL • Test plan migration from Master Test Plan(excel sheets) to Octane • User Advocacy and Process Improvement, feature improvements by collaborating with developers and business analyst • wrote technical documentation
Associate IT Consultant at ITC Infotech, Feb 2022 - Mar 2023 · 1 yr 2 mos, Bengaluru, Karnataka, India · Hybrid, Account : Shell Energy Domain : Energy Model : Agile Impact : helped Shell acquire & maintain 15519 customers in energy market of Netherlands. Implemented automated regression suite for automated deployments, resulting in a early stage identification of bugs, lowering costs & enhancing product quality ❖Module : In-Life / MyAccount • Functional testing of overview, invoices and payments, Usage, account details, login and maintenance pages in MyAccount • Salesforce Testing – community, flexcards, apexclasses, schedulers, flows, email templates, batch mails, omniscripts, reminders, invoices, billing, energy insights & knowledge articles • API automation – postman & Playwright (using Axios library) • UI automation – Playwright with Typescript | POM + keyword driven framework • Visual testing – desktop view, tablet view and mobile view • Migration testing of MyAccount 2.0 • AWS migration testing (IaaS) • Parallel testing, Data Integrity testing • Beta Testing and Production testing • Omnistudio integration procedure testing • Help center – video & image testing • Localization testing(dutch) and cross browser testing(browser stack) • Performance Testing - Google Lighthouse & Artillery • Link rot testing - Dr. Link Check • Compatibility testing - litmus • Test data creation – Salesforce, Excelegy and EDSN(automation) • Upgrade testing of Sandbox & Vlocity and salesforce • Data integrity & database testing • Risk based testing (data driven decisions) • Checking logs with new relic • Testing Renewal & Upgrade • Collaborated with diverse team across 3 locations. • User Advocacy and Process Improvement, feature improvements with PO ❖Module : Acquisition & Onboarding • Functional Testing of Acquisition & Onboarding : Switch, Move Journeys & Artemis, SVG • Salesforce Testing – email, orders, offers, products, meters & contracts • Risk based testing SVG ❖Module : Agent • Salesforce testing – acquisition, leave, move, renewal and contract switch journeys : Agent console
Senior Software Engineer - Testing at ValueMomentum, Aug 2021 - Feb 2022 · 7 mos, Hyderabad, Telangana, India, ❖ Account : GEICO Domain : Financial Services - Insurance Model : Agile Impact : Reduced UAT testing time by 50% using UI automation and 75% using API automation across cutting edge Test plans. Demonstrated excellent multitasking skills by handling the workload of 3 automation resources across 3 teams. Responsibilities: • Validations on Policy transactions, Forms, PHIN, Splunk • UI automation and API automation of various test plans - Selenium and RestAssured • Parameterization and maintenance of test scripts, behavior driven development (BDD) testing • Validations of coverages, premium, discount, credit score, prefill data, back navigation, invoices etc • Regression testing of features across 50 states in US • Validation of Rated Logs, Steps and Dumps • Reporting bugs and retesting • End to End testing and UAT testing • Batch testing via Azure runs • validating claims on Guideware claims center • checking logs by using splunk • Completed training's and assignments on Claims, Billing, Rating, Underwriting, Sales, Edge and ETM Automation which are based on Duckcreek, Guideware, Selenium and RestAssured.
Project Engineer at Wipro, Mar 2021 - Aug 2021 · 6 mos, Hyderabad, Telangana, India, ❖ Account : RSA Insurance Group Domain : Financial Services Model : Agile Impact : UAT of UK government accessibility insurance project ensuring it met government regulations within 4 weeks timeframe Responsibilities: • Mainframe Integration testing & batch testing • Functional testing of application flow - insurance domain • Raising bugs and retesting ❖ Practice : Cloud and Integration Testing practice, Wipro Digital Team : Consulting and Presales Impact : Transformed clients testing process to API centric & helped Wipro Digital in acquiring 1 billion dollar deal (Cigna) & 3 multimillion dollar deals (Island resort in Maldives, Mastercard and Emirates NBD) Responsibilities : • API testing / API automation - Postman, SoapUI & RestAssured • Service Virtualization - Wiremock • Handling RFP’s of multi million dollar and Billion dollar projects in SOA , Cloud Assurance and Mainframe • Handling estimations / RLS for respective projects Operations support • Semi automation of business process • Training people in API testing and API automation under Wipro Digital
Project Engineer at Wipro, Jun 2019 - Feb 2021 · 1 yr 9 mos, Hyderabad, Telangana, India, ❖ Account : Honda Domain : Manufacturing Project : Refactoring Model : Agile Impact : Intuitive next gen Honda supply chain website for enterprise users Responsibilities: • Requirement analysis • Confluence and Jira - User stories, bugs and documentation • Designing : Test cases, Test plans, Test strategy, Test driven development, Requirement Traceability Matrix • Boundary value analysis and Equivalence partitioning • Decision table testing, Exploratory testing • System Integration Testing (SIT), Functional Testing, User acceptance testing (UAT) • Webservices testing, Usability Testing • Data integrity testing, Interface testing • Test Automation - Selenium with Java • version management - Git • Proactive Testing to find Latent Defects & Uncover fault masking • Database Testing, Interface Testing & Test Data preparation in QMF database - SQL • User Advocacy, Process Improvement and feature improvement by collaborating with scrum master, business analyst and developers
Project Engineer at Wipro, Mar 2017 - May 2019 · 2 yrs 3 mos, Chennai, Tamil Nadu, India, ❖ Account : Kohls Domain : Retail Project : Mainframe refactoring Model : Waterfall Impact : Reduced mainframe cost from 400 million dollars to 60 million dollars by migrating 126 applications across domains Responsibilities: • Requirement analysis, Requirement Traceability Matrix (RTM), Boundary value analysis • Test case migration from HP ALM to QTest • Extracting Data from Source library in Mainframes for CICS navigation • Test management - QTest, JIRA • Test data preparation & test data management - IBM DB2 using SQL • Running JCL Jobs, validating FTP & MFT transfers - Mainframe • RACF : Classification of all the transactions according to their respective Domains Testing of Positive, Negative, Exception Scenarios & maintaining the record of screenshots (destination screens) • Cross checking combinations of RACF TC's by comparing parameters like Universal access, Exception Access & TKID access. • Matching all the user groups with every User IDs in Kohls. • Finding the transactions associated with Mnemonics for positive , negative & exception scenarios in RACF. • System Integration Testing (SIT), Smoke testing, Stress Testing, User acceptance Testing (UAT) • Browser compatibility Testing, Mobile testing, Monkey Testing • Regression Testing, Baseline Testing, Stress Testing • Concurrency testing & Reliability Testing • Used VMware virtual machine
PG Diploma in Natural Language Processing (Artificial Intelligence), Annamalai university
Bachelor of Technology (B.Tech), Electrical and Electronics Engineering, JNTU Anantapur