Rachit Gupta profile photo 1 on Tal

Rachit Gupta

Building in stealth | Ex-Amazon, Microsoft, PhonePe | Data Engineering Expert | Architecting Scalable Data Platforms

Mumbai
Hiring

Senior Backend Engineer

Stealth AI Startup

Stealth AI Startup logo

I'm hiring for Engineering. I am looking for a Senior Backend Engineer to build robust AI infrastructure.

Bengaluru

₹11–60 LPA

CTC

1–8 years

Exp

About Rachit

Stealth AI Startup
Sep 20241 yr 1 moSep 2025

Mumbai, Maharashtra, India

Prodigal
Sep 202311 mosJul 2024

Mumbai, Maharashtra, India

As a Tech Lead at Prodigal, I spearheaded the development and scaling of a robust data platform. Leveraging Airflow and Databricks, I architected and implemented efficient data ingestion pipelines for CSV and SQL backup sources. To streamline data management, I introduced medallion architecture and employed DBT for efficient data transformations, ensuring a single model per destination and near real-time updates from multiple sources. I fostered strong cross-functional collaboration to align data initiatives with broader business goals. By implementing agile methodologies, including sprint planning, retrospectives, and performance reviews, I successfully led the team in delivering high-quality data products. My experience in hiring and onboarding new engineers further strengthened the team's capabilities.
PhonePe
Sep 202211 mosJul 2023

Bengaluru, Karnataka, India

As a key contributor to PhonePe's payments platform, I was worked on handling the massive scale of 150 million daily UPI transactions. I focused on performance optimization and implemented caching mechanisms and improved business rule computations, significantly enhancing transaction processing latency and CPU usage. Recognizing the limitations of the MySQL database for storing transaction metadata, I executed a migration to Aerospike, resulting in a substantial cost reduction of $1 million annually. Beyond technical execution, I actively participated in architectural decision-making, code reviews, and sprint planning.
Microsoft
Aug 20202 yrs 2 mosSep 2022

Developed and managed a high-performance logging framework for a Microsoft email platform processing over 80 million emails daily, generating 2TB of log data. Optimized data extraction and consolidation pipelines to support downstream teams in deriving actionable insights. Collaborated closely with product and engineering teams to enhance email performance and user experience based on metrics such as time spent, link clicks, and card adoption. Led scrum and sprint planning, demonstrating strong technical and leadership skills.
Amazon
Nov 20163 yrs 9 mosJul 2020

Bengaluru, Karnataka, India

I am part of the transportation team that takes care of auditing, payment and accounting for deliveries made by 3rd party carriers like DHL, FEDEX, USPS in the US and Europe. Our team works on developing systems handling the following responsibilities 1. Process Invoice sent by carriers converting them to entities that can be audited and paid 2. Maintain a repository of charges that can be audited and accounted for. 3. Interact with planning systems to get details about liabilities to be closed against invoices We operate on a scale of over 10 million invoice units on a daily basis with SLA ranging from few minutes to a couple of hours. I have been involved in leading a small team to scale the system to handle loads in excess of 50 million, connecting with services interested in invoice data, launching the service in additional geographies. Additional responsibilities include reducing the operational load, re-architecture of existing components, decprecation of old systems, migration to non-relational databases

Education

Indian Institute of Technology, Bombay

Master's degree, Computer Engineering

Indian Institute of Technology, Bombay

20075 yrs2012

Bishop Cotton School, Nagpur

199510 yrs2005

Join Rachit and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss
TAL BY GRAPEVINE
Message Rachit

Rachit Gupta on Tal

Headline

Building in stealth | Ex-Amazon, Microsoft, PhonePe | Data Engineering Expert | Architecting Scalable Data Platforms

About

Accomplished Manager with 12+ years of experience, including the last 4 years in leadership roles. At Prodigal, I led and scaled a team to architect and implement a robust data platform, optimizing ingestion and processing with technologies like Airflow, Databricks, and AWS. I’ve managed cross-functional projects and long-running initiatives, ensuring timely and successful product launches. My experience includes conducting sprint planning and scrum, setting up efficient processes for on-call duties, code reviews and design discussions. At PhonePe, as part of the Payments team handling the UPI transactions of scale 150 million per day. I drove infrastructure improvements reducing server costs by over $1M. My tenure at Microsoft and Amazon involved developing scalable solutions, including ML-powered services and robust log monitoring frameworks, supporting millions of daily requests. I am adept at managing team performance, conducting 1:1s, and providing constructive feedback to foster growth and innovation. I thrive in collaborative environments, working closely with product and business stakeholders to define roadmaps and allocate resources effectively. My proven ability to manage and grow engineering teams, coupled with my expertise in cloud technologies and big data ecosystems, positions me to drive impactful data product strategies. Seeking leadership roles to further leverage my skills and experience in data engineering.

Location

Mumbai

Work experience

Co-Founder at Stealth AI Startup, Sep 2024 - Sep 2025 · 1 yr 1 mo, Mumbai, Maharashtra, India

Engineering Manager - Platform Team at Prodigal, Sep 2023 - Jul 2024 · 11 mos, Mumbai, Maharashtra, India, As a Tech Lead at Prodigal, I spearheaded the development and scaling of a robust data platform. Leveraging Airflow and Databricks, I architected and implemented efficient data ingestion pipelines for CSV and SQL backup sources. To streamline data management, I introduced medallion architecture and employed DBT for efficient data transformations, ensuring a single model per destination and near real-time updates from multiple sources. I fostered strong cross-functional collaboration to align data initiatives with broader business goals. By implementing agile methodologies, including sprint planning, retrospectives, and performance reviews, I successfully led the team in delivering high-quality data products. My experience in hiring and onboarding new engineers further strengthened the team's capabilities.

Lead Software Engineer - Payments at PhonePe, Sep 2022 - Jul 2023 · 11 mos, Bengaluru, Karnataka, India, As a key contributor to PhonePe's payments platform, I was worked on handling the massive scale of 150 million daily UPI transactions. I focused on performance optimization and implemented caching mechanisms and improved business rule computations, significantly enhancing transaction processing latency and CPU usage. Recognizing the limitations of the MySQL database for storing transaction metadata, I executed a migration to Aerospike, resulting in a substantial cost reduction of $1 million annually. Beyond technical execution, I actively participated in architectural decision-making, code reviews, and sprint planning.

Senior Software Engineer at Microsoft, Aug 2020 - Sep 2022 · 2 yrs 2 mos, Developed and managed a high-performance logging framework for a Microsoft email platform processing over 80 million emails daily, generating 2TB of log data. Optimized data extraction and consolidation pipelines to support downstream teams in deriving actionable insights. Collaborated closely with product and engineering teams to enhance email performance and user experience based on metrics such as time spent, link clicks, and card adoption. Led scrum and sprint planning, demonstrating strong technical and leadership skills.

SDE 2 at Amazon, Nov 2016 - Jul 2020 · 3 yrs 9 mos, Bengaluru, Karnataka, India, I am part of the transportation team that takes care of auditing, payment and accounting for deliveries made by 3rd party carriers like DHL, FEDEX, USPS in the US and Europe. Our team works on developing systems handling the following responsibilities 1. Process Invoice sent by carriers converting them to entities that can be audited and paid 2. Maintain a repository of charges that can be audited and accounted for. 3. Interact with planning systems to get details about liabilities to be closed against invoices We operate on a scale of over 10 million invoice units on a daily basis with SLA ranging from few minutes to a couple of hours. I have been involved in leading a small team to scale the system to handle loads in excess of 50 million, connecting with services interested in invoice data, launching the service in additional geographies. Additional responsibilities include reducing the operational load, re-architecture of existing components, decprecation of old systems, migration to non-relational databases

Education

Master's degree, Computer Engineering, Indian Institute of Technology, Bombay

Bishop Cotton School, Nagpur

Rachit Gupta - Co-Founder in Mumbai | Tal