Gaurang Jain profile photo 1 on Tal

Gaurang Jain

Software Development Engineer @ AWS | Backend, Distributed Systems & GenAI Platforms | Java, Python, AWS CDK, Kafka, Spark | ex-Razorpay, ex-Meesho | IIIT-J

India

3+ years of work experience

Amazon
Apr 20251 y 4 moPresent

On-site

Building backend systems for Amazon Quick GenAI — Amazon's enterprise GenAI platform serving thousands of internal teams. • Architected a decoupled integration test pipeline that cut test execution time from 2+ hours to <10 minutes, unblocking faster release cadence for the team • Designed and implemented static throttling for control-plane Lambdas using AWS CDK, enforcing per-product and per-API rate limits and preventing noisy-neighbor issues at the platform layer • Reverse-engineered undocumented internal services to expand test coverage on scheduled connector workflows, eliminating a key reliability gap • Diagnosed and patched a critical NullPointerException in the UpdateDataSource API with defensive null-safety validation, preventing a customer-facing outage • Automated cleanup of stuck data-source syncs via Python tooling, removing recurring manual operational toil for on-call engineers Tech: Java, Python, AWS (Lambda, CDK, DynamoDB, S3), CloudFormation
Razorpay
Oct 20247 mosApr 2025

Shipped data products powering merchant analytics and real-time data sharing at fintech scale. • Built an in-house querying & reporting platform replacing Looker, cutting BI tooling spend significantly while serving analysts and risk teams with native merchant-data reports • Designed a metadata ingestion pipeline for DataHub on Airflow + KubernetesPodOperator — established data observability, cataloging, and governance across the org • Architected the Realtime DataSync flow: Debezium CDC → MSK Kafka, delivering streaming merchant data with <2-second end-to-end lag • Implemented AES encryption (Scala) for sensitive payment data in Realtime DataSync, enabling compliant data-sharing with merchants • Owned data shares on Snowflake & Redshift for the DataSync product, optimizing transformation and synchronization for payment & transaction data • Integrated Celery workers behind an API to trigger metadata-ingestion scripts, optimizing task scheduling under bursty load Tech: Scala, Python, Kafka (MSK), Debezium, Snowflake, Redshift, Airflow, Kubernetes, DataHub
Meesho
Mar 20247 mosSep 2024

Bangalore Urban, Karnataka, India

• Designed and shipped a Data Cataloging service automating metadata ingestion to DataHub — eliminated manual lineage publishing entirely • Built APIs serving upstream/downstream lineage at column- and dataset-level from DataHub, used by data engineers across teams • Developed a SQLGlot-based parser to extract partition filters, tables, and columns from real-time SQL queries • Shipped FailFast instrumentation that aborts inefficient queries pre-execution by analyzing partition data — reduced server load by 40% • Built a Trino event-listener ETL on PySpark to surface user query-access patterns from Metabase & Zeppelin — cut analyst investigation time by 25% • Drove IPO-readiness data-security work: configured governance groups to lock down access to confidential columns • Built a Text-to-SQL service (FastAPI + LangChain) letting business analysts query L0 metrics from Slack Tech: Python, PySpark, Trino, FastAPI, LangChain, DataHub, SQLGlot
GKM IT
Jan 20243 mosMar 2024

Udaipur, Rajasthan, India

- Led the implementation of an ETL pipeline to organize and store food nutrient data from CSV files. - Developed Python scripts for scraping recipes to enrich the data repository. - Spearheaded the development of a ChatBot using Langchain technology, integrating OpenAI models for improved communication and efficiency within the team. - Utilized FAISS-based embedding techniques for optimized data retrieval and analysis. - Leveraged SQL Toolkits and Agents from Langchain to enhance data processing capabilities. - Applied prompt engineering techniques to create effective prompts for various data-related tasks and interactions.
May 20236 mosOct 2023

Remote

• Developed a stock price prediction app using OpenAI , achieving a 20% accuracy improvement . • Enhanced security with Google OAuth2.0 , reducing security incidents by 30% in 6 months . • Deployed the app using AWS EC2, Route53, S3, CloudFront , improving page load times by 25% . • Established a CI/CD pipeline using Github Actions & CodeDeploy , reducing deployment time by 50% . • Implemented Jenkins automation jobs to swiftly revert failed deployments to minimize downtime. Backend : Flask , Python Frontend : React.Js

Gaurang’s AI Stack

claude code
claude code
claude
claude
kiro
kiro
langchain
langchain
openai
openai
openclaw
openclaw

Education

Indian Institute of Information Technology, Design and Manufacturing, Jabalpur

Bachelor of Technology, Computer Engineering

Indian Institute of Information Technology, Design and Manufacturing, Jabalpur

12th, PCM

MDS Sr. Sec. School

Join Gaurang and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Gaurang Jain on Tal

Headline

Software Development Engineer @ AWS | Backend, Distributed Systems & GenAI Platforms | Java, Python, AWS CDK, Kafka, Spark | ex-Razorpay, ex-Meesho | IIIT-J

About

Software Development Engineer at AWS, building the Quick GenAI platform — Amazon's enterprise GenAI offering. I design and ship backend systems that serve LLM-powered workflows at scale. What I do: → Backend & Distributed Systems: Java, Python, AWS Lambda, DynamoDB, Kafka, Spark → Infrastructure as Code: AWS CDK, CloudFormation, control-plane services → Data Platforms: ETL pipelines, real-time CDC, metadata cataloging, data lineage (DataHub), data lakes (Snowflake, Redshift) → AI/ML Integration: LLM applications, LangChain, RAG, FastAPI services Recent impact: • Cut integration test cycle from 2+ hours to minutes via decoupled test pipeline • Implemented static throttling on control-plane Lambdas using AWS CDK • Built real-time data sync with <2s lag using Debezium CDC + MSK Kafka • Shipped DataHub metadata ingestion pipeline (Airflow + KubernetesPodOperator) • Reduced server load 40% with SQL FailFast instrumentation using SQLGlot Background: B.Tech in Computer Engineering from IIITDM Jabalpur. Previously shipped data products at Razorpay (DataSync, real-time CDC) and Meesho (Data Catalog, lineage APIs, Text-to-SQL). Open to connecting on: backend engineering, distributed systems, GenAI infrastructure, data platforms. Stack: Java • Python • Scala • AWS (Lambda, CDK, DynamoDB, S3, EC2, MSK) • Kafka • Spark • Airflow • Snowflake • Redshift • DataHub • FastAPI • LangChain • Kubernetes • Debezium 📩 jain.gaurang2001@gmail.com

Location

India

AI stack

claude code

claude

kiro

langchain

openai

openclaw

Work experience

Software Development Engineer at Amazon, Apr 2025 - Present · 1 y 4 mo, On-site, Building backend systems for Amazon Quick GenAI — Amazon's enterprise GenAI platform serving thousands of internal teams. • Architected a decoupled integration test pipeline that cut test execution time from 2+ hours to <10 minutes, unblocking faster release cadence for the team • Designed and implemented static throttling for control-plane Lambdas using AWS CDK, enforcing per-product and per-API rate limits and preventing noisy-neighbor issues at the platform layer • Reverse-engineered undocumented internal services to expand test coverage on scheduled connector workflows, eliminating a key reliability gap • Diagnosed and patched a critical NullPointerException in the UpdateDataSource API with defensive null-safety validation, preventing a customer-facing outage • Automated cleanup of stuck data-source syncs via Python tooling, removing recurring manual operational toil for on-call engineers Tech: Java, Python, AWS (Lambda, CDK, DynamoDB, S3), CloudFormation

SDE at Razorpay, Oct 2024 - Apr 2025 · 7 mos, Shipped data products powering merchant analytics and real-time data sharing at fintech scale. • Built an in-house querying & reporting platform replacing Looker, cutting BI tooling spend significantly while serving analysts and risk teams with native merchant-data reports • Designed a metadata ingestion pipeline for DataHub on Airflow + KubernetesPodOperator — established data observability, cataloging, and governance across the org • Architected the Realtime DataSync flow: Debezium CDC → MSK Kafka, delivering streaming merchant data with <2-second end-to-end lag • Implemented AES encryption (Scala) for sensitive payment data in Realtime DataSync, enabling compliant data-sharing with merchants • Owned data shares on Snowflake & Redshift for the DataSync product, optimizing transformation and synchronization for payment & transaction data • Integrated Celery workers behind an API to trigger metadata-ingestion scripts, optimizing task scheduling under bursty load Tech: Scala, Python, Kafka (MSK), Debezium, Snowflake, Redshift, Airflow, Kubernetes, DataHub

SDE Intern(Data Platform) at Meesho, Mar 2024 - Sep 2024 · 7 mos, Bangalore Urban, Karnataka, India, • Designed and shipped a Data Cataloging service automating metadata ingestion to DataHub — eliminated manual lineage publishing entirely • Built APIs serving upstream/downstream lineage at column- and dataset-level from DataHub, used by data engineers across teams • Developed a SQLGlot-based parser to extract partition filters, tables, and columns from real-time SQL queries • Shipped FailFast instrumentation that aborts inefficient queries pre-execution by analyzing partition data — reduced server load by 40% • Built a Trino event-listener ETL on PySpark to surface user query-access patterns from Metabase & Zeppelin — cut analyst investigation time by 25% • Drove IPO-readiness data-security work: configured governance groups to lock down access to confidential columns • Built a Text-to-SQL service (FastAPI + LangChain) letting business analysts query L0 metrics from Slack Tech: Python, PySpark, Trino, FastAPI, LangChain, DataHub, SQLGlot

Data Science Intern at GKM IT, Jan 2024 - Mar 2024 · 3 mos, Udaipur, Rajasthan, India, - Led the implementation of an ETL pipeline to organize and store food nutrient data from CSV files. - Developed Python scripts for scraping recipes to enrich the data repository. - Spearheaded the development of a ChatBot using Langchain technology, integrating OpenAI models for improved communication and efficiency within the team. - Utilized FAISS-based embedding techniques for optimized data retrieval and analysis. - Leveraged SQL Toolkits and Agents from Langchain to enhance data processing capabilities. - Applied prompt engineering techniques to create effective prompts for various data-related tasks and interactions.

Software Engineer(0-->1) at Novaris.Ai, May 2023 - Oct 2023 · 6 mos, Remote, • Developed a stock price prediction app using OpenAI , achieving a 20% accuracy improvement . • Enhanced security with Google OAuth2.0 , reducing security incidents by 30% in 6 months . • Deployed the app using AWS EC2, Route53, S3, CloudFront , improving page load times by 25% . • Established a CI/CD pipeline using Github Actions & CodeDeploy , reducing deployment time by 50% . • Implemented Jenkins automation jobs to swiftly revert failed deployments to minimize downtime. Backend : Flask , Python Frontend : React.Js

Education

Bachelor of Technology, Computer Engineering, Indian Institute of Information Technology, Design and Manufacturing, Jabalpur

12th, PCM, MDS Sr. Sec. School

Public links

github: https://github.com/gjboxer