Headline

Data @ PW | Ex-Amazon

About

I am a software engineer with deep experience in building scalable data platforms and streaming systems, with a proven record of reducing costs, improving efficiency, and delivering measurable results through data-driven solutions. In my current role as a Data Platform Engineer at PhysicsWallah, I own the ingestion platform, data security, and data governance end to end. The ingestion platform streams change data from over 1,000 MongoDB and RDS collections into an Apache Iceberg lakehouse, served through Trino and transformed with Spark. By architecting and deploying a Kafka Connect based solution with in-house schema evolution over schemaless sources, I reduced aggregate ingestion costs by up to 70% annually while ensuring accurate, reliable data for stakeholders. I also drive AI integrations across the platform, including a self-serve onboarding MCP, and own governance covering PII handling, compliance, and end-to-end lineage from source through to the BI layer. Previously, I spent close to four years at Amazon in the physical stores organization, where I built frameworks establishing critical data contracts and APIs for cross-functional services, developed Spark and Glue pipelines, migrated a core database onto a Redshift warehouse serving 30+ teams, and shipped self-service tooling that let teams deploy their own pipelines independently. My automation initiatives cut camera planning effort from 168 to 36 hours per store. Before Amazon, I founded and ran Avior Automation, an industrial automation company. I hold 6+ years of experience across data engineering and platform work, and I enjoy mentoring engineers and helping them grow. Always happy to trade notes and exchange ideas.

Location

Greater Bengaluru Area

AI stack

claude code

claude

cursor

mcp

notebooklm

obsidian

Work experience

SDE III - Data Platforms at PW (PhysicsWallah), Aug 2025 - Present · 1 yr 1 mo, Bengaluru, Karnataka, India

Senior Data Engineer at Annalect, Mar 2025 - Jul 2025 · 5 mos, Bengaluru

Software Engineer at Amazon Web Services (AWS), Apr 2021 - Jan 2025 · 3 yrs 10 mos, Bengaluru, Karnataka, India

Founder at Avior Automation, Oct 2019 - Mar 2021 · 1 yr 6 mos

Education

Bachelor of Technology, Computer Science Engineering, sharda university