About
I design data systems that work at the scale where most architectures break. At Adobe, I own data platform architecture across two products in the Digital Experience org: ▪ Adobe Learning Manager (ALM) — Architected a petabyte-scale Lakehouse serving 1000+ enterprise customers where data freshness is a core product SLA. Designed a near real-time CDC pipeline ingesting 1000s of tables from PostgreSQL, MariaDB, and MySQL using Debezium, Kafka, and Apicurio Schema Registry into Medallion architecture on Delta Lake. Built a high-concurrency query engine on Trino/EKS/HPA achieving sub-5s latency at 800+ concurrent RPS — powering an in-house BI tool, Custom Report Builder, and a GenAI Data Insights Agent for plain English querying over petabyte-scale data. Delivered 70% cost reduction — $200K to $60K/month. ▪ Adobe DSP (Demand Side Platform) — Architected core data infrastructure supporting 400B+ RTB bid requests/day at sub-second latency. Delivered a production ML platform deploying 300+ models for bid price calculation — adopting Metaflow integrated with MLflow for experiment tracking and model governance, improving ML engineer productivity. Designed end-to-end Multi-Touch Attribution pipeline across Search, Social & Commerce ingesting from Google, Microsoft, and Yahoo Japan. Extended the platform with a DSP GenAI Data Insights Agent — low-latency Gold schemas enabling natural language querying delivering results in seconds vs minutes. Over 17 years delivering enterprise-scale data platforms across AdTech, Media, BFSI, and Retail. My philosophy: Architecture must serve the business. Every system I design is built to be fast, reliable, cost-efficient, and ready to scale before the business needs it to. What I do best: ▪ Distributed Lakehouse Architecture at Petabyte Scale ▪ Real-Time CDC & Streaming Pipelines ▪ ML Platforms · MLOps · GenAI Agent Development ▪ High-Concurrency Query Engine Design ▪ Cost-Efficient Infrastructure Redesign ▪ Data Governance · Compliance · Schema Management ▪ Engineering Leadership · Mentoring · Team Grooming
Work experience
Senior Data & AI Architect at Adobe, Mar 2025 - Present · 1 yr 8 mos, Bengaluru, Karnataka, India
ML & Data Engineering Leader/Architect at Amazon, Aug 2024 - Feb 2025 · 7 mos, Bengaluru, Karnataka, India
Data Engineering Leader/Architect at Amagi, Jun 2023 - Jun 2024 · 1 yr 1 mo, Bengaluru, Karnataka, India, Led data engineering and architecture for a self-serve cloud-agnostic content viewership and ad analytics platform for TV and OTT customers at petabyte scale. - Reduced cloud compute cost from $2,500 to $300 per month (88% reduction) through platform optimization and right-sizing. - Implemented Medallion architecture with Delta Lake for ACID compliance, delayed event handling, and data reconciliation across batch and streaming pipelines. - Snowflake ELT using DBT with advanced Jinja templating. Dynamic Airflow DAG creation using DagBag and Jinja for pipeline orchestration. - Implemented GDPR compliance via fine-grain data access control and tag-based dynamic masking policies on Snowflake. - Led and mentored a team of 4 Data Engineers — driving engineering standards, code quality and delivery velocity.
Lead Data Engineer at Amazon, Jun 2022 - Jun 2023 · 1 yr 1 mo, Bengaluru, Karnataka, India
Lead Data Engineer at Visa, Mar 2021 - May 2022 · 1 yr 3 mos, Bangalore Urban, Karnataka, India
Education
Bachelor of Technology - BTech, Electronics and Telecommunications Engineering, Biju Patnaik University of Technology, Odisha
12th, Physical Sciences, Council of Higher Secondary Education
