Headline

Senior Software Engineer (SDE 3) | Distributed Systems Architect | 1M+ RPM & 10TB+ Scale | Java • Python • Kafka • ClickHouse • Apache Iceberg

About

Senior Software Development Engineer (SDE 3) | 1M+ RPM & 10+ TB Scale I architect high-performance backend systems and data lakehouses that handle massive scale (1M+ RPM & 10+ TB). Currently at BrightEdge (Ex-Shiprocket), I specialize in building distributed services and real-time pipelines that prioritize both technical elegance and cost-efficiency. Core Technical Impact: - Scale & Performance: Engineered microservices handling 1M+ RPM and optimized ClickHouse queries over 10+ TB datasets to meet a strict 5-second SLA. - Data Architecture: Architected a Data Lakehouse (Apache Iceberg/ClickHouse) that reduced ETL costs by 40%and accelerated data availability by 3x. - Reliability & Security: Built custom Kafka deduplication and rate-limiting engines to ensure 99.9% system stability during peak loads. - Cost Optimization: Reduced cloud infrastructure spend by 40% through strategic migrations to distributed SQL engines and resource tuning. The Engineering Mindset: I am a language-agnostic architect (Java, Python, Go) who believes technical excellence is a means to solve business problems. I am a proponent of AI-augmented development (leveraging tools like Claude Code) to ship higher-quality code faster. Current Research: Deep-diving into Agentic AI and RAG architectures to understand the next evolution of distributed systems. Tech Stack: Java, Python, Kafka, ClickHouse, Apache Iceberg, Spring Boot, Distributed Systems, Microservices architecture, Cloud Infrastructure.

Location

Bengaluru

AI stack

claude code

claude

cursor

gemini

notebooklm

openai

Work experience

Senior Software Engineer at BrightEdge, Oct 2025 - Present · 11 mos, - Architected a Data Lakehouse foundation using Apache Iceberg and Clickhouse, reducing ETL pipelines cost by 40% and accelerating data availability for analytics by 3x. - Led the end-to-end development of the Keyword Reporting backend, building high-performance REST APIs that query 10+ TB of data in ClickHouse with SLA of 5-second. - Implemented Trino and Clickhouse as a distributed SQL engine to query heterogeneous datasources, significantly reducing ad-hoc analytical latency compared to legacy MariaDB systems. - Designed a robust Data Collection Framework (Python, Redis) that reduced keyword dataingestion time from 4 to 2 days while maintaining >95% reliability. - Optimized cloud infrastructure costs by 40% through the migration of analytical workloads from MariaDB to ClickHouse.

SDE 2 at BrightEdge, Sep 2024 - Nov 2025 · 1 yr 3 mos, United States, - Led ETL pipeline development (Python, Redis) to process 100+ TB/week, transforming raw CSVs to Parquet on GCS for fast ClickHouse querying. - Migrated from MariaDB to ClickHouse, improving API response times by 60% and reducing cloud costs by 40%. - Reducing keyword related data collection time from 4 to 2 days, and implemented robust cleaning and deduplication logic to ensure >95% data reliability across the platform.

Software Development Engineer - 2 at Omuni, Jun 2023 - Sep 2024 · 1 yr 4 mos, Bengaluru, Karnataka, India, - Developed software solutions using Java, Spring Boot, Kafka, and AWS, demonstrating proficiency in modern development tools. - Engineered a reconciliation product optimizing order and payment processes, utilized by 5 Brands. - Played an integral role in designing a trend analysis product for data-driven decisions by Brands. - Developing an algorithm for optimal store selection in order fulfillment, handling 200,000 daily API hits with <1000ms response time. - Achieved 95% accuracy in order/payment reconciliation and 80% accuracy in trend prediction/store selection. - Implemented custom Kafka features: delayed consumption, message prioritization, and rate-limiting. - Implemented Redis-based deduplication for efficient, real-time inventory updates, eliminating Kafka duplicates.

Software Development Engineer - 1 at Omuni, Jan 2021 - Jun 2023 · 2 yrs 6 mos, Bangalore Urban, Karnataka, India, - Designs applications for omnichannel retail Platforms using the spring boot framework. - Integrated OMUNI products with eCommerce platforms like Magento and Shopify. - Developed and Worked on B2B projects that help top brands like Bata, Bestseller, and many others to integrate with OMUNI platform for Order, Inventory, and Logistic Management Systems. - Actively working on developing standard and scalable APIs for seamless communication using Java Spring boot.

Software Development at Omuni, Jul 2020 - Dec 2020 · 6 mos, Bangalore Urban, Karnataka, India, - Designed and developed optimized and almost real-time auto exception report generators for various microservices using Spring boot. - Implemented auditing of any kind of data using ELK stack to reduce overhead cost on MySQL database. - Build a recommendation engine, which does size recommendations to users based on past orders. - Developed a JSON MAPPER UI that edits Json and can also convert JSON to FTL file.

Education

Bachelor of Engineering - BE, Telecommunications Engineering, Siddaganga Institute of Technology

High School Diploma, Geethanjali All India Senior Secondary School

Public links

github: https://github.com/udhavmohata

medium: https://medium.com/@udhavmohata

leetcode: https://leetcode.com/udhavmohata