Building Distributed Systems & Reliable Infrastructure @ Harvey | Ex - Databricks


Bengaluru, Karnataka, India

Gurugram, Haryana, India

Gurugram, Haryana, India

New Delhi, Delhi, India




Bachelor's degree, Computer Engineering
Delhi College of Engineering
Intermediate Degree, Science with C++
MDH International School
Join Shubham and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossBuilding Distributed Systems & Reliable Infrastructure @ Harvey | Ex - Databricks
I am usually more interested in how systems fail than how they work, that’s where most of the engineering is. Senior platform engineer with 5 years building distributed systems and control planes. Founding engineer of Oxide at Databricks, where I worked on database lifecycle management, durability, and authorization systems across 1000s of resources in 50+ regions. Ex-Sprinklr.
Delhi
antigravity
codex
cursor
Member of Technical Staff at Harvey, Jul 2026 - Present · 2 mos
Software Engineer II at Databricks, Dec 2023 - Jun 2026 · 2 yrs 7 mos, Bengaluru, Karnataka, India, • Founding engineer of Oxide, Databricks’ control plane for database lifecycle management (provisioning, scaling, backup, restore, migration). Led design and development of core systems including Temporal-based workflow orchestration, distributed tracing, and a policy-based authorization system (RBAC + ABAC) — enabling self-serve operations across 1000s of resources in 50+ regions for 10+ teams. • Served as a DRI for Storage Durability across TiDB and MySQL. Designed a unified KPI framework (RPO, RTO, backup compliance), automated restore validation pipelines across hundreds of databases, and drove data-driven SLOs that moved durability posture from 70% to consistently green with zero customer-visible data loss incidents. • Envisioned and buit the Oxide Admin Console (Azure Database Portal equivalent for Databricks) from zero — defined the north star vision, prioritized CUJs, drove cross-team alignment and adoption; consolidated 5+ fragmented tools into a single production critical ops UI, reducing debugging time from ∼ 45 minutes to less than 5 minutes. • Won multiple internal hackathons (including Judges’ Choice, FY Q3 2025), with solutions adopted by 500+ engineers.
Senior Product Engineer at Sprinklr, Jul 2023 - Dec 2023 · 6 mos, Gurugram, Haryana, India, • Leading and spearheading two significant projects: Media Monitoring Analytics, facilitating brand analysis from news, blogs, and print sources, and Sprinklr Newsletters, helping PR and communication teams to share messages, top news and insights across team members. • Actively engaged in supervising engineers, designing architectures, code reviews, & mentoring interns.
Product Engineer at Sprinklr, Jun 2021 - Jul 2023 · 2 yrs 2 mos, Gurugram, Haryana, India, • Owned 3 major products in Research Team - Media Monitoring Analytics, Sprinklr Newsletters, and Manual article ingestion. Played a key role in designing, implementing, and improving them for various business-critical applications. Also simplified integration for Restricted messaging channels like Dow Jones Factiva. • Worked on over 150 tasks, including adding features, solving bugs & issues and added patches on existing elasticsearch-core, elasticsearch-plugins & lucene-core jars. • Added caching strategy for an Elasticsearch cluster and optimized queries, resulting in search results that were 64% faster and a 22% reduction in server load. • Proficient in On-call support, debugging slowness, lags & high-loads. • Revamped architecture for long-running platform tasks, achieving a ∼0% failure rate by implementing various distributed system concepts such as heartbeats.
Product Engineering Intern at Sprinklr, May 2020 - Jun 2020 · 2 mos, New Delhi, Delhi, India, • Deployed a JSON MockServer for the front end team with support for persistence, schema checks, and regular expressions in URL, configured with a Slackbot. Written over 3500+ lines of code from start, with a beautiful Technical document. • Shipped a Shareable Link Preview Generator with a Chrome Extension to make any link shareable with previews in them to display, when shared across any social media channel.
Bachelor's degree, Computer Engineering, Delhi College of Engineering
Intermediate Degree, Science with C++, MDH International School
github: https://github.com/shubhamk0027