Senior Data Engineer | Data Platform & Distributed Systems

Bengaluru, Karnataka, India



Bengaluru, Karnataka, India







Information Science and Engineering, Information Technology
RV College of Engineering
Join Rishabh and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossSenior Data Engineer | Data Platform & Distributed Systems
Senior Data Engineer with 3 years experience building distributed batch and streaming data platforms — data ingestion, identity resolution, data quality, and real-time event layers that power prospecting search and AI-driven workflows. I work primarily in Python, SQL, and Go on Databricks and Apache Spark, with Kafka, Spark Structured Streaming, Delta Lake, Amazon OpenSearch Service, and AWS. My systems process billion-scale records and tens of millions of events weekly across multi-tenant production infrastructure serving 100+ tenants. Based in Bangalore, I'm focused on data platform and distributed systems engineering, with a growing interest in AI infrastructure and the data systems that power AI agents.
Greater Bengaluru Area
claude code
cursor
openai
opencode
ChatGPT
OpenRouter
Senior Data Engineer - Data Platform at Aurasell AI, Nov 2025 - Present · 11 mos, Bengaluru, Karnataka, India, Senior Data Engineer - Data Platform. -> Build and operate distributed batch and streaming data systems on Databricks and Spark for Aurasell’s AI-driven prospecting platform. -> Architected the Global Database, a master data management platform that unifies multi-vendor, real-time, and agent-enriched company/contact data through identity reconciliation and automated data-quality controls. -> Built the Unified Activities Layer, generating 25M+ professional and company activity signals weekly to power AI prospecting agents, product activity feeds, and automated outreach. -> Scaled batch ingestion and intent-processing platforms handling billion-scale profile data and 2B+ behavioral records weekly; reduced data-refresh cycles from two weeks to two days. -> Operate multi-tenant production infrastructure under strict SLAs, including low-latency streaming paths for agent-enriched profiles and search-ready data publishing.
Data Engineer - 2 at Amagi, May 2025 - Oct 2025 · 6 mos, -> Architected the Integrated Supply Transparency Report, unifying multi-platform data to deliver critical supply chain visibility and business insights. -> Developed an observability-driven KPI monitoring and alerting framework using Prometheus and Grafana, improving platform reliability and reducing error incidence rates by 50%. -> Mentored junior interns across multiple data engineering initiatives.
Data Engineer - 1 at Amagi, Aug 2023 - May 2025 · 1 yr 10 mos, -> Architected and built distributed batch pipelines in Databricks and Apache Spark, processing 50B+ records weekly to enable audience segmentation at scale. Improved ad targeting and contributed to a substantial increase in CPM for ad slots through data-driven monetization.
Backend Engineer at Nunam, Feb 2023 - Jul 2023 · 6 mos, Bengaluru, Karnataka, India, Backend Developer Intern at an early-stage startup, building scalable REST APIs using Java, Spring Boot, and PostgreSQL, while managing schema migrations with Liquibase.
Information Science and Engineering, Information Technology, RV College of Engineering