Headline

Data@Uber | Sr Data Solutions Lead Engineer | Designing/Implementing Data Pipelines, Platforms & Agentic Systems at Scale | IIITB | GATE AIR 800 | BARC AIR 16 | ECIL AIR 3 | NPCIL AIR 12

About

Engineering professional with a Master's Degree focused in Machine Learning, Big Data, Data Modeling and Statistics from IIIT Bangalore. Experienced Data Solutions Engineer who has worked in all the layers of full data stack in the FinTech, Finance Risk (CCAR), Marketing and Sales domain.

Location

Bengaluru

AI stack

claude code

cursor

langchain

mcp

ChatGPT

Work experience

Lead data engineer at Uber, Aug 2024 - Present · 2 y 2 mo, Bangalore, Working in FinTech Engineering & Insights team. > Managing a team of 3. > Independently designed, developed & currently managing a vertically and horizontally scalable Anomaly Detection framework (which is used across 20+ teams) to detect Anomalies at lower grain (accross different systems) on finance dataset without increasing False positives. At ingestion Layer: Used LLM based RAG pipeline to quickly omboard new users/teams. At Observability Layer: Defined and tracking Data Quality metrics at data/team/org levels for IC/higher management users. There has been ZERO downtime / incident in the framework since inception (since Aug 2023). > Designed & Developed RAG based Delta Doc Pipeline which scans through all the code changes on a weekly basis and document historical and current changes. Later, these summarized documents/chunks are vectorized and used to answer users & developer queries with higher accuracy on the fly. Later implemented Caching & Evals to reduce LLM cost & increase confidence. These created documents are also ingested by other team models. > Led cloud migration & Hive to spark migration initiatives for the team. > Worked on/managed various business critical metrics which is monitored by senior management like: EBITDA, Uber Trip Level Profitability, GB etc.

Software Engineer 2 at Uber, Mar 2022 - Aug 2024 · 2 yrs 6 mos, Bengaluru, In FinTech Insights & Data Engineering Team @ Uber R&D - Created a unified Datamart for Uber eats & Uber rides (financial data) which is used to answer business critical questions along with the data getting used by Data Science team for their experimentation. - Independently handelled Billions of data points (ETL) daily starting from ingesting, transforming, data modelling, creating ERDs, generating insights out of it and finally visualizing it using Tableau which is business critical and used by many senior managers (about 1100 views/month). - Created a utility using Tableau API which allows all kinds of tableau extracts to refresh as soon as latest data is available in base tables. Hence saving about 4 hours on SLA. - Created a Conversational AI Chatbot for the team (integrated with slack) which educates end users on our team & data. It also creates Hive/Presto queries on the fly for non technical end users. - Optimizing our business critical ETL data pipelines by improving the logic and moved it to PySpark and reduced the processing time of some of them from 4 hours to about 20 minutes. - Working on achieving row level Data Security for hive tables.

Senior Software Engineer (Big Data Analytics) at LogMeIn, Mar 2021 - Feb 2022 · 1 yr, Bengaluru, Karnataka, India, Working in as Full Data Stack Developer in Big Data Analytics team. - Designing ETL pipelines in pySpark and modelling datawarehouse hive tables to daily handel millions of data records in scalable fashion for GoToMeeting, GoToWebinar, Lastpass and other company products. - Building analytics on top of the data like: customer churn prediction, products upsell & cross sell for sales team (generating about $7 million revenue per year for EMEA market) and even creating tableau reports which shows customers 360 view which is daily used by about 300 end users. - Spent time on data governance efforts and hence made sure the quality of data in our centralised datawarehouse is top notch. Technology/Platform used: Machine Learning, AI, NLP, AWS, Conversational Chatbots, Hadoop, Pig, Hive, PySkark, Python, Oozie/Airflow, SQL, Presto and Tableau.

Software Engineer (Big Data Analytics) at LogMeIn, Jan 2018 - Mar 2021 · 3 yrs 3 mos, Bengaluru, Karnataka, India, Working in Data Engineering and Big Data Analytics team. Technology/Platform used: Machine Learning, NLP, AWS, Hadoop, Pig, Hive, PySkark, Python, Oozie, SQL, Presto and Tableau.

Software Developer (Business Analyst) at Oracle, Nov 2016 - Dec 2017 · 1 yr 2 mos, Bengaluru Area, India, Working in Domain: Machine Learning , Analytics, Database and Automation Programming Languages used: SAS, Python, PLSQL, Java (Selenium), Shell Scripting, Security testing. Platform used: Hadoop, Spark Have working knowledge of using: Docker, Git, XML, HTML, Hudson (Jenkins)

Analyst at American Express, Jul 2015 - Oct 2016 · 1 yr 4 mos, Gurgaon, Team: Individual Decision Science (Risk Information Management Department). Job Role: Working on CCAR model for US and International markets (using SAS Technology) and in parallel, trying to migrate the whole process on to Hadoop (Big Data) from SAS. By doing this, there will be a significant improvement in the run time performance of the process.

Intern at American Express, Jan 2015 - Jul 2015 · 7 mos, Gurgaon, India, Working on Big Data Solutions to a process with Global Risk Oversight team.

Student at IIIT Bangalore, Jul 2013 - Jul 2015 · 2 yrs 1 mo, Bengaluru Area, India

Education

Master's Degree, IT, IIIT Bangalore

Bachelor's Degree, Electronics & Communication Engineering, Tech : ABES Engineering College(032)