Akash Srivastava profile photo 1 on Tal

Akash Srivastava

Staff Data Platform Engineer @ Careem (UBER) | ex-Salesforce (processed 9 Million EPS real-time data, 18+ PetaByte/day) | Post Graduate [Deep Learning & AI] - IISc Bangalore | UAE - Golden Visa

Dubai

9+ years of work experience

Careem
Jan 20251 yr 5 mosPresent

Dubai, United Arab Emirates

Building Data & AI platform at Careem serving as the backbone powering data flow & AI capabilities across Careem services & mobile app.
Salesforce
Jan 20223 yrs 1 moJan 2025

Bengaluru, Karnataka, India

▪ Built ML platform for streamlining the process of productionizing ML models, from batch/stream based ML model training over S3 Delta lake, orchestration over Airflow, model deployment, integration with Splunk. ▪ Developed a notebook based Sandbox environment for ML engineers for data exploration, model development, testing & load test deployment leveraging JupyterHub, Spark, EMR, AWS Sagemaker & Data Lake integration (reducing time to production by 30%). ▪ Developed large-scale distributed data processing services in AWS, handling over 18+ PetaBytes of daily data and processing over ~9 Million Events/sec. ▪ Designed & developed push-based, event-driven data ingestion service for ingesting logs from [S3 + SQS], [GCS + PubSub] & Kafka to populate S3 Data Lake & handle partitions in Delta table via message/notification metadata extraction using custom Spark connectors & log format agnostic processing using Rule Engine. ▪ Designed & developed a pull-based, stateless, event-driven data ingestion service, using time-sliced event generator, to enable parallelization for faster data querying extensible over any queryable data sources (eg: REST API, BigQuery). The service improved operational efficiency & developer productivity cost overhead (~99% reduction in on-call alerts due to data ingestion lag of the earlier sequential data fetch service). [Patent filed: SFDC/I/105048/US] ▪ Handled PetaByte scale problems around Data migrations, Hive Metastore partitions , Data partitioning, Blob storage and building Data Lake. ▪ As first hire for India team, contributed to hiring & mentoring SDEs and ownership of the India charter & its deliverables. ▪ Building a centralized Data Governance Suite with cloud-agnostic integrations to AWS, GCP & Salesforce Data Cloud, providing uniform control over data across cloud storage solutions.
VMware
Aug 20216 mosJan 2022

Bengaluru, Karnataka, India

End User Computing (EUC) - Horizon Cloud Services
Walmart Global Tech India
Jun 20192 yrs 3 mosAug 2021

Greater Bengaluru Area

- "Next-Gen PPA - Payments data platform" - Developing a cloud-based centralized data solution for multi-sourced financial data, with the capability of workflow orchestration (Azure Data Factory), data transformations (Databricks + Apache Spark) and scheduling. The platform is based on reactive microservices architecture leveraging Functional Programming in Scala. - “Walmart Sales Planning Solution” - Lead the areas of design & backend development, Azure cloud setup, CI/CD (Azure DevOps) and PingFed based authentication for a Financial Planning solution intended for store & market managers across all Walmart stores in USA. The solution reduced the completion time of the planning process from 3 months to 3 weeks. - “FAQ Chat Bot” - Developed a POC platform leveraging Azure Bot Framework to create Question Answering bots on the fly, based on uploaded documents, and exposing it over multiple integrations: Slack, React Chat component. - Implemented a “Privacy-preserving Machine Learning” app for targeted promotions using customer behavior and personal demographic info. The solution was based on the concept of “Federated Learning”, which allows training of ML models on distributed data. Used a transfer-learning approach with TensorFlow-JS + Keras.
SAP Labs
Jul 20172 yrsJun 2019

Bengaluru Area, India

Scala Developer @ SAP Labs Innovation Center Network - Designing a framework in ReasonML for typedef generation and provisioning GraphQL endpoints with SAP semantic data-model: CDS. - Developing a type-safe DSL query framework in Scala employing compile-time meta-programming using scala-macros. - Developing a composable & scalable framework "Cloud Application Dev Kit for Scala" to enable development of applications and services on Cloud Foundry. - Independently published a library to enable type-safe messaging for Integration in cloud architecture. - Published an SBT- plugin to automate the deployment of application and services to SAP Cloud Foundry.

Education

Indian Institute of Science (IISc)

Postgraduate Degree, PG Level Advanced Certification Programme in Deep Learning Foundations and Applications

Indian Institute of Science (IISc)

20231 yr2024
Jaypee University of Information Technology

Bachelor of Technology (B.Tech.), Information Technology

Jaypee University of Information Technology

20114 yrs2015

Join Akash and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Akash Srivastava on Tal

Headline

Staff Data Platform Engineer @ Careem (UBER) | ex-Salesforce (processed 9 Million EPS real-time data, 18+ PetaByte/day) | Post Graduate [Deep Learning & AI] - IISc Bangalore | UAE - Golden Visa

About

Software Engineer with 10+ years of experience specializing in designing and implementing distributed systems, Data, ML & AI platforms processing batch & streaming data @ 9 Million EPS (18+ PB/day). Proficient in Java, Scala, Python, and cloud platforms (AWS, Azure, GCP), with proven success in leading large-scale data processing projects handling petabytes of data and building services serving millions of requests per second.Adept at driving efficiency and scalability through innovative solutions, including patented technologies.

Location

Dubai

Work experience

Staff Data & AI Platform Engineer at Careem, Jan 2025 - Present · 1 yr 5 mos, Dubai, United Arab Emirates, Building Data & AI platform at Careem serving as the backbone powering data flow & AI capabilities across Careem services & mobile app.

Senior Member of Technical Staff at Salesforce, Jan 2022 - Jan 2025 · 3 yrs 1 mo, Bengaluru, Karnataka, India, ▪ Built ML platform for streamlining the process of productionizing ML models, from batch/stream based ML model training over S3 Delta lake, orchestration over Airflow, model deployment, integration with Splunk. ▪ Developed a notebook based Sandbox environment for ML engineers for data exploration, model development, testing & load test deployment leveraging JupyterHub, Spark, EMR, AWS Sagemaker & Data Lake integration (reducing time to production by 30%). ▪ Developed large-scale distributed data processing services in AWS, handling over 18+ PetaBytes of daily data and processing over ~9 Million Events/sec. ▪ Designed & developed push-based, event-driven data ingestion service for ingesting logs from [S3 + SQS], [GCS + PubSub] & Kafka to populate S3 Data Lake & handle partitions in Delta table via message/notification metadata extraction using custom Spark connectors & log format agnostic processing using Rule Engine. ▪ Designed & developed a pull-based, stateless, event-driven data ingestion service, using time-sliced event generator, to enable parallelization for faster data querying extensible over any queryable data sources (eg: REST API, BigQuery). The service improved operational efficiency & developer productivity cost overhead (~99% reduction in on-call alerts due to data ingestion lag of the earlier sequential data fetch service). [Patent filed: SFDC/I/105048/US] ▪ Handled PetaByte scale problems around Data migrations, Hive Metastore partitions , Data partitioning, Blob storage and building Data Lake. ▪ As first hire for India team, contributed to hiring & mentoring SDEs and ownership of the India charter & its deliverables. ▪ Building a centralized Data Governance Suite with cloud-agnostic integrations to AWS, GCP & Salesforce Data Cloud, providing uniform control over data across cloud storage solutions.

Member Of Technical Staff - III at VMware, Aug 2021 - Jan 2022 · 6 mos, Bengaluru, Karnataka, India, End User Computing (EUC) - Horizon Cloud Services

Software Engineer III at Walmart Global Tech India, Jun 2019 - Aug 2021 · 2 yrs 3 mos, Greater Bengaluru Area, - "Next-Gen PPA - Payments data platform" - Developing a cloud-based centralized data solution for multi-sourced financial data, with the capability of workflow orchestration (Azure Data Factory), data transformations (Databricks + Apache Spark) and scheduling. The platform is based on reactive microservices architecture leveraging Functional Programming in Scala. - “Walmart Sales Planning Solution” - Lead the areas of design & backend development, Azure cloud setup, CI/CD (Azure DevOps) and PingFed based authentication for a Financial Planning solution intended for store & market managers across all Walmart stores in USA. The solution reduced the completion time of the planning process from 3 months to 3 weeks. - “FAQ Chat Bot” - Developed a POC platform leveraging Azure Bot Framework to create Question Answering bots on the fly, based on uploaded documents, and exposing it over multiple integrations: Slack, React Chat component. - Implemented a “Privacy-preserving Machine Learning” app for targeted promotions using customer behavior and personal demographic info. The solution was based on the concept of “Federated Learning”, which allows training of ML models on distributed data. Used a transfer-learning approach with TensorFlow-JS + Keras.

Associate Developer at SAP Labs, Jul 2017 - Jun 2019 · 2 yrs, Bengaluru Area, India, Scala Developer @ SAP Labs Innovation Center Network - Designing a framework in ReasonML for typedef generation and provisioning GraphQL endpoints with SAP semantic data-model: CDS. - Developing a type-safe DSL query framework in Scala employing compile-time meta-programming using scala-macros. - Developing a composable & scalable framework "Cloud Application Dev Kit for Scala" to enable development of applications and services on Cloud Foundry. - Independently published a library to enable type-safe messaging for Integration in cloud architecture. - Published an SBT- plugin to automate the deployment of application and services to SAP Cloud Foundry.

Education

Postgraduate Degree, PG Level Advanced Certification Programme in Deep Learning Foundations and Applications, Indian Institute of Science (IISc)

Bachelor of Technology (B.Tech.), Information Technology, Jaypee University of Information Technology