Headline

Data Engineer focused on AI-driven data infrastructure and analytics.

About

As a Data Engineer II at Baker Hughes, I focus on building robust production data infrastructure and pipelines that integrate AI/ML models for real-time oilfield monitoring. My work includes designing and implementing high-precision pipelines, such as those used for real-time well-leak detection across multiple wells, and migrating data pipeline modules to secure architectures for IP protection. I hold a Bachelor's degree in Computer Science from Vellore Institute of Technology. My core competencies include PySpark, Databricks, and Apache Spark, with a focus on event-driven systems and AI-ready data integration. I am motivated by opportunities to collaborate with teams and stakeholders to enhance reliability and efficiency in data-driven solutions.

Location

Bengaluru

AI stack

claude code

claude

github copilot

mcp

Microsoft Copilot

Work experience

Data Engineer 2 at Baker Hughes, Sep 2025 - Present · 1 yr 2 mos, Bengaluru, Karnataka, India, • Designed and implemented production data infrastructure for Baker Hughes' AI-driven oilfield monitoring platform. • Engineered a high-precision AI/ML model integration pipeline for real-time well-leak detection across 20+ wells. • Led the migration of 40+ data pipeline modules to a secure Cython-based architecture, ensuring IP protection. • Mentored junior engineers and collaborated with stakeholders to enhance AI alerting features and reliability.

Data Engineer 1 at Baker Hughes, Jul 2023 - Sep 2025 · 2 yrs 3 mos, Bengaluru, Karnataka, India, Joined as a campus hire and built core production systems for Baker Hughes' data platform across SaaS and customer-deployed environments. Promoted to Data Engineer II for technical leadership and ownership across critical projects. - Designed and shipped end-to-end ETL pipelines ingesting 100GB/day across heterogeneous sources (REST APIs, JDBC, files, event streams) into a medallion architecture on Databricks + Delta Lake, supporting 6+ downstream analytics and AI consumers. - Built an event-driven processing layer that reduced end-to-end data latency by 30% and tightened SLA compliance for customer-facing pipelines. - Cut cloud transaction costs by ~60% on event-driven workloads through message batching, deduplication, and partition tuning strategies. - Implemented SCD Type 3 and CDC patterns for historical-data management and large-scale backfills, ensuring data accuracy for SOC2-audited customer environments. - Designed and developed a scalable query engine for ad-hoc SQL and statistical workloads, abstracting compute backends across Trino and Spark behind a unified interface. - Architected a unified codebase serving both on-premises and Databricks deployments, eliminating duplicated logic across two delivery paths. - Spearheaded Databricks asset automation using CI/CD principles, delivering a 70% improvement in infrastructure operations and developer efficiency, with monthly Power BI dashboards surfacing recurring cost-optimization wins. Tech: PySpark · Databricks · Delta Lake · Apache Spark · Trino · Hive · Airflow · Azure (ADLS, Event Hubs, ADF) · Docker · Power BI · CI/CD · SOC2

Digital technology intern at Baker Hughes, Jan 2023 - Jun 2023 · 6 mos, Bengaluru, Karnataka, India, As a part of the M&A team, I had the privilege to work on a core business centric usecase driven by Power BI involving extensive data analysis. This application was designed for the divestitures part of the deal and it's associated inventory of applications, User IDs all at one place for multiple deals given the multiple sources of data. Primarily associated with the due diligence phase, the application maintains a single source of truth for multiple deals there by ensuring deal level data isolation. This made a positive impact on the pace of the deal execution by speeding up the Virtual Data Room (VDR) preparation time. Data confidentiality was ensured at all levels to cater the fact that deals are accounted to be a part of deal NDA and corporate NDA. Role based access control (RBAC) was implemented given the access restriction levels of users sufficing row level security of data.

Education

Bachelor's degree, Computer Science, Vellore Institute of Technology

Public links

saikrishna-subramanian.vercel.app: https://saikrishna-subramanian.vercel.app/?utm_source=ig&utm_medium=social&utm_content=link_in_bio&fbclid=PAb21jcAVHLz1leHRuA2FlbQIxMQBwZG9mAnNydGMGYXBwX2lkDzU2NzA2NzM0MzM1MjQyNwABp4CoISFme-SmbPFsvlcwjW2i2wJodKOPYP1h0-fDuvzJr-SbJu2uHys9U-yV_aem_TQW2D0bEhFNjpWMc1c7zag