Headline

Lead/Staff Data Engineer | SQL | Python | PySpark | Databricks | Snowflake | AWS | Azure | Ex-Deloitte | Ex-Ameriprise

About

I’m a Lead/Staff Data Engineer passionate about building scalable data systems that power real-world intelligence in healthcare. At ResMed, I lead the data engineering efforts for our ML/AI team, enabling predictive insights like fall-risk and depression detection for thousands of patients through our EHR SaaS platform. My work focuses on designing low-latency, cloud-native data architectures using AWS, Snowflake, and PySpark — from real-time streaming pipelines processing a million+ observation forms weekly to large-scale batch systems optimized for billions of records. I thrive at the intersection of data infrastructure and applied machine learning, turning complex raw data into actionable insights that help clinicians make faster, better decisions. Beyond building pipelines, I focus on performance optimization, reliability automation, and establishing architecture best practices. Always open to learning, collaborating, and leading teams that push the boundaries of what data can do in healthcare.

Location

Greater Kolkata Area

AI stack

claude code

github copilot

langchain

langgraph

mistral

openai

Work experience

Senior Data Engineer at ResMed, Aug 2024 - Present · 2 yrs 3 mos, Bengaluru, Karnataka, India

Senior Data Engineer at agilon health, Apr 2023 - Aug 2024 · 1 yr 5 mos, Bengaluru, Karnataka, India

Lead Data Engineer at Deloitte, Jan 2023 - Apr 2023 · 4 mos, Bengaluru, Karnataka, India

Data Engineer at Deloitte, Aug 2021 - Jan 2023 · 1 yr 6 mos, Bengaluru, Karnataka, India

ETL Developer at Ameriprise Financial Services, LLC, Feb 2021 - Aug 2021 · 7 mos, Noida, Uttar Pradesh, India

Informatica ETL Developer at Cognizant, Jan 2018 - Feb 2021 · 3 yrs 2 mos, Kolkata, West Bengal, India, Advanced Developer in Informatica Power Center, Power Exchange(9.6, 10.2HF1 & 10.2HF2), Informatica TDM & Informatica Intelligent Cloud Services(IICS). Rich experience in data masking, data profiling, data generation, data subsetting , data warehousing using Informatica. Developed mappings, workflows and tasks using Power Center and implemented business logic parameters for model execution. Gathered, defined and refined requirements, led module design and oversaw implementation in the absence of Team Lead. Have good debugging skills for data movement workflows and have hands on experience of performance tuning too. Worked across multiple RDBMS' like: SQL Server, SQL MI Server, DB2, Mainframe DB2, Oracle 10g, Salesforce, Azure SQL & various file formats including mainframe files to secure data using data masking. Led development of masking workflows and mappings for Mainframe applications and also worked intensively on identifying, troubleshooting and correcting bugs and bottlenecks. Generated synthetic data for testers as per the client's requirements to mitigate data related risks. Worked on integration and development for Salesforce based applications using Informatica Intelligent Cloud Services(IICS) to apply data masking and data subsetting. Hands on experience of Java - Developed in house encryption and decryption tool for a database as per clients' requirements. Worked in both development and operations' track with night support. Hands on experience of Shell scripting.

Education

Bachelor of Engineering (B.E.), Electrical, Electronics and Communications Engineering, Savitribai Phule Pune University

Public links

github: https://github.com/karnirathore