Deepak Kumar profile photo 1 on Tal

Deepak Kumar

Sr Data Engineer | Data Vault 2.0 Expert | AWS & Snowflake Specialist | Optimizing Data Pipelines & Cloud Costs | Python | ELT/ETL Framework

Bengaluru

6+ years of work experience

Illumina
Jan 20251 yr 9 mosPresent

Greater Bengaluru Area

EY
Jul 20222 y 6 moJan 2025

On-site

Tata Consultancy Services
Aug 20202 yrs 1 moAug 2022

Kolkata, West Bengal, India

Contributed to creating a Python-based, cloud-agnostic ELT framework for Snowflake, integrating data from 12 source systems (S3, SQL Server, Profisee) into modeled Data Vault tables. Reduced data ingestion time by 40% through Connection Pool implementation, minimizing parallel database connections. Integrated features like checkpoints, restart-ability, data quality checks, and automated notifications to improve data integrity between RDV (Raw Data Vault) and Staging Area in ELT processes. Migrated on-premises ELT batch Python framework to AWS serverless stack (AWS Batch, S3, CloudWatch, Fargate), reducing operational costs by 85%. Utilized AWS CloudFormation templates for serverless migration (Infrastructure as Code), ensuring efficient monitoring, versioning, and streamlined deployments. Tech Stack: Snowflake, SQL, Data Vault 2.0, Azure DevOps, YAML, Git, Python, Pandas, AWS (S3, Docker, CloudWatch, Secret Manager), Control-M

Deepak’s AI Stack

claude
claude
cursor
cursor
github copilot
github copilot
langgraph
langgraph

Education

Bachelor of Technology - BTech, Computer Science

institute of engineering and management

20164 yrs2020

Join Deepak and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Deepak Kumar on Tal

Headline

Sr Data Engineer | Data Vault 2.0 Expert | AWS & Snowflake Specialist | Optimizing Data Pipelines & Cloud Costs | Python | ELT/ETL Framework

About

As a Senior Data Engineer with proven expertise in data warehouse design, ETL/ELT pipeline automation, and cloud migration, I thrive on transforming complex data challenges into scalable, efficient solutions. My experience spans Fortune 500 companies and high-growth environments, where I’ve delivered Python-based ELT frameworks, migrated critical workloads to AWS serverless, and cut operational costs by up to 85%. I specialize in Data Vault 2.0 modeling, Snowflake architecture, and building robust data quality frameworks.I am passionate about leveraging emerging cloud technologies to drive business value, data integrity, and cost efficiency. If you’re seeking a data engineering leader who turns data into a strategic asset, let’s connect!

Location

Bengaluru

AI stack

claude

cursor

github copilot

langgraph

Work experience

Sr Data Engineer at Illumina, Jan 2025 - Present · 1 yr 9 mos, Greater Bengaluru Area

Data Engineer at EY, Jul 2022 - Jan 2025 · 2 y 6 mo, On-site

Data Engineer at Tata Consultancy Services, Aug 2020 - Aug 2022 · 2 yrs 1 mo, Kolkata, West Bengal, India, Contributed to creating a Python-based, cloud-agnostic ELT framework for Snowflake, integrating data from 12 source systems (S3, SQL Server, Profisee) into modeled Data Vault tables. Reduced data ingestion time by 40% through Connection Pool implementation, minimizing parallel database connections. Integrated features like checkpoints, restart-ability, data quality checks, and automated notifications to improve data integrity between RDV (Raw Data Vault) and Staging Area in ELT processes. Migrated on-premises ELT batch Python framework to AWS serverless stack (AWS Batch, S3, CloudWatch, Fargate), reducing operational costs by 85%. Utilized AWS CloudFormation templates for serverless migration (Infrastructure as Code), ensuring efficient monitoring, versioning, and streamlined deployments. Tech Stack: Snowflake, SQL, Data Vault 2.0, Azure DevOps, YAML, Git, Python, Pandas, AWS (S3, Docker, CloudWatch, Secret Manager), Control-M

Education

Bachelor of Technology - BTech, Computer Science, institute of engineering and management

Deepak Kumar - Sr Data Engineer in Bengaluru | Tal