Headline

Data Engineer | PySpark • AWS Glue • Redshift • Aurora | 3+ Yrs @ Deloitte USI | 1B+ Records Processed | AWS Certified Developer | PyPI Open-Source Contributor | Claude Certified Architect

About

Data Engineer with 3+ years at Deloitte USI, building large-scale data pipelines and cloud-native data platforms for a leading global investment management firm. What I do: I design, build, and optimize production-grade ETL/ELT pipelines on AWS using PySpark, AWS Glue, Redshift, Aurora PostgreSQL, Lambda, and Step Functions. My work sits at the intersection of financial data engineering, cloud architecture, and data quality — processing 1B+ records for critical financial workflows. Key highlights: - Implemented 25+ PySpark batch jobs on AWS Glue, processing 1B+ records to support a phased legacy COBOL-to-cloud migration - Reduced average runtime of 5 production AWS Glue jobs by 62.5% (40 mins to 15 mins) by diagnosing bottlenecks via Spark UI and restructuring job logic and execution configuration - Resolved Aurora production degradation via CDC replication (AWS DMS) to Redshift — enabled self-serve analytics for 8+ teams - Improved Redshift query performance by 40% through sort/distribution key tuning based on query access patterns - Built a PySpark validation framework automating 250+ hours/month of manual QA for legacy-to-cloud data reconciliation - Implemented a multi-region pipeline (EHC-based failover) sustaining 99.9% uptime for critical batch workloads - Published open-source Python library on PyPI — databridge-validator — for data migration validation with PII masking (500+ downloads) - Built a real-time stock market analytics platform — Kafka, Spark Streaming, Delta Lake medallion lakehouse, Airflow, Docker Tech I work with daily: Python • PySpark • Spark SQL • SQL • AWS Glue • S3 • Redshift • Aurora PostgreSQL • Lambda • Step Functions • DMS • Athena • EMR • Lake Formation • IAM • KMS • Kafka • Airflow • Delta Lake • Databricks • Snowflake • Docker • Splunk • Git AI & LLM: I use Claude Code daily for AI-augmented development, along with the Claude API, Model Context Protocol (MCP), and agentic workflows to accelerate engineering productivity and code quality. Certifications: AWS Certified Developer - Associate, Claude Certified Architect - Foundations 📧 vulasalaharikrishna@gmail.com 🔗 github.com/Vulasala-Hari-Krishna

Location

Bengaluru

AI stack

anthropic apis

claude code

github copilot

claudecode

Work experience

Data Engineer II at Deloitte, Jun 2026 - Present · 4 mos, Bengaluru · Hybrid

Data Engineer I at Deloitte, Oct 2024 - May 2026 · 1 yr 8 mos, Bengaluru · Hybrid

Analyst Trainee at Deloitte, Oct 2023 - Sep 2024 · 1 yr, Bengaluru · Hybrid

Education

Bachelor of Technology - BTech, Electronic and Communications Engineering, Rajiv Gandhi University of Knowledge Technologies, RKValley (RAC)

Public links

github: https://github.com/Vulasala-Hari-Krishna