Headline

Senior Data Engineer | Databricks, PySpark, Delta Lake, Kafka, dbt, Airflow | AWS Data Engineer + Solutions Architect Certified | Relocating to EU — Blue Card Eligible

About

Senior Data Engineer with over 5 years of experience building enterprise-grade lakehouse platforms and cloud data infrastructure — currently at Thermo Fisher Scientific (Life Sciences & Pharma), previously at TEKsystems (Fortune 500 Travel) and Labcorp (Clinical Trials). Triple certified: Databricks Certified Data Engineer Associate · AWS Certified Data Engineer · AWS Certified Solutions Architect. ━━━ What I Build ━━━ I design and deliver production data platforms that organisations trust for compliance, scale, and speed — not just pipelines that run. ━━━ Key Deliverables ━━━ ▸ 100+ TB cloud migration (Hadoop/Teradata → Apache Iceberg on AWS) — 50% query latency reduction ▸ ELT pipelines processing 1–2 TB daily across 600+ tables in HIPAA/GDPR-regulated environments ▸ 99.8% ingestion accuracy via PySpark data quality framework with 150+ validation rules ▸ 300+ hours/month saved through automated clinical data workflows ▸ LLM-powered automation eliminating 120 person-hours/month across 5 business teams ▸ Zero compliance findings across every external audit at two regulated companies ━━━ Core Stack ━━━ PySpark · Databricks · Apache Iceberg · Delta Lake · dbt · Apache Airflow · AWS (Glue, EMR, S3, Redshift, Athena) · Unity Catalog · Terraform · GitHub Actions ━━━ Certifications ━━━ Databricks Certified Data Engineer Associate (May 2026) · AWS Certified Data Engineer (Aug 2024) · AWS Certified Solutions Architect (Feb 2025) ━━━ Open to Opportunities in Europe ━━━ Actively seeking Senior / Lead Data Engineer roles in Germany, Netherlands, Sweden, Finland, Denmark, Ireland, Spain, or Estonia. EU Blue Card eligible. Available for employer-supported relocation.

Location

Germany

AI stack

antigravity

codex

Work experience

Data Engineer III at Thermo Fisher Scientific, Nov 2025 - Present · 10 mos, Bengaluru, Karnataka, India, • Building and owning production-grade data pipelines and lakehouse infrastructure on Databricks and AWS for 3 regulated business units (Life Sciences, Diagnostics, Pharma). • Scaled a governed data platform serving 600+ tables across regulated environments, with full Unity Catalog lineage and zero HIPAA/GDPR compliance findings • Built ELT pipelines processing 1–2 TB daily; optimised Spark jobs to cut compute costs by 30% and improve throughput by 25% • Delivered data quality contracts across 20+ TB of clinical data, ensuring full audit readiness at every pipeline stage • Cut manual reporting effort by 40% (~120 person-hours/month) through OpenAI-powered workflow automation • Reduced ad-hoc data requests by 35% by defining data contracts and SLAs with three crossfunctional business teams

Senior Data Engineer at TEKsystems Global Services in India, Oct 2024 - Nov 2025 · 1 yr 2 mos, Bengaluru, Karnataka, India, Led large-scale data engineering for a Fortune 500 travel platform, migrating 100+ TB from Hadoop and Teradata to a cloud lakehouse on AWS. • Migrated 100+ TB of travel data (flights, hotels, cars, cruises) to AWS using Apache Iceberg — enabling ACID transactions, schema evolution, and time-travel queries at scale • Cut Athena query latency by 50% through partition redesign and Iceberg compaction strategies • Built Bronze/Silver/Gold medallion pipelines with CDC and SCD Type-2 across 12+ source systems • Developed a PySpark data quality framework with 150+ validation rules — achieving 99.8% ingestion accuracy • Reduced deployment cycle time by 65% using Terraform and GitHub Actions CI/CD; maintained 99%+ SLA adherence via Airflow

Data Analytics Associate at Labcorp Drug Development, Feb 2021 - Sep 2024 · 3 yrs 8 mos, Bengaluru, Karnataka, India, Built and maintained the core data engineering infrastructure for clinical trial analytics across 20+ source systems in a HIPAA/GDPR-regulated environment. • Built HIPAA/GDPR-compliant ETL/ELT pipelines on AWS Glue and EMR, ingesting clinical trial data at scale from 20+ source systems • Delivered a clinical data warehouse and metadata catalog that cut audit preparation effort by 300+ hours per month • Built an NLP pipeline in PySpark to process 10,000+ monthly clinical consent forms at 98% accuracy • Reduced manual validation effort by 60% through automated schema drift detection; passed 3 external regulatory audits with zero findings

Education

Master of Computer Applications - MCA, Computer Programming, Specific Applications, RV College of Engineering

BCA - Bachelor of Computer Application, Computer Programming, Yuvaraja's College, Mysuru

Public links

github: https://github.com/data-factor