Headline

Senior Data Engineer

About

🚀 Passionate Senior Data Engineer | Certified Cloud & Big Data Specialist | Azure | Databricks | AWS | GCP | Python | SQL | Spark | Snowflake As a Data Engineering professional with close to 5 years of industry experience, I specialize in building, optimizing, and scaling robust data pipelines and cloud-based architectures. From designing real-time streaming solutions to developing ELT frameworks on Azure and AWS, I bring both hands-on expertise and a strong architectural mindset to deliver high-quality data solutions. 🔹 I’ve led the development of large-scale ETL/ELT pipelines using Azure Data Factory, Databricks, and Spark. I’ve migrated complex data systems to Azure SQL, managed cluster environments, optimized PySpark workloads by 30%, and automated data workflows using Logic Apps and Unix shell scripting. 🔹 I collaborated with cross-functional teams to deliver robust analytics pipelines, migrate data across Oracle, MySQL, and Snowflake to Azure, and ensure data accuracy and availability across business units. My contributions enhanced reporting efficiency and ensured secure, scalable data access via ADLS and Key Vault. 🔹 My early exposure as a Business Analyst Associate sharpened my business understanding. I helped top pharma clients gain insights into market KPIs through Tableau dashboards, bridging the gap between data and strategy. 🏆 Achievements: Perfect score of 100 in Engineering Mathematics-2 2nd Rank at Techtatva for UI design of an e-commerce app Awarded in the International Mathematics Olympiad (Class 10) 🎯 Core Skills: Data Engineering: Databricks, Spark, PySpark, SparkSQL, Airflow, Azure Data Factory Cloud Platforms: Azure, AWS, GCP Data Modeling & Warehousing: Snowflake, Azure SQL, ScyllaDB, Redshift Programming: SQL, Python, Shell scripting Orchestration: Airflow, Glue, ADF Security & Governance: Azure Key Vault, IAM, Compliance (ISO Certified Environments) Tools: IBM Infosphere DataStage, Databricks Delta, Spring Boot 📜 Certifications: Databricks Professional Data Engineer Databricks Gen AI Associate AWS Certified Solutions Architect – Associate SnowPro Core Certified Microsoft Certified: Azure Data Engineer (DP-203) Microsoft Certified: Azure Fundamentals (AZ-900) Google Cloud Certified: Professional Cloud Architect I thrive in high-growth environments and take pride in solving complex data challenges.

Location

Bengaluru

AI stack

claude code

claude

Work experience

Senior Data Engineer at Latitude Financial Services, Feb 2026 - Present · 10 mos, Melbourne, Victoria, Australia, • Built ETL/ELT pipelines for analytics workloads using Python, PySpark, SQL, ADF and Databricks across Azure and AWS. • Integrated on-prem enterprise and ERP sources (SAP, Oracle, Teradata, SQL Server) into modern cloud data warehouses. • Developed DBT transformation layers and dimensional data models producing governed, analytics-ready datasets for BI teams. • Improved query and pipeline performance by ~25% through tuning, partitioning and cost optimization.

Senior Data Engineer at Kroger Technology & Digital, Feb 2025 - Feb 2026 · 1 yr 1 mo, Cincinnati, Ohio, United States

Senior Data Engineer at Royal Mail, Aug 2021 - Jan 2025 · 3 yrs 6 mos, London Area, United Kingdom

Education

Bachelor of Engineering, Computer Engineering, Visvesvaraya Technological University

Delhi Public School (DPS)

Public links

github: https://github.com/amritanshagrawal99