Headline

Aspiring Azure Data Engineer | Proficient in ADF, Databricks, PySpark, Delta Lake & Medallion Architecture | Built Production-Grade ETL Pipelines

About

As an Azure Data Engineer at Personal Projects, actively building an end-to-end ETL pipeline for an automotive sales data system using Azure Data Factory, Databricks, PySpark, and Delta Lake. Key contributions include implementing incremental data loading, SCD Type 1 with surrogate keys, and designing a Star Schema with fact and dimension tables for seamless Power BI dashboard integration. Data security is ensured through Unity Catalog with External Locations and Storage Credentials. Previously worked as a Solution Developer at Tata Technologies, contributing to enterprise CRM development for Cummins Inc. by customizing Siebel Sales and Service modules and optimizing SQL queries. Holds a Certified Data Scientist credential and is pursuing a Bachelor of Technology in Civil Engineering at JNTUH College of Engineering Hyderabad, expected in May 2027. Focused on leveraging cloud computing and data warehousing expertise to drive innovative data solutions.

Location

Telangana

Work experience

Azure Data Engineer (Project) at Personal Projects, Apr 2025 - Present · 1 yr 3 mos, Hyderabad, Telangana, India, Built an end-to-end ETL pipeline following Medallion Architecture (Bronze → Silver → Gold) for an automotive sales data system. Key Achievements: Designed incremental data loading with ADF watermark tables and stored procedures, reducing data load time by 70% Transformed raw data using Azure Databricks and PySpark — applied window functions, type casting, and KPI calculations Implemented SCD Type 1 with surrogate keys using Delta Lake MERGE/Upsert logic Built Star Schema (Fact + 4 Dimension tables) ready for Power BI dashboards Secured data access using Unity Catalog with External Locations and Storage Credentials Tech Stack: Azure Data Factory · Azure Databricks · PySpark · Delta Lake · ADLS Gen2 · Unity Catalog · Power BI Skills: Azure Data Factory, Azure Databricks, PySpark, Delta Lake, ADLS Gen2, Unity Catalog

Solution Developer at Tata Technologies, Jan 2022 - Sep 2023 · 1 yr 9 mos, Hybrid, Enterprise CRM development for Cummins Inc. using Siebel platform. - Developed and customized Sales & Service modules (BCs, BOs, Views, Applets, Screens, Responsibilities, User Properties) - Wrote complex SQL queries for data validation and performance tuning — reduced query execution time by ~30% - Collaborated with business and technical teams on requirement analysis, code reviews, and client presentations - Managed full defect lifecycle: root cause analysis, fixing, testing, deployment, and production support

Education

Bachelor of Technology, Civil Engineering, JNTUH College of Engineering Hyderabad