Headline

Data Engineer | Azure Data Factory, Databricks, PySpark, Unity Catalog & Cloud Architecture

About

As a Data Engineer, I specialize in architecting, building, and optimizing robust data pipelines within the Microsoft Azure and Databricks ecosystems. ​Currently, I focus on complex ETL/ELT processes, seamless environment migrations, and data governance. My technical stack heavily features Azure Data Factory, PySpark, Unity Catalog, Logic Apps, and SQL Server. I am passionate about modernizing data infrastructure, recently driving large-scale migrations from Azure Synapse to Databricks to enhance performance and scalability. ​Leveraging Python and Power Automate, I integrate seamless automation solutions across platforms to solve complex business challenges. I am a continuous learner, actively preparing for advanced certifications including Microsoft DP-203, AZ-305, and Databricks Professional to stay at the forefront of cloud data engineering

Location

Bail Hongal

AI stack

cursor

github copilot

langchain

openai

Work experience

Senior Data Engineer at Data Semantics, Jul 2023 - Present · 2 yrs 11 mos, Bengaluru, > Spearheaded the complex data migration for the Modon Data Foundation project, seamlessly transitioning data architectures from Azure Synapse to Databricks while managing environment separation. > Implemented and configured Unity Catalog for ADNEC and Modon environments, establishing robust data governance, access controls, and improved data discoverability. > Designed and optimized scalable ETL/ELT pipelines utilizing Azure Data Factory, PySpark, and advanced SQL Server integrations. > Automated critical data workflows and cross-platform business processes leveraging Azure Logic Apps and Power Automate.

Education

Computer Software Engineering, Oxford College of Computer Applications Keshwapur, Sholapur Road, Hubli.

Master of Software Engineering, Oxford College of Computer Applications Keshwapur, Sholapur Road, Hubli.