Headline

Data Engineer | Azure Databricks | PySpark | ADF | SQL | Building scalable ETL & analytics pipelines

About

Data Engineer with experience building scalable ETL pipelines, automating data workflows, and developing cloud-based analytics solutions using Azure technologies. I work extensively with Azure Databricks, Azure Data Factory (ADF), PySpark, SQL, and Python to design reliable data pipelines and transform raw data into business-ready insights. My experience includes handling structured and semi-structured data, optimizing data ingestion processes, and working with Medallion Lakehouse architecture concepts. Key areas I work on: • Azure Databricks & PySpark • Azure Data Factory (ADF) • SQL & Data Transformation • ETL/ELT Pipeline Development • Data Modeling & Analytics • Cloud Data Engineering (Azure & AWS) Recently, I’ve worked on: ✔ Automating file ingestion and transformation workflows\ ✔ Building scalable data movement pipelines using Azure services ✔ Optimizing data processing and validation workflows I’m actively growing my expertise in advanced cloud data engineering, real-time processing, and scalable analytics platforms. Open to connecting with professionals in Data Engineering, Azure Cloud, and Analytics.

Location

Mumbai

Work experience

Data Eng, Mgmt & Governance Analyst at Accenture, Dec 2024 - Present · 1 yr 7 mos, Developed and maintained scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, PySpark, and SQL for efficient data ingestion and transformation. Worked with structured and semi-structured datasets to build reliable data processing workflows and analytics-ready data models. Automated data validation, cleansing, and transformation processes to improve data quality and operational efficiency. Designed and optimized SQL queries, stored procedures, and transformation logic for better pipeline performance and reduced execution time. Implemented file-based ingestion workflows using Azure Data Lake Storage and ABFSS integrations for large-scale data movement. Collaborated with cross-functional teams to gather business requirements and translate them into scalable data engineering solutions.

Data Eng, Mgmt & Governance Associate at Accenture, Dec 2022 - Nov 2024 · 2 yrs, Assisted in developing and enhancing cloud-based ETL pipelines using Azure Data Factory, Databricks, SQL, and Python. Worked on data ingestion, transformation, and loading processes for enterprise-scale analytics and reporting requirements. Created PySpark notebooks and SQL-based transformations to process and validate large datasets efficiently. Supported automation of recurring data workflows and manual processes to improve productivity and reduce operational effort. Performed data quality checks, reconciliation, and validation to ensure accuracy and consistency across datasets. Integrated files and datasets from multiple data sources into Azure Data Lake environments using scalable ingestion methods.

Education

Masters of Computer Applications, Deccan Education Societys Navinchandra Mehta Institute of Technology and Development At Dadar Mumbai 400 028

Bachelor of Science - BS, Computer Science, S K Somaiya Vidyavihars College of Arts Science & Commerce Vidyavihar Mumbai 400 077