Data Engineer | Azure, Databricks, Fabric | Building Modern Data Platforms for Analytics & AI/ML | Python, PySpark, SQL






Postgraduate Diploma, Big Data Analytics
Centre for Development of Advanced Computing (C-DAC)

Bachelor of Engineering - BE, Computer Engineering
Savitribai Phule Pune University
Join Vivek and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossData Engineer | Azure, Databricks, Fabric | Building Modern Data Platforms for Analytics & AI/ML | Python, PySpark, SQL
Most companies don’t have a data problem — they have a data engineering problem. I’m a Data Engineer focused on building reliable, scalable, and analytics-ready data platforms using Azure, Databricks, Microsoft Fabric, PySpark, and SQL. In my current role, I work on designing and maintaining ETL pipelines, improving data quality, and supporting cloud migrations — helping teams move from messy raw data to trustworthy, decision-ready datasets. Alongside production work, I’m actively expanding into Data Science, AI/ML, and GenAI systems, because great AI is impossible without great data foundations. My focus areas: Building scalable ETL/ELT pipelines (ADF, Databricks, Fabric) Data warehousing, Delta Lake, and analytics engineering Real-time & batch processing foundations Designing AI-ready data platforms I’m currently open to opportunities as: Data Engineer / GenAI Data Engineer / AI-ML Engineer If you’re building a data platform, analytics stack, or AI product — let’s talk.
Pune District
claude
cursor
Data Engineer at Prosys Infotech Private Limited, Jul 2024 - Present · 2 yrs 1 mo, Engineered and implemented robust automated data pipelines using Azure Data Factory and Databricks to ingest multi-source data into a structured Medallion Architecture on ADLS Gen2. Optimized PySpark workloads by implementing Delta Lake features like Z-Ordering and Partitioning, achieving measurable improvements in processing efficiency and reducing compute costs. Established CI/CD maturity by developing Azure DevOps pipelines to automate the testing and deployment of ADF artifacts and Databricks notebooks across multiple environments. Integrated Microsoft Fabric capabilities into existing workflows, utilizing Lakehouse shortcuts and GitHub Copilot to accelerate script development and pipeline orchestration. Architected high-performance data layers in Azure SQL Database to support real-time Power BI dashboards, maintaining Unity Catalog standards for strict governance and compliance.
Associate Data Engineer at Prosys Infotech Private Limited, May 2024 - Jul 2024 · 3 mos
Data Engineer at Prosys Infotech Pvt. Ltd., May 2024 - Present · 2 yrs 3 mos, Engineered and implemented robust automated data pipelines using Azure Data Factory and Databricks to ingest multi-source data into a structured Medallion Architecture on ADLS Gen2. Optimized PySpark workloads by implementing Delta Lake features like Z-Ordering and Partitioning, achieving measurable improvements in processing efficiency and reducing compute costs. Established CI/CD maturity by developing Azure DevOps pipelines to automate the testing and deployment of ADF artifacts and Databricks notebooks across multiple environments. Integrated Microsoft Fabric capabilities into existing workflows, utilizing Lakehouse shortcuts and GitHub Copilot to accelerate script development and pipeline orchestration. Architected high-performance data layers in Azure SQL Database to support real-time Power BI dashboards, maintaining Unity Catalog standards for strict governance and compliance.
Postgraduate Diploma, Big Data Analytics, Centre for Development of Advanced Computing (C-DAC)
Bachelor of Engineering - BE, Computer Engineering, Savitribai Phule Pune University