Azure Data Engineer at Tata Consultancy Services | Azure | PySpark | SQL | ETL | ADF | Databricks



Pune, Maharashtra, India

Pune, Maharashtra, India

Bachelor of Engineering - BE, Information Technology
JSPM's Rajarshi Shahu College of Engineering
Join Vishakha and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossAzure Data Engineer at Tata Consultancy Services | Azure | PySpark | SQL | ETL | ADF | Databricks
Azure Data Engineer with 4 years of experience, including 3 years in data engineering and 1 year in Identity Governance and Administration (IGA). Skilled in building and optimizing data pipelines, data lakes, and analytics solutions using Azure Data Factory, Databricks , Pyspark & SQL. Strong background in data security, access management, and governance, ensuring scalable and compliant cloud data solutions. Passionate about transforming data into actionable insights and driving business value through efficient, secure, and modern data architectures.
Pune Division
Azure Data Engineer at TCS at Tata Consultancy Services, Aug 2023 - Present · 3 yrs, • Engineered end-to-end ETL pipelines utilizing PySpark, SQL, and Azure Data Factory (ADF) for efficient data processing. • Designed reusable ADF workflows to automate data ingestion and transformation, enhancing operational efficiency. • Improved pipeline performance through query optimization and effective Spark transformations, ensuring reliability. • Implemented data validation and quality checks to maintain data accuracy and troubleshoot production issues.
Assistant System Engineer at Tata Consultancy Services, Oct 2022 - Jul 2023 · 10 mos, As an Azure Data Engineer at Tata Consultancy Services, I focused on building and maintaining robust ETL pipelines using PySpark and SQL. I designed data workflows with Azure Data Factory, ensuring efficient data processing and analytics. My role involved data transformation and cleansing, which significantly improved data quality for analytics use cases. Additionally, I automated data ingestion processes and resolved pipeline execution issues, contributing to reliable data solutions.
Assistant System Engineer - Trainee at Tata Consultancy Services, Jul 2021 - Sep 2022 · 1 yr 3 mos, Pune, Maharashtra, India, Managed identity lifecycle operations (provisioning, de-provisioning, access modifications) using One Identity Manager. Implemented RBAC, automated workflows, and approval policies to enhance access governance. Integrated One Identity Manager with Active Directory, Azure AD, and LDAP connectors for centralized identity management. Developed and maintained custom synchronization projects and data mappings for directory integrations. Supported troubleshooting, policy optimization, and continuous improvement in IGA processes.
Intern at Zensar Technologies, Dec 2020 - Feb 2021 · 3 mos, Pune, Maharashtra, India
Bachelor of Engineering - BE, Information Technology, JSPM's Rajarshi Shahu College of Engineering