Azure Data Engineer | 2 YOE TCS Azure DevOps | ADF Synapse PySpark SQL ETL | Building Scalable Pipelines | Open to Relocation Opportunities

Kolkata

Remote
Patna, Bihar, India

Bachelor of Technology - BTech, Computer Science & Engineering
Bhagalpur College of Engineering
12th, Science, maths
Bseb
Join Deepak and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossAzure Data Engineer | 2 YOE TCS Azure DevOps | ADF Synapse PySpark SQL ETL | Building Scalable Pipelines | Open to Relocation Opportunities
Azure Data Engineer with 2 years hands-on experience at TCS, specializing in Azure DevOps for data pipelines, ETL processes, and BCP documentation. Proficient in Azure Data Factory (ADF), Azure Synapse Analytics, PySpark, SQL (advanced queries, CTEs, window functions), and Databricks-delivered pipelines handling 1TB+ data, optimizing ETL runtime by 40% and ensuring seamless data flow for business continuity. Key achievements: Engineered Azure DevOps CI/CD pipelines integrated with ADF for automated data ingestion and transformation. Built Synapse workspaces for analytics, reducing query costs via partitioning and indexing. Developed PySpark scripts for large-scale data processing, enabling real-time insights. Passionate about transforming raw data into actionable business value. Actively pursuing Data Engineer roles with cloud-first teams-excited for global opportunities where I can contribute scalable solutions. Open to relocation and ready to discuss how my Azure expertise drives efficiency. Let's connect! #AzureDataEngineer #DataPipelines #ETL #DataEngineer
Kolkata
Assistant System Engineer at TCS, Apr 2024 - Present · 2 yrs 1 mo, Kolkata, Designed and implemented Azure Data Factory (ADF) pipelines for ETL workflows, processing 1TB daily data and cutting processing time 40% via optimization. Leveraged Azure Synapse for data warehousing and analytics, building workspaces with SQL pools that improved query performance 30% for BCP reporting. Developed PySpark jobs on Databricks for big data transformations, handling joins/CTEs/window functions on terabyte-scale datasets. Integrated Azure DevOps CI/CD with data tools, automating deployments and ensuring zero-downtime for production pipelines. PySpark Contributed to BCP documentation using SQL queries and Power BI dashboards, enhancing disaster recovery insights for stakeholders.
Data Analytics Corporate Training at Jobaaj.com, Jul 2022 - Mar 2023 · 9 mos, Remote, Hello, My name is Deepak Kumar , I joined Jobaaj Learning for training and learning. The experience here is awesome. Jobaaj learning trained me, with full of data analytics skills. I consider it the most effective method of consuming learning contents and are on a mission of making professional habitual of upskilling by stealing little time daily from their busy lifestyle.
Summer Intern at BIHAR STATE POWER TRANSMISSION COMPANY LIMITED, Jun 2022 - Jul 2022 · 2 mos, Patna, Bihar, India, • Built a unique Book Recommender system for the library from scratch, now there's a machine learning feature that is also available in that system. • Process oriented data analysis using excel, python library for the recommender system and reduced operating costs. • Successfully interpreted data to identify key metrics and draw conclusion.
Bachelor of Technology - BTech, Computer Science & Engineering, Bhagalpur College of Engineering
12th, Science, maths, Bseb