Headline

Azure Data Engineer | SQL | ETL | Azure Data Factory | Azure DataBricks | Python | Azure Synapse

About

Data Engineer with 4+ years of experience designing and building scalable data pipelines on Microsoft Azure. I specialize in end-to-end data engineering — from ingestion to transformation to analytics-ready delivery — using Azure Data Factory, Databricks, and Synapse Analytics. I enjoy solving problems around data reliability, performance tuning, and designing pipelines that scale as data volume grows. I'm always looking to deepen my expertise in modern data platform architecture. Currently open to new opportunities where I can apply my Azure data engineering skills to interesting, high-impact problems. Feel free to connect or reach out — always happy to talk data engineering, cloud architecture, or potential opportunities.

Location

Hyderabad

AI stack

claude code

gemini

github copilot

Work experience

Developer at Tata Consultancy Services, Aug 2021 - Present · 5 yrs 4 mos, - Designed and implemented ETL pipelines using Azure Data Factory to ingest data, reducing manual processing time. - Built and optimized Databricks notebooks using PySpark, improving pipeline runtime. - Developed data models and warehouse schemas in Azure Synapse Analytics to support reporting for business teams/stakeholders. - Automated data quality checks and validation rules across pipelines, reducing data errors/incidents. - Collaborated with data analysts/business teams to translate reporting requirements into reliable, production-grade data pipelines. - Migrated legacy on-prem ETL processes to Azure cloud architecture, improving scalability and reducing infrastructure costs.

Data Engineer at Tata Consultancy Services, 2021 - Present · 5 yrs 11 mos, Developed and executed SQL queries for data extraction, validation, troubleshooting, and business data analysis. Collaborated with stakeholders to gather requirements and ensure project alignment. Developed ADF pipelines to extract data from multiple source systems and load it into Azure environments. Designed ETL workflows for handling large datasets efficiently. Implemented incremental loading strategies to minimize processing time. Built and maintained Synapse data warehouse structures for analytics and reporting. Optimized ADF pipelines to improve data flow efficiency and adapt to changing business needs. Worked with structured datasets to identify data inconsistencies and ensure data quality across enterprise systems. Performed data investigation and root cause analysis for resolving production data issues. Supported deployment activities and production issue resolution with focus on data accuracy and pipeline stability. Monitored pipeline executions and resolved failures to ensure smooth production operations. Collaborated with application teams and stakeholders to gather requirements and implement solutions. Optimized SQL-based processes and improved operational efficiency through issue analysis and resolution. Maintained documentation for recurring issues, data validations, and technical workflows. Implemented data cleansing, transformation, and validation logic to ensure high data quality and consistency. Created reporting datasets for analytics use cases.

Education

Bachelor of Technology, Computational Science, Raghu Engineering College

Bachelor of Technology - BTech, Computer Science, Raghu Engineering College, Dakamarri Village, Bheemunipatnam Mandal,PIN-531162(CC-98)