Headline

Data Engineer & ETL Engineer | Azure ADF & Databricks | SQL | PySpark | Enterprise Cloud Migration @Tata Consultancy Services|

About

Data Engineer (ETL) with 4 years of experience building scalable data pipelines on Azure. Improved data processing performance by optimizing PySpark jobs and ETL workflows. Experienced in migrating on-premise systems to ADLS Gen2 and developing robust data solutions in the banking domain. Proficient in PySpark, Databricks, Azure Data Factory, and SQL, with a strong focus on data quality. Experienced in data validation, reconciliation, workflow orchestration, and implementing data quality frameworks to ensure reliable and consistent data pipelines across enterprise platforms and Azure Data Lake Storage (ADLS Gen2).

Location

Hyderabad

Work experience

Engineer at Tata Consultancy Services, May 2022 - Present · 4 yrs 2 mos, Hyderabad, Data Engineer with 3.9+ years of experience working on scalable data pipelines, data ingestion, and large-scale data processing in Azure cloud environments. Proficient in Azure Data Factory, Databricks, PySpark, and SQL for building ETL/ELT workflows supporting data migration and transformation. Experienced in data validation, reconciliation, workflow orchestration, and implementing data quality frameworks to ensure reliable and consistent data pipelines across enterprise platforms and Azure Data Lake Storage (ADLS Gen2).

Education

Bachelor of Technology, Information Technology, CMR

sri chaitanya junior college