Headline

Aspiring Data Engineer | Azure Cloud Explorer | Passionate About Data Pipelines & Big Data Processing| Immediate joiner

About

Technology professional with experience in Application Support, ETL/Data Warehouse Testing, and Automation, now transitioning into Cloud Data Engineering with a focus on Azure platforms. I bring a strong background in data validation, production support, and automation, along with hands-on exposure to building and managing cloud-based data pipelines and orchestration workflows. My experience in ETL and Data Warehouse testing includes validating complex data transformation logic, source-to-target mappings, and data quality frameworks to ensure integrity across enterprise data platforms. I have worked closely with cross-functional teams in Agile environments to support data delivery pipelines, UAT cycles, and defect management, enabling reliable and high-quality releases. As part of my transition to cloud technologies, I have been actively working with Azure Data Factory (ADF) and Azure Databricks (ADB) to design and build scalable data pipelines, implement data orchestration workflows, and optimize data ingestion and transformation processes. My work includes building ADF pipelines for data integration, scheduling and orchestration of ETL workflows, and leveraging Databricks for distributed data processing and transformation. I am also focused on cloud data migration and modernization, supporting the movement of traditional ETL workloads and on-premise data pipelines into Azure-based data platforms. This includes optimizing pipeline performance, improving data processing efficiency, and enabling scalable analytics architectures. I’m passionate about building cloud-native data platforms, designing robust orchestration frameworks, and contributing to data engineering and cloud transformation initiatives that enable organizations to derive scalable and reliable insights from their data.

Location

Greater Hyderabad Area

AI stack

cursor

github copilot

langchain

notion

Work experience

Data Engineer at Wipro, Feb 2022 - Jan 2026 · 4 yrs, Hybrid, Client:TD BANK • Built scalable ETL/ELT pipelines using Azure Databricks, PySpark, and ADF to process large datasets • Developed incremental and metadata-driven pipelines with reusable components across Dev/UAT/Prod environments • Designed and optimized Delta Lake models (MERGE, SCD Type 1/2, OPTIMIZE, Z-ORDER) for performance and scalability • Orchestrated end-to-end workflows using ADF with dependency management and scheduling (event/time-based triggers) • Performed Spark optimization (partitioning, broadcast joins, caching, DAG analysis), reducing job runtime by up to 50% • Implemented data validation, logging, and monitoring frameworks to ensure data quality and reliability • Designed end-to-end CI/CD pipelines using Azure Pipelines for automated build and deployment of Databricks notebooks and ADF pipelines • Created multi-stage YAML pipelines with stages for build, test, and deployment across Dev, QA, and Prod • Implemented pipeline triggers (CI/CD) based on code commits and pull requests in Azure Repos • Used branching strategies (feature, develop, main) with pull request validations and code reviews • Configured environment-based deployments using variable groups and parameterized templates • Integrated Azure Key Vault for secure management of secrets and credentials in pipelines • Enabled artifact versioning using Azure Artifacts for consistent and reusable deployments • Built reusable pipeline templates to standardize deployment across multiple projects • Implemented approval gates and release controls to ensure safe production deployments • Deployed ADF pipelines using ARM templates / JSON exports through CI/CD workflows • Configured rollback strategies for failed deployments to maintain system stability • Optimized pipeline performance by parallel execution and stage-level optimizations • Managed service connections and RBAC roles for secure access between Azure DevOps and Azure resources

ETL Tester at Wipro, Jun 2019 - Nov 2021 · 2 yrs 6 mos, Chennai, Client: Optus * Designed comprehensive test cases based on ETL specifications, ensuring full validation of transformation logic, data quality rules, and exception handling within Data Warehouse pipelines. • Performed end-to-end ETL/DWH testing including source-to-target validation, data reconciliation, and transformation rule verification using structured test scenarios. • Managed test execution and defect lifecycle using ALM, including test case uploads, execution tracking, and defect logging for failed scenarios. • Possess strong knowledge of the Software Testing Life Cycle (STLC) and Defect Management processes, ensuring structured quality assurance practices. • Demonstrated working knowledge of Informatica PowerCenter and ETL workflows, supporting validation of data integration pipelines. • Contributed to Agile delivery by actively participating in sprint planning, daily stand-ups, and retrospectives to ensure timely release cycles. • Supported UAT cycles by preparing validation scenarios, tracking defects, and collaborating with stakeholders to ensure successful product releases. • Performed data analysis on large datasets to support business insights and developed dashboards for improved decision visibility. • Implemented automation testing using Selenium with Java/Python, developing automated regression and functional test suites integrated with CI pipelines using JUnit/TestNG and Jenkins. • Conducted cross-browser and environment validation to ensure application reliability and consistent performance across platforms.

Education

Bachelor of Technology - BTech, Computer Science, Aditya University