Headline

Azure Data Engineer | Big Data | Azure Data Factory | Databricks | PySpark | Python | ETL | Data Engineering | Azure SQL | Synapse | Simplifying Complex Data Workflows

About

working as an Azure Data Engineer at Accenture with 4.5+ years of experience designing scalable ETL pipelines, cloud-native data platforms, and API-driven data solutions. I build enterprise-grade data engineering solutions using Azure Data Factory, Databricks, PySpark, Python, and Azure SQL to deliver reliable, high-performance analytics for large-scale business operations. Previously, I contributed to cross-cloud data migration, REST API modernization, and real-time data processing initiatives across Azure and AWS environments. My experience includes developing event-driven architectures, optimizing large datasets, implementing data quality frameworks, and improving reporting performance through automation. My core expertise includes Azure Data Factory, Databricks, PySpark, Python, SQL, FastAPI, Azure Functions, Azure Synapse Analytics, ADLS Gen2, Power BI, CI/CD, Delta Lake, and data modeling. I hold Microsoft Certified: Azure Fundamentals and AWS Certified Cloud Practitioner certifications, with hands-on experience in building secure, scalable, and governed data platforms. I enjoy solving complex data engineering challenges by transforming raw data into reliable business insights. I am passionate about building modern cloud data solutions that improve performance, enable informed decision-making, and deliver measurable business value across enterprise environments.

Location

Greater Bengaluru Area

AI stack

claude code

claude

github copilot

kiro

langgraph

ollama

Work experience

Azure Data Engineer at Accenture in India, Oct 2021 - Present · 5 yrs 2 mos, Bengaluru, Azure Data Engineer Analyst | Accenture Jan 2023 – Present Delivering enterprise-scale Azure data engineering solutions focused on scalable ETL pipelines, cloud-native architectures, and real-time data platforms. • Led architecture and optimization of 10+ ETL pipelines using Azure Data Factory and Databricks, improving scalability and reliability. • Designed serverless event-driven pipelines using Azure Functions and Logic Apps for near real-time processing. • Built analytics platforms processing 10M+ transactions/day, reducing reporting latency from 24 hours to under 5 minutes. • Implemented Medallion Architecture (Bronze, Silver, Gold) using Delta Lake for analytics-ready datasets. • Integrated Azure Synapse with ADF and Databricks to build a unified data platform. • Established CI/CD pipelines using Azure DevOps and GitHub Actions for streamlined deployments. • Optimized Azure SQL queries and indexing, improving performance by 35%. • Implemented data quality, governance, and monitoring using Azure Monitor. • Collaborated with cross-functional teams in Agile delivery to ensure timely releases. Azure Data Engineer Associate | Accenture Oct 2021 – Jan 2023 Built cloud-native data solutions focused on ETL modernization, cross-cloud integration, and large-scale processing. • Improved Databricks performance by 3x using partitioning, Z-ordering, and caching on 500TB+ datasets. • Built cross-cloud data pipelines between Azure ADLS and AWS S3 using Python. • Developed REST APIs using FastAPI and deployed on Kubernetes. • Created automated data quality and anomaly detection frameworks. • Built PySpark pipelines processing large-scale CSV, JSON, Parquet, XML, and Avro data. • Optimized Azure SQL queries and indexing for reporting workloads. • Supported data modeling and reporting automation initiatives.

Education

BTech - Bachelor of Technology, Electrical, Electronics and Communications Engineering, sree rama engineering collage

Bachelor of Technology, Electrical, Electronics and Communications Engineering, Sri Rama Engineering