Headline

Azure Data Engineer | Databricks · ADF · ADLS · PySpark · Synapse | ETL Pipelines · Data Warehousing

About

I build data pipelines that actually hold up at scale. Over the past 3+ years as a Data Engineer at Riaktr, I've architected end-to-end Azure data platforms — designing Medallion Architecture (Bronze–Silver–Gold) on Azure Databricks, building ETL/ELT pipelines with Azure Data Factory and PySpark, and processing 5+ TB of telecom data daily with 99% reliability. What I care about: → Data that teams can trust — I built a quality framework that hit 99.8% accuracy and cut incidents by 85% → Pipelines that are maintainable — reusable datasets, schema evolution, SCD Type-2, CI/CD via Azure DevOps → Performance that scales — SQL tuning, partition pruning, broadcast joins, Iceberg time-travel I work across the full stack: ADLS Gen2 · Azure Synapse · Apache Iceberg · Delta Lake · Airflow · Spark · PostgreSQL · MongoDB Before moving into data engineering, I spent 7 years in software engineering and QA at Cognizant and Seamless Distribution Systems — which means I think about reliability, testing, and stakeholder communication as naturally as I think about pipelines. Currently open to remote Data Engineer roles where I can contribute to serious data platform challenges.

Location

Bengaluru

AI stack

ChatGPT

Work experience

Data Engineer at Riaktr, Oct 2022 - Mar 2026 · 3 yrs 6 mos, • Architected an enterprise-scale Medallion Architecture (Bronze–Silver–Gold) on Azure Databricks with PySpark, ADLS Gen2, and Delta Lake — processing 5+ TB of telecom data daily, replacing legacy ETL systems end-to-end. • Built and maintained CI/CD pipelines via Azure DevOps and Git; developed reusable ADF pipeline templates and modular PySpark components that cut development time across new data integration projects. • Engineered a Data Quality Framework (null checks, reconciliation, variance detection) achieving 99.8% data accuracy and reducing production incidents by 85%; enforced data governance, lineage, and privacy controls across all lakehouse layers. • Optimised query performance through SQL tuning, partition pruning, broadcast joins, and Iceberg time-travel — sustaining 99% pipeline reliability with real-time Synapse Pipelines monitoring and automated failure alerting.

Senior Software Engineer at Seamless Distribution Systems AB, Jun 2021 - Nov 2022 · 1 yr 6 mos, Kolkata, West Bengal, India, • Led a QA team of engineers, designing automation testing strategies and roadmaps for distributed system initiatives — managing multiple concurrent project priorities across technical and business stakeholders. • Deployed and operated the ELK Stack (Elasticsearch, Logstash, Kibana) for log aggregation, observability, and end-to-end pipeline monitoring across relational and NoSQL databases.

Software Engineer at Seamless Distribution Systems AB, Feb 2019 - Jun 2021 · 2 yrs 5 mos, Kolkata, West Bengal, India, Extensively used elasticsearch, logstash and Kibana and tested using ELK stack. Development of test automation framework using java, Junit, Maven. Writing selenium test cases. Unix VM set up for elasticsearch , logstash , kibana and other application components

Associate at Cognizant, Jun 2014 - Feb 2019 · 4 yrs 9 mos, Kolkata Area, India, • Developed and maintained test automation frameworks across multiple enterprise software engineering projects; managed full defect lifecycle and reporting in Jira with cross-functional stakeholder collaboration. • Conducted web service testing using SoapUI, validating XML/JSON request-response payloads against SQL-backed APIs to ensure data integrity and contract compliance.

Education

Bachelor’s Degree, Computer Science, St. Thomas' College of Engineering & Technology

High School, Science, BALLYGUNGE SHIKSHA SADAN