Shyam Kumar B. on Tal
Headline
Data Engineer | Microsoft Fabric, Synapse & Databricks, Oracle Data Integrator | ADF, Python, Pyspark, SQL, Power BI | 2x Microsoft Certified (DP-700 & DP-600)
About
I am a Data Engineer specializing in architecting scalable cloud data platforms and executing complex, enterprise-scale legacy-to-cloud migrations. Currently Microsoft Certified (DP-700) in the Fabric ecosystem, I focus on bridging the gap between distributed raw data and automated, high-performance business intelligence. My engineering journey began in traditional data warehousing and ETL with Oracle Data Integrator (ODI), giving me a deep, foundational understanding of enterprise data movement. Today, I leverage that foundation to design modern Medallion architectures utilizing Microsoft Fabric, Azure Synapse, Databricks, and Python. I don't just build pipelines; I engineer systems for performance, reliability, and business impact. In my current role, I am executing a massive multi-source migration—ingesting over 3,800 tables from 8 distinct ERP, HR, and CRM systems into a unified Fabric Bronze layer. Key Engineering Wins: Performance Optimization: Slashed a business-critical 24-hour full-load processing time down to 11 hours through rigorous query optimization and architectural tuning. Custom Solutions: Engineered high-throughput Python pipelines to bypass legacy bottlenecks during massive historical data loads, and partnered with Product Engineering to build a custom Data Enhancement Application (DEA) for late-arriving data. Automation: Built dynamic Power BI frameworks from scratch to automate complex monthly and quarterly financial reconciliation reporting. Beyond hands-on architecture, I am deeply invested in engineering culture. I recently spearheaded the development of a metadata-driven lineage tool during a COE Hackathon to map complex Azure data flows, and I actively mentor a team of 10 junior engineers to elevate our overall data warehousing standards. Core Tech Stack: Microsoft Fabric | Azure Synapse Analytics | Databricks | Python (PySpark) | SQL | Azure Data Factory (ADF) | Power BI | Oracle Data Integrator (ODI)
Work experience
Softwar Engineer 3 - Data & Analytics at Praval, Jul 2026 - Present · 5 mos, Hyderabad, Telangana, India
Software Engineer 2 - Data & Analytics at Praval, Jul 2025 - Jun 2026 · 1 yr, Hyderabad, Telangana, India, • Designed and maintained Azure Synapse data pipelines supporting monthly and quarterly stock information releases, ensuring high data accuracy under strict reporting timelines. • Performed detailed data reconciliation across source and warehouse systems to validate financial datasets prior to reporting cycles. • Collaborated with Product teams on enhancements to the DEA (Data Enhancement Application) tool to handle late-arriving data and last-minute reporting updates. • Automated end-to-end regional data processing workflows, eliminating manual Excel-based reporting and significantly reducing operational effort. • Reduced ODI full load processing time from 20 hours to 8 hours (~60% improvement) by optimizing transformations and load strategies. • Designed reusable data warehousing pipelines and integrated additional data sources to support evolving business requirements. • Provided production support and resolved data discrepancies during critical reporting windows.
Software Engineer 1 - Data & Analytics at Praval, Jul 2024 - Jun 2025 · 1 yr, Hyderabad, Telangana, India
Junior Software Developer - Data & Analytics at Technovert, Nov 2022 - Jun 2023 · 8 mos
Data Engineer Intern at Technovert, May 2022 - Oct 2022 · 6 mos
Education
Bachelor of Engineering - BE, Computer Science, MVSR Engineering College
Product management Launchpad, Airtribe
