Headline

Serving Notice Period |Azure Data Engineer | ADF | DATABRICKS | ADLS GEN2 | PYSPARK | SQL | ETL/ELT | DELTA LAKE | C# | SSIS | HEALTHCARE |

About

Data Engineer | Azure | Databricks | PySpark | ETL/ELT Data Engineer with nearly 3 years of experience designing and optimizing scalable data pipelines and cloud-native solutions on Microsoft Azure. I specialize in: • Azure Data Factory (ADF) and SSIS-to-ADF cloud migrations • Azure Databricks & PySpark for large-scale data processing • Delta Lake and Medallion Architecture (Bronze, Silver, Gold) • End-to-end ETL/ELT pipeline development and orchestration • Azure Synapse Analytics, ADLS Gen2, and Data Warehousing • CI/CD, Data Quality, Monitoring, and Automation Recent Achievements: → Migrated 20+ SSIS packages to Azure Data Factory, reducing pipeline execution time by 35% → Built and optimized PySpark pipelines processing 50–100 GB of data daily → Designed Bronze-Silver-Gold data architecture using Delta Lake and Databricks → Automated monitoring and alerting using Azure Monitor and Logic Apps → Implemented SCD Type 1 & Type 2 solutions for enterprise reporting and analytics Tech Stack: Azure Data Factory | Azure Databricks | PySpark | Python | SQL | Azure Synapse | ADLS Gen2 | Delta Lake | Microsoft Fabric | Apache Spark | Git | Docker | Kafka Currently working as a Data Engineer at Infinite Computer Solutions, Hyderabad. 📧 satyamkjaiswal9721@gmail.com 🚀 Open to Data Engineer opportunities across Bengaluru, Hyderabad, Noida, Gurugram, and other major tech hubs.

Location

Hyderabad

AI stack

antigravity

claude code

codex

gemini

github copilot

Work experience

Data Engineer at Infinite Computer Solutions, Feb 2024 - Present · 2 yrs 7 mos, Hyderabad, • Migrated 20+ SSIS packages to Azure Data Factory, reducing pipeline execution time by 35% and enabling automated error handling with proactive Azure Monitor alerts for high-volume production data streams. • Designed and optimized end-to-end ETL/ELT pipelines in Azure Data Factory (ADF) to ingest data from on-premises SQL Server into Azure Data Lake Storage (ADLS), enabling scalable and reliable data integration for analytics and reporting across multiple business units. • Built and deployed PySpark transformation workflows on Azure Databricks, processing 50 to 100 GB of structured and semi-structured data daily while implementing data quality checks, validation rules, and incremental loads. • Implemented Delta Lake with ACID transactions, schema evolution, and time travel; maintained pipeline documentation and data store schemas for cross-functional team reference. • Designed SCD Type 1 and Type 2 dimension logic using PySpark and Delta Lake with surrogate keys and effective date ranges; collaborated with analytics and ML teams to deploy pipelines into production. • Integrated Azure Logic Apps with ADF for automated notifications; applied CI/CD practices via Git to streamline pipeline deployments and ensure adherence to best practices.

Android Developer at GearToCare, Sep 2022 - Dec 2022 · 4 mos

Education

Bachelor of Technology, Computer Engineering, BABU BANARASI DAS NORTHERN INDIA INSTITUTE OF TECHNOLOGY, LUCKNOW