Md Manawar Iqbal profile photo 1 on Tal

Md Manawar Iqbal

Azure Data Engineer | Azure Data Factory | Databricks (PySpark) | ADLS Gen2 | Synapse | Delta Lake | ETL / ELT | CI/CD | Terraform

Greater Delhi Area

4+ years of work experience

HCLTech
Oct 20241 yr 7 mosPresent

Noida, Uttar Pradesh, India

• Designed and delivered enterprise-grade ETL and ELT pipelines using Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Azure Synapse Analytics for datasets exceeding 5 TB per month. • Implemented Delta Lake bronze, silver, and gold architecture, improving query performance by approximately 40 percent. • Developed optimized PySpark transformations for large-scale distributed workloads and improved cluster cost efficiency. • Integrated Azure Event Hub and Azure Stream Analytics for near real-time ingestion of transactional events. • Implemented data quality validation using Great Expectations and custom Python-based frameworks. • Built CI/CD pipelines using Azure DevOps for Azure Data Factory, Databricks notebooks, and infrastructure as code deployments. • Developed reusable Terraform modules for provisioning Azure resources across multiple environments.
HCLTech
Sep 20222 yrs 4 mosDec 2024

Noida, Uttar Pradesh, India

• Designed and delivered enterprise-grade ETL and ELT pipelines using Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Azure Synapse Analytics for datasets exceeding 5 TB per month. • Implemented Delta Lake bronze, silver, and gold architecture, improving query performance by approximately 40 percent. • Developed optimized PySpark transformations for large-scale distributed workloads and improved cluster cost efficiency. • Integrated Azure Event Hub and Azure Stream Analytics for near real-time ingestion of transactional events. • Implemented data quality validation using Great Expectations and custom Python-based frameworks. • Built CI/CD pipelines using Azure DevOps for Azure Data Factory, Databricks notebooks, and infrastructure as code deployments. • Developed reusable Terraform modules for provisioning Azure resources across multiple environments.
HCLTech
Apr 20223 mosJun 2022

Saathi Pads
Sep 20213 mosNov 2021

Help to build the company website pages using HTML,CSS and JavaScript. responsibilities also include how to make the website seo friendly. Research on keywords which can make the website seo friendly.

Education

Jamia Millia Islamia

Master of Business Administration - MBA

Jamia Millia Islamia

Cooch Behar Government Engineering College

B.tech, Computer Science

Cooch Behar Government Engineering College

20184 yrs2022

Join Md and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Md Manawar Iqbal on Tal

Headline

Azure Data Engineer | Azure Data Factory | Databricks (PySpark) | ADLS Gen2 | Synapse | Delta Lake | ETL / ELT | CI/CD | Terraform

About

Azure Data Engineer with 3 years of hands-on experience designing, building, and optimizing scalable data engineering solutions on Microsoft Azure. I specialize in building end-to-end ETL and ELT pipelines using Azure Data Factory, Azure Databricks (PySpark), Azure Data Lake Storage Gen2, and Azure Synapse Analytics. I have worked on high-volume data platforms (5+ TB monthly ingestion) and implemented Delta Lake architectures for reliable and high-performance analytics. Core expertise: • Azure Data Factory – pipeline orchestration, triggers, monitoring • Azure Databricks – PySpark, performance optimization, Delta Lake • Azure Data Lake Storage Gen2 – scalable data storage • Azure Synapse Analytics – analytics and reporting • Streaming – Azure Event Hub, Azure Stream Analytics • CI/CD – Azure DevOps, GitHub Actions • Infrastructure as Code – Terraform, Bicep I enjoy working on data platforms that are production-ready, cost-optimized, and scalable. Open to Azure Data Engineer opportunities where I can solve real-world data problems and grow further in cloud data engineering.

Location

Greater Delhi Area

Work experience

Software Engineer at HCLTech, Oct 2024 - Present · 1 yr 7 mos, Noida, Uttar Pradesh, India, • Designed and delivered enterprise-grade ETL and ELT pipelines using Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Azure Synapse Analytics for datasets exceeding 5 TB per month. • Implemented Delta Lake bronze, silver, and gold architecture, improving query performance by approximately 40 percent. • Developed optimized PySpark transformations for large-scale distributed workloads and improved cluster cost efficiency. • Integrated Azure Event Hub and Azure Stream Analytics for near real-time ingestion of transactional events. • Implemented data quality validation using Great Expectations and custom Python-based frameworks. • Built CI/CD pipelines using Azure DevOps for Azure Data Factory, Databricks notebooks, and infrastructure as code deployments. • Developed reusable Terraform modules for provisioning Azure resources across multiple environments.

Graduate Engineering Trainee at HCLTech, Sep 2022 - Dec 2024 · 2 yrs 4 mos, Noida, Uttar Pradesh, India, • Designed and delivered enterprise-grade ETL and ELT pipelines using Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Azure Synapse Analytics for datasets exceeding 5 TB per month. • Implemented Delta Lake bronze, silver, and gold architecture, improving query performance by approximately 40 percent. • Developed optimized PySpark transformations for large-scale distributed workloads and improved cluster cost efficiency. • Integrated Azure Event Hub and Azure Stream Analytics for near real-time ingestion of transactional events. • Implemented data quality validation using Great Expectations and custom Python-based frameworks. • Built CI/CD pipelines using Azure DevOps for Azure Data Factory, Databricks notebooks, and infrastructure as code deployments. • Developed reusable Terraform modules for provisioning Azure resources across multiple environments.

Java Programmer at HCLTech, Apr 2022 - Jun 2022 · 3 mos

Web Developer at Saathi Pads, Sep 2021 - Nov 2021 · 3 mos, Help to build the company website pages using HTML,CSS and JavaScript. responsibilities also include how to make the website seo friendly. Research on keywords which can make the website seo friendly.

Education

Master of Business Administration - MBA, Jamia Millia Islamia

B.tech, Computer Science, Cooch Behar Government Engineering College