Pawan Panchal profile photo 1 on Tal

Pawan Panchal

Python, Pyspark, SQL, AWS Cloud, Gen AI || AWS Data Engineer || Cloud Engineer || AWS Developer

India

5+ years of work experience

Tata Consultancy Services
Dec 20214 yrs 8 mosPresent

Banglore

Built scalable ETL pipelines using AWS Glue & PySpark processing 10GB+ data daily into Redshift Designed event-driven pipelines using Lambda, SQS & Step Functions — reduced manual effort by 70% Developed data lake architecture on S3 with Glue Data Catalog & Athena for ad-hoc querying Implemented PySpark batch jobs on EMR processing 5M+ records — reduced processing time by 50% Deployed Kafka-based streaming pipelines for real-time data ingestion into Redshift & S3 Managed IAM roles & cross-account access across 120+ AWS accounts for governance & compliance Built Grafana dashboards for real-time pipeline monitoring & proactive alerting
Entourage Infotech
Jun 20202 mosJul 2020

1 months Internship in Web Development from Entourage Infotech., Developed a project named Event Registration Portal (ERP) during training.
Internshala
Dec 20194 mosMar 2020

* Define, create, manage the development of content & technical documents, & help developers get started. * Identify, create and post developer topics, blogs, tips, etc. to drive engagement.

Education

Bachelor of Technology - BTech, Computer Science

Student at University Institute of Technology, RGPV

20174 yrs2021

Join Pawan and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Pawan Panchal on Tal

Headline

Python, Pyspark, SQL, AWS Cloud, Gen AI || AWS Data Engineer || Cloud Engineer || AWS Developer

About

Empowering Communities via Development and Education.

Location

India

Work experience

Software Engineer at Tata Consultancy Services, Dec 2021 - Present · 4 yrs 8 mos, Banglore, Built scalable ETL pipelines using AWS Glue & PySpark processing 10GB+ data daily into Redshift Designed event-driven pipelines using Lambda, SQS & Step Functions — reduced manual effort by 70% Developed data lake architecture on S3 with Glue Data Catalog & Athena for ad-hoc querying Implemented PySpark batch jobs on EMR processing 5M+ records — reduced processing time by 50% Deployed Kafka-based streaming pipelines for real-time data ingestion into Redshift & S3 Managed IAM roles & cross-account access across 120+ AWS accounts for governance & compliance Built Grafana dashboards for real-time pipeline monitoring & proactive alerting

Web Development Intern at Entourage Infotech, Jun 2020 - Jul 2020 · 2 mos, 1 months Internship in Web Development from Entourage Infotech., Developed a project named Event Registration Portal (ERP) during training.

Developer Advocate at Internshala, Dec 2019 - Mar 2020 · 4 mos, * Define, create, manage the development of content & technical documents, & help developers get started. * Identify, create and post developer topics, blogs, tips, etc. to drive engagement.

Education

Bachelor of Technology - BTech, Computer Science, Student at University Institute of Technology, RGPV

Pawan Panchal - Software Engineer in India | Tal