Yagnik Patel profile photo 1 on Tal

Yagnik Patel

Solution Developer | DevOps Engineer | Data Engineer

Mumbai

4+ years of work experience

Tata Technologies
Aug 20223 yrs 9 mosPresent

Thane, Maharashtra, India

- Design, develop, and maintain scalable batch and real-time data pipelines using PySpark, with end-to-end orchestration, scheduling, and monitoring of complex workflows via Apache Airflow - Build robust ETL/ELT pipelines ingesting data from databases, APIs, and event streams, ensuring data quality, reliability, and performance - Work extensively with relational and search databases including OLAP/OLTP, MySQL, PostgreSQL, and Elasticsearch (ELK stack) for structured storage, fast search, analytics, and log monitoring - Design and implement CI/CD pipelines using Jenkins, Docker, and GitHub, enabling faster, secure, and automated deployments across environments - Develop web scraping and automated testing solutions using Python and Selenium for large-scale data collection and validation - Implement RPA-based alerting and automation using Power Automate, reducing issue resolution time by 30% through proactive incident detection - Troubleshoot and resolve Linux, DevOps, and infrastructure issues, leveraging shell scripting and automation for long-term, reliable fixes - Deploy and manage containerized applications using Docker in cloud-native environments - Collaborate with cross-functional teams to improve system reliability, scalability, and operational efficiency

Yagnik’s AI Stack

cursor
cursor
github copilot
github copilot
n8n
n8n
ollama
ollama

Education

Government Engineering College, Valsad

Bachelor of Engineering - BE, Civil Engineering

Government Engineering College, Valsad

20144 yrs2018

Join Yagnik and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Yagnik Patel on Tal

Headline

Solution Developer | DevOps Engineer | Data Engineer

About

Seeking a challenging opportunity to learn, innovate and enhance my coding skills and strengths in concurrence with company goals and objectives.

Location

Mumbai

AI stack

cursor

github copilot

n8n

ollama

Work experience

Solutions Developer at Tata Technologies, Aug 2022 - Present · 3 yrs 9 mos, Thane, Maharashtra, India, - Design, develop, and maintain scalable batch and real-time data pipelines using PySpark, with end-to-end orchestration, scheduling, and monitoring of complex workflows via Apache Airflow - Build robust ETL/ELT pipelines ingesting data from databases, APIs, and event streams, ensuring data quality, reliability, and performance - Work extensively with relational and search databases including OLAP/OLTP, MySQL, PostgreSQL, and Elasticsearch (ELK stack) for structured storage, fast search, analytics, and log monitoring - Design and implement CI/CD pipelines using Jenkins, Docker, and GitHub, enabling faster, secure, and automated deployments across environments - Develop web scraping and automated testing solutions using Python and Selenium for large-scale data collection and validation - Implement RPA-based alerting and automation using Power Automate, reducing issue resolution time by 30% through proactive incident detection - Troubleshoot and resolve Linux, DevOps, and infrastructure issues, leveraging shell scripting and automation for long-term, reliable fixes - Deploy and manage containerized applications using Docker in cloud-native environments - Collaborate with cross-functional teams to improve system reliability, scalability, and operational efficiency

Education

Bachelor of Engineering - BE, Civil Engineering, Government Engineering College, Valsad

Yagnik Patel - Solutions Developer in Mumbai | Tal