Headline

Data Engineer @Tysonfoods

About

Data Engineer with 4+ years of experience building data pipelines and infrastructure across GCP and AWS. I've led DBT migrations, orchestrated workflows with Apache Airflow, and worked across Finance and HR data domains at scale. Core stack: DBT, Apache Airflow, Python, PostgreSQL, Amazon Redshift, GCP. Currently exploring cloud-native and AI/ML applications in data engineering. Always up for a good conversation about pipelines, architecture, or simply a chat.

Location

Greater Bengaluru Area

AI stack

antigravity

claude code

lovable

LiteLLM

Mistral Vibe

Supabase

Work experience

Data Engineer - II at Tyson Foods, May 2024 - Present · 2 yrs 5 mos, Greater Bengaluru Area, - Designed and implemented data ingestion pipelines using SnapLogic and Postman to efficiently load data into Google Cloud Platform (GCP) Data Lake, ensuring seamless data flow. - Authored comprehensive end-to-end process documentation, detailing data ingestion, transformation, and storage workflows to enhance team collaboration and maintain operational clarity. - Managed historical data loads into the GCP Data Lake, enabling robust datasets for downstream modeling and advanced data processing tasks. - Developed and optimized data models to support analytical and processing requirements using DBT, ensuring scalability and performance for data-driven applications.

Data Engineer at Encora Inc., Apr 2022 - Mar 2024 · 2 yrs, Bangalore Urban, Karnataka, India, - Developed, unit tested, and maintained robust data architecture, ensuring, reliability, and performance of data systems. - Aligned development efforts with client requirements, collaborating closely with stakeholders to understand their needs and translate them into technical solutions. - Managed and debugged issues arising from day-to-day operations of Apache Airflow, ensuring smooth and uninterrupted data workflows. - Hands-on development efforts on Airflow migration project. - Assumed responsibility for job execution in both production and non-production environments, guaranteeing the accurate and timely processing of data. - Collaborated with data scientists, analysts, and business stakeholders, to deliver data-driven solutions and optimize data processes. - Documented workflows enabling easy maintenance and knowledge transfer within the team. - Hands-on development on DBT migration

Education

Artificial Intelligence Professional, Artificial Intelligence, Defence Institute of Advanced Technology (DIAT), DU, DRDO

Bachelor of Engineering - BE, nitte meenakshi institute of technology

Public links

github: https://github.com/apjbasu01