Varun Kota profile photo 1 on Tal

Varun Kota

GCP Data Engineer | BigQuery | Cloud Composer (Airflow) | Dataflow | Dataproc | PySpark | Python | SQL | 5+ Years

Hyderabad

Varun’s AI Stack

gemini
gemini
openai
openai

Education

Hindustan University

Bachelor of Engineering - BE, Mechanical Engineering

Hindustan University

20134 yrs2017

Intermediate, MPC

Nri junior college

20112 yrs2013

Join Varun and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Varun Kota on Tal

Headline

GCP Data Engineer | BigQuery | Cloud Composer (Airflow) | Dataflow | Dataproc | PySpark | Python | SQL | 5+ Years

About

I’m a GCP Data Engineer with 5+ years of experience building and optimizing scalable, cloud-native data platforms for retail and automotive domains. I specialize in designing high-performance ELT/ETL pipelines using BigQuery, Cloud Composer (Airflow), Dataflow, Dataproc (PySpark), and Cloud Storage, enabling reliable analytics across staging, historical, and curated data layers. In my recent work, I’ve: • Improved BigQuery performance by using partitioning, clustering, and SQL optimization • Developed robust data quality and audit frameworks, ensuring pipeline reliability I work extensively with SQL, Python, and PySpark for data transformation and automation, and leverage Airflow for orchestration and CI/CD tools like Git, Cloud Build for reliable deployments. I enjoy solving complex data problems, optimizing pipelines for performance and cost, and collaborating with cross-functional teams to deliver scalable, production-grade data solutions.

Location

Hyderabad

AI stack

gemini

openai

Education

Bachelor of Engineering - BE, Mechanical Engineering, Hindustan University

Intermediate, MPC, Nri junior college

Varun Kota - GCP Data Engineer | BigQuery | Cloud Composer (Airflow) | Dataflow | Dataproc | PySpark | Python | SQL | 5+ Years in Hyderabad | Tal