Headline

Sr. Data Engineer | | Databricks | PySpark | SQL | GenAI | Airflow | ETL

About

Senior Data Engineer | Databricks | PySpark | Apache Spark | SQL | AWS | Azure | Airflow | Delta Lake | Data Engineering | Airflow Senior Data Engineer with 5+ years of experience designing and building scalable data platforms and production-grade data pipelines across AWS and Azure. My core expertise includes Databricks, PySpark, Apache Spark, SQL, Delta Lake, Airflow and cloud data engineering. Currently working at Version 1, where I build Databricks-based data platforms and work on large-scale ingestion, transformation, data quality, governance and automation solutions.

Location

Bengaluru

AI stack

claude code

codex

cursor

github copilot

openai

Work experience

Senior Data Engineer at Version 1, Mar 2026 - Present · 7 mos, Bengaluru, Karnataka, India, • Developed a robust Data Platform in Databricks utilizing a medallion architecture to streamline data processing. • Extracted data from on-prem SQL Server, enhancing data accessibility and integration. • Implemented Role-Based Access Control (RBAC) for catalogs and schemas, ensuring data security and compliance. • Managed infrastructure through Terraform and GitHub Actions, promoting efficient deployment and version control.

Data Engineer at Evernorth Health Services, Sep 2024 - Feb 2026 · 1 yr 6 mos, Hyderabad, Telangana, India, Big data processing for specialty pharmacy reporting by applying business logic and transforming data using medallion architecture through ETL pipelines using databricks deploying through terraform. Building Chatbot for existing applications.

Associate Data Engineer at Anblicks, Feb 2023 - Sep 2024 · 1 yr 8 mos, Hyderabad, Telangana, India, Creating data feeds for marketing campaigns/ customer identification and downstream ML applications. Big data processing using Azure Databricks and Airflow. Migrated data across organization from Azure Gen1 storage to Gen2 storage.

Big Data Developer at Cognizant, Apr 2021 - Jan 2023 · 1 yr 10 mos, External employee at Credit Suisse. Processing data by writing codes in Java spark using git for version control. For querying database and creating new tables using hive and Impala. for job scheduling using control-m. I write codes and play with json and XML files.

Education

Bachelor of Technology, Computer Science engineering, CHANDIGARH UNIVERSITY