Headline

Data Engineer | Databricks | PySpark | SQL | Airflow | Big Data

Location

Bengaluru

AI stack

gemini

kimi

openai

Work experience

Data Engineer at GENPACT, Oct 2024 - Present · 2 yrs 2 mos, Bengaluru, Karnataka, India, • Migrated 200+ enterprise datasets from PostgreSQL to Databricks (Delta Lake), improving data accessibility and scalability. • Built and maintained PySpark-based ETL pipelines, enabling efficient large-scale data processing and transformation. • Orchestrated 15+ production workflows using Apache Airflow, reducing manual effort by 90% and improving data reliability. • Optimized Spark jobs through partitioning, caching, and cluster tuning, reducing execution time by 35% and infrastructure cost by 20%. • Implemented data quality checks and monitoring mechanisms, ensuring high data integrity and pipeline reliability. • Wrote complex SQL queries for data extraction, transformation, and business reporting, enabling data-driven decision-making. • Collaborated with cross-functional teams to gather requirements and deliver scalable data solutions.

Data Science Intern at GENPACT, Feb 2024 - Aug 2024 · 7 mos, Bengaluru, Karnataka, India

Education

Bachelor of Technology - BTech, Computer Science, Thapar Institute of Engineering & Technology

Bachelor of Engineering, Computational Science, Thapar Institute of Engineering & Technology