Headline

Data Engineer | Spark | Python | SQL | DBT | S3 | Glue | BigQuery

About

My expertise lies in creating robust data pipelines. As a Data Engineer, I thrive on transforming complex data into strategic assets that propel organizational growth.

Location

Mysuru

AI stack

claude

gemini

ChatGPT

Microsoft Copilot

Work experience

Pyspark Developer at PURVIEW, Jul 2024 - Aug 2026 · 2 y 1 mo, Remote, • Built data transformation logic and business rules with dbt on BigQuery in batch processing pipelines, enabling a finance reporting dashboard that identifies tax incentives for green energy initiatives across Europe.

Software Engineer - Analytics at LogiNext, Mar 2023 - Jul 2024 · 1 yr 5 mos, Mumbai, Maharashtra, India, - Developed APIs using Django to enable seamless integration of the machine learning algorithm for driver assignment. - Created data pipelines to efficiently extract and transform large volumes of data from MongoDB, facilitating smoother data processing and storage on Google Cloud platform. - Utilized Apache Spark for data processing, enabling comprehensive analytics and insights into large datasets. - Leveraged Apache Drill to perform flexible and efficient queries on data stored in Google Cloud bucket, supporting in-depth analysis and reporting. - Implemented data replication in MySQL to enhance database performance and scalability, effectively managing increased data load without compromising data integrity.

Software Engineer at Delixus, Inc., Feb 2020 - Feb 2023 · 3 yrs 1 mo, Greater Bengaluru Area, - Implemented ETL project for data from different vendors using Apache Spark, AWS S3, Dataframes, and MySQL - Utilized AWS EMR for big data processing, reducing processing time by 25%. - Contributed to the open-source python library pyTenable, enhancing its functionality for seamless integration with Tenable's platform APIs.

Education

Post Graduate Diploma, Big data, CDAC Bangalore

Msc, Statistics, University of Mysore