Headline

Principal Data Engineer | Data Engineering Mentor | SQL, Snowflake, dbt, Airflow, PySpark, Python

About

I am a Principal Data Engineer with experience across the full data engineering lifecycle, including requirement analysis, solution design, development, deployment, and production support. Over the years, I have worked with multiple data engineering technologies and platforms across SQL-based systems, cloud environments, big-data ecosystems, and modern data platforms. My hands-on experience includes technologies such as SQL, PL/SQL, PySpark, Snowflake, AWS, Databricks, Hadoop, and Hive. I am also passionate about teaching and mentoring professionals in data engineering. I focus on making complex concepts easier to understand through business scenarios, visual explanations, practical demonstrations, and end-to-end projects. I regularly explore and teach topics such as SQL, data warehousing, ETL/ELT, Snowflake, dbt, Airflow, PySpark, cloud data platforms, and big-data fundamentals. My goal is to continue growing as a hands-on data engineering professional while helping others build practical, industry-relevant skills. Data Engineering | SQL | PySpark | Snowflake | AWS | Databricks | ETL/ELT | Data Warehousing | Big Data | Instructor and Mentor

Location

Greater Bengaluru Area

AI stack

claude code

claude

elevenlabs

grok

Work experience

Data Engineering Mentor & Instructor at Bosscoder Academy, Apr 2026 - Present · 6 mos, Bengaluru, Deliver part-time instruction and mentoring to professionals building practical data engineering skills. • Teach SQL, data warehousing, ETL/ELT, PySpark, Snowflake, dbt, Airflow, and related data engineering concepts. • Use business scenarios, visual explanations, live demonstrations, and hands-on exercises to simplify complex topics. • Support learners with problem-solving, debugging, interview preparation, and practical implementation. • Adapt sessions for learners across different experience levels. • Consistently maintain an average learner rating of 4.6+/5.

Associate at JPMorgan Chase & Co., Feb 2017 - Present · 9 yrs 8 mos, Bengaluru, Karnataka, India, • Cloud Transformation: Leading the end-to-end migration of legacy data warehouses to Snowflake, AWS Athena, and Azure • PySpark Pipeline Engineering: Architecting and developing complex, scalable data pipelines using PySpark and Python to process datasets within the Digital Team's data warehouse • Advanced Analytics: Developed an in-house Python/PySpark ETL Framework used across the Digital Team to handle large datasets. • Automated CI/CD: Streamlined deployment cycles by implementing robust CI/CD pipelines using Jenkins and Jules, ensuring high pipeline reliability. • Infrastructure Optimization: Created an automated S3-based archival solution to reduce redundant storage costs and performed deep performance tuning on Hadoop and Cloud clusters.

Data Engineer at J.P. Morgan, Feb 2017 - Present · 9 yrs 8 mos, Key Deliverables: · Cloud Transformation & Team Leadership: Spearheaded a technical team of 4 to lead the end-to-end migration of legacy data warehouses to Snowflake and AWS, including Snowpipe-based automated ingestion; mentored junior engineers on optimizing complex SQL scripts to ensure seamless logic parity and warehouse performance during migration. · PySpark Pipeline Engineering: Architecting and developing complex, scalable data pipelines using PySpark and Python to process datasets within the Digital Team's data warehouse leveraging Gen AI Tools (copilot) for scaffolding and documentation. · Data Pipeline : Architecting scalable ETL/ELT workflows using Apache Airflow, Azure Data Factory (ADF), implementing triggers for complex dependency management. · Modern Data Stack (MDS): Designing curated staging, integration, and semantic data layers using dbt and Google BigQuery, applying dimensional (Kimball) modeling principles to enable modular, version-controlled, analytics-ready data models. · Advanced Analytics: Developed an in-house Python/PySpark ETL Framework used across the Digital Team to handle multi-terabyte datasets. · Automated CI/CD: Streamlined deployment cycles by implementing robust CI/CD pipelines using Jenkins and Jules, ensuring high pipeline reliability. · Infrastructure Optimization: Engineered a Python-based automation suite for S3 lifecycle management and data to reduce redundant storage costs and performed deep performance tuning on Hadoop and Cloud clusters.

Assistant Technical Delivery Manager at Accolite, Sep 2015 - Jan 2017 · 1 yr 5 mos, Bengaluru, Karnataka, India, delivery manager for data warehousing environment in Morgan Stanley

Technical Project Manager at Accolite India, Sep 2015 - Jan 2017 · 1 yr 5 mos, Key Deliverables: · Data Warehouse Engineering: Directed IBM DB2 data warehouse initiatives for Morgan Stanley, developing complex ETL objects, Unix shell scripts, and Autosys-scheduled workflows to manage large-scale data volumes with a focus on performance tuning and optimization. · Delivery & Operations: Operated as a high-level individual contributor within Agile SDLC, translating business requirements into scalable solutions while providing critical production support to maintain pipeline stability and uptime.

Education

B.Tech, Electrical and Electronics, Dr.Mgr university

SSC, Vidyasagar