Headline

Data Engineer | PySpark, SQL, Snowflake, AWS (Glue, Redshift) | BFSI & Regulatory Reporting | Open to Opportunities

About

Data Engineer with 2+ years of production experience building ETL pipelines and regulatory reporting solutions in the BFSI space. I work primarily with PySpark, SQL/PL-SQL, Snowflake, Informatica, and AWS (Glue, Redshift, S3, Lambda), with a focus on making large-scale data workflows faster, more reliable, and audit-ready. Some things I've shipped: Optimized a critical SQL process from 5 hours down to ~20 minutes (93% reduction), unblocking downstream regulatory reporting deadlines Cut a PySpark job's runtime from 1.5 hours to 30 minutes through partitioning and join optimization Designed a Bronze-Silver-Gold data lake architecture on S3 with SCD Type-2 handling for historical tracking Built a personal project combining Kafka and PySpark Structured Streaming to explore real-time data processing patterns Worked extensively on regulatory line-item pipelines, debugging complex join logic, null handling, and cross-source key reconciliation across multiple banking source systems I'm currently exploring new opportunities in data engineering, particularly roles that combine strong AWS/cloud infrastructure with meaningful technical depth in Spark and SQL. Open to connecting.

Location

Thane

AI stack

claude

codex

cursor

gemini

openai

Work experience

Consultant 1 at FINTELLIX, Mar 2025 - Aug 2026 · 1 y 5 mo, Mumbai, - Built and maintained production PySpark pipelines for regulatory reporting, processing financial data across multiple upstream source systems - Reduced a critical SQL query's runtime by 93% (5 hours → ~20 minutes), directly improving regulatory reporting turnaround - Optimized a PySpark job's execution time by 66% (1.5 hours → 30 minutes) through improved partitioning and join strategy - Debugged and resolved complex data quality issues in production pipelines, including join key construction mismatches, null handling edge cases, and deduplication logic in lookup processes - Designed a Bronze-Silver-Gold S3 data lake architecture with SCD Type-2 implementation for historical data tracking - Worked with Apache Airflow for pipeline orchestration and Kafka for streaming data ingestion - Collaborated cross-functionally on data pipelines spanning Oracle, Snowflake, and AWS (S3, Glue, Redshift, Lambda)

Associate Consultant at FINTELLIX, Jul 2024 - Mar 2025 · 9 mos, Mumbai, Maharashtra, India

Student Intern at Hybrid Utopia, Jun 2022 - Sep 2022 · 4 mos

Education

B. Tech CSE, Computational Science, amity University

Bachelor of Technology, Computational Science, Amity University Mumbai