Headline

Data Engineer | Generative AI Engineer @ Deloitte | Python • PySpark • SQL • AWS • Databricks • Snowflake | RAG, LLM & Vector Search | ETL Pipelines & Cloud Automation

About

I'm a Data Engineer and Generative AI Engineer with 4+ years at Deloitte, building production ETL pipelines and GenAI-powered applications across AWS, Databricks, Snowflake, and Azure OpenAI. On the data engineering side, I've delivered 20-30 ETL pipelines using Python and PySpark, cutting system downtime by 80% across enterprise environments. I've led legacy data migrations using SQL and IICS with zero data loss, and built cloud automation frameworks on AWS Lambda for resource auditing and cost optimization. On the Generative AI side, I've built and shipped a Retrieval-Augmented Generation (RAG) chatbot, an AI-powered document-to-XML conversion platform, and a Generative AI business glossary generator — containerized with Docker and deployed via CI/CD (GitHub Actions) to Azure Container Apps. These projects cut manual processing time by up to 70-80% while holding up to production-grade accuracy requirements. I like owning problems end-to-end — from pipeline design and data validation to deploying LLM-powered systems that work reliably in production, not just in a notebook. Core skills: Data Engineering | ETL/ELT Pipelines | Python | PySpark | SQL | AWS | AWS Lambda | Databricks | Snowflake | Azure OpenAI | Generative AI | RAG | LLM Applications | Vector Databases | Informatica | IICS | Docker | CI/CD | GitHub Actions | Data Migration | Data Governance

Location

Greater Kolkata Area

AI stack

anthropic apis

claude

codex

github copilot

grok

Work experience

Consultant at Deloitte, Jun 2025 - Present · 1 yr 5 mos, Hyderabad, Telangana, India, Spearheaded the implementation of advanced data engineering techniques to optimize data processing and analysis. Collaborated with cross-functional teams to design and deploy innovative AI solutions for predictive analytics. Conducted regular data audits to ensure compliance with industry regulations and best practices. Provided technical expertise and guidance to junior team members on data engineering and AI technologies. Utilized cloud technologies to streamline data storage and access for improved scalability and performance. Developed and implemented data governance policies to ensure data quality and security.

DC Analyst at Deloitte, Jun 2022 - May 2025 · 3 yrs, Hyderabad, Telangana, India, Spearheaded the design and development of end-to-end data pipelines, encompassing extraction, transformation, and loading (ETL) processes. Successfully implemented scalable solutions that significantly reduced data processing time. Implemented robust data quality checks within the pipelines, ensuring the integrity and accuracy of transformed data. Developed monitoring systems to proactively identify and address potential issues, contributing to data reliability. Continuously optimized existing data pipelines to enhance performance, scalability, and resource utilization. Employed best practices to minimize latency and improve overall system responsiveness.

Summer Intern at HighRadius, Jun 2021 - Dec 2021 · 7 mos, Bhubaneswar, Odisha, India, Building and enhancing automation suites for testing HighRadius Cloud Enterprise UI to figure out any bugs or anomalies

Quality Assurance Intern at HighRadius, Jun 2021 - Dec 2021 · 7 mos, Designed and maintained automation frameworks for the HighRadius Cloud Enterprise UI, improving test coverage and accelerating the detection of bugs and system inconsistencies.

Data Science and Business Analytic Intern at The Sparks Foundation, Apr 2021 - Apr 2021 · 1 mo

Crio Intern at Crio.Do, Jan 2021 - Feb 2021 · 2 mos

Student at Konnexions-KIIT, Oct 2019 - Nov 2019 · 2 mos, India, Calculator in android studio. Skills covered : Java and CSS I used various OOP techniques like class, objects and functions like buttons, widgets, view, edit text for the structure of the app Link to app video: https://drive.google.com/file/d/1Q_h3JL3j-lJiNbRf1UZ6jE6XfdogWttO/view?usp=sharing

Education

Bachelor's degree, Computer Science, Kalinga Institute of Industrial Technology, Bhubaneswar

High School Diploma, Sudhir Memorial Institute

Public links

github: https://github.com/snakeeyes007