Headline

Data Engineer | Python | Snowflake | AWS | Airflow | Data & AI | GenAI & RAG | FastAPI

About

I am a Data Engineer & Python Backend Developer with 5+ years of experience building large-scale ETL pipelines, high-performance APIs, serverless workflows, and analytics platforms across healthcare, mining, and financial domains. At TCS, I engineered a metadata-driven SAP HANA → Snowflake ETL framework using Airflow Dynamic DAGs, SCD-2 processing, and optimized MERGE patterns — replacing Matillion and enabling ~60% reduction in cost and zero manual onboarding. I also built an enterprise-grade Streamlit analytics app with Snowflake RBAC and a serverless PDF reporting pipeline using Lambda, API Gateway, and External Functions. Previously at Cognizant, I developed high-throughput FastAPI services, optimized SQL processing, and introduced Redis caching to reduce API latency by 30–40%. My experience spans: ✔ Scalable ETL & data ingestion frameworks ✔ Distributed API design with Python + FastAPI ✔ Serverless solutions on AWS (Lambda, API Gateway, S3, ECR) ✔ High-volume SQL optimization & schema engineering ✔ Real-time dashboards and workflow automation I’m passionate about building reliable data systems, performance-driven backend services, and integrating AI into modern data pipelines. Always open to challenging roles in Data Engineering, Backend Engineering, Analytics Platform Engineering, and ML/AI-driven Data Systems.

Location

Ghaziabad

AI stack

codex

github copilot

openai

githubcopilot

Work experience

Python Data Engineer at Tata Consultancy Services, Mar 2025 - Present · 1 yr 7 mos, Noida, Uttar Pradesh, India, Python Data Engineer | TCS Mar 2025 – Present Designed a metadata-driven ETL pipeline to ingest 274+ SAP HANA tables into Snowflake using Airflow Dynamic DAGs. Implemented SCD Type-2, delta loads & soft-delete logic with optimized Snowflake MERGE patterns. Built a parallel, scalable ingestion system capable of handling 24+ business topics with minimal manual intervention. Replaced Matillion by engineering an in-house ETL framework, enabling ~60% reduction in licensing & operational cost. Improved operational efficiency through CI/CD automation using GitHub Actions, S3 deployment, and MWAA orchestration. Developed an enterprise-wide Streamlit analytics app with Snowflake RBAC to deliver dynamic charts, filters & real-time exploration. Built a serverless PDF reporting pipeline (Snowflake → External Function → API Gateway → Lambda) to automate business reporting.

Software Engineer at Cognizant, Apr 2023 - Mar 2025 · 2 yrs, India, Backend & Data Engineer | Optum (UHG) Dec 2022 – Mar 2025 Developed high-performance REST APIs using FastAPI, SQLAlchemy & optimized SQL for healthcare claims workflows. Reduced API response latency by 30–40% through caching (Redis), query optimization & endpoint refactoring. Built scalable backend pipelines for processing large, complex healthcare claim datasets with high accuracy. Engineered custom business rules engines to automate claims adjudication and reduce manual intervention. Integrated multiple internal & third-party APIs to streamline data exchange across microservices. Optimized schemas & indexing strategies to enhance system performance and database reliability.

Programming Analyst at Cognizant, Jan 2021 - Apr 2023 · 2 yrs 4 mos, Kolkata, West Bengal, India, Backend Engineer | Duns & Bradstreet Jan 2021 – Nov 2022 Automated a complex legacy workflow from 20 hours to 7–8 hours using Java, Shell Scripting & Linux automation. Built modules to generate multi-format data files (pipe-delimited, 12K format) using advanced XML parsing & transformation. Improved system reliability with automated server-side monitoring scripts for job health, file delivery & data flows. Enhanced data quality and fixed numerous production issues across high-volume ETL processes. Wrote & optimized complex SQL queries (CTEs, analytical functions, joins) and executed advanced XPath to process XML BLOBs.

Software Developer at Bharat Electronics, Jul 2019 - Aug 2019 · 2 mos, India, Worked as a Software Developer Intern

Education

Bachelor of Technology, Computer Science, Ambedkar Institute of Advanced Communication Technologies and Research