Shivakumar Appadurai profile photo 1 on Tal

Shivakumar Appadurai

Senior Vice President at BNY

Bengaluru

19+ years of work experience

BNY
Aug 20262 mosPresent

Pune City, Maharashtra, India

AI/Machine Learning Software Engineer and Architect designs, builds, and scales intelligent systems.
JPMorganChase
Feb 20251 yr 5 mosJun 2026

India

Architected the firm-wide LLM Platform on Azure OpenAI, serving 5,000+ data scientists across 8 Lines of Business — processing 30M+ API calls and 40B+ tokens daily at 99.9% availability and sub-300ms P95 latency. Built LangGraph ReAct agentic AI systems and FAISS-based RAG pipelines, enabling intelligent document retrieval and automated reasoning workflows at enterprise scale. Engineered a secure LLM Gateway with token-level access controls, PII redaction pipelines, and audit logging aligned to financial-grade regulatory and compliance requirements. Reduced LLM model deployment cycle time by 60% through Azure DevOps CI/CD pipelines, Terraform IaC, and containerized blue-green deployment strategies. Developed Python-based LLM evaluation and observability pipelines tracking response quality, token usage, latency, and model drift — enabling data-driven model upgrade decisions. Led a cross-regional team of 15+ engineers across India, US, UK, and APAC; drove OKR-based planning, design reviews, and blameless post-mortems.
JPMorganChase
May 20222 yrs 9 mosJan 2025

Led the design and delivery of the Newton Spring Boot/Kafka task orchestration platform, processing high-throughput distributed workloads across Investment Banking and Asset Management. Managed a team of 10+ engineers; established Agile ceremonies, engineering excellence standards, and on-call SLO frameworks reducing P1 incidents by 40%. Drove the initial Azure OpenAI integration proof-of-concept that evolved into the firm-wide LLM Platform, presenting business case and architecture to senior stakeholders. Owned cloud infrastructure modernization on Azure — Kubernetes cluster management, Terraform automation, and migration of legacy services to containerized microservices.
JPMorganChase
Nov 20165 yrs 7 mosMay 2022

Mumbai, Maharashtra, India

Delivered Java/Spring Boot microservices for core banking workflows across Retail Banking and Operations, supporting millions of daily transactions. Contributed to API gateway design and service mesh implementation, improving inter-service reliability and reducing p99 latency by 30%. Led technical onboarding and mentoring of junior engineers; built internal coding standards and code review guidelines adopted across the team.
Tata Consultancy Services
May 20115 yrs 7 mosNov 2016

Mumbai Area, India

▪ Led a team of 20 engineers delivering high-throughput Java / Spring Boot microservices and J2EE applications for enterprise clients in the BFSI and retail sectors. ▪ Architected distributed microservice solutions using Spring Boot and REST APIs, transitioning monolithic legacy systems to modular, independently deployable services — improving release velocity by 40%. ▪ Personally led hands-on coding and technical delivery of multiple Proof-of-Concept (POC) initiatives, validating new Spring Boot patterns, integration frameworks, and performance benchmarks ahead of full-scale production rollout. ▪ Established code review standards, CI/CD pipelines, and performance testing frameworks that reduced production incidents by 35% and improved overall platform stability.
Tata Consultancy Services
May 20115 yrs 6 mosOct 2016

Led a team of 20 engineers delivering Java / Spring Boot microservices for BFSI and retail clients and drove POC-to-production delivery, CI/CD pipelines and code review practices, reducing incidents by 35% and improving release velocity by 40%.
Hexaware Technologies
May 20101 yr 1 moMay 2011

Mumbai Metropolitan Region

▪ Developed and maintained enterprise Java applications; coordinated with onsite teams for requirement clarification, effort estimation, and delivery planning. ▪ Contributed to performance testing, defect resolution, and optimization of database-heavy modules, improving query response times by 25%.
Puratech Solutions (India) Pvt. Ltd.
Jun 20081 yr 11 mosApr 2010

Mumbai Area, India

▪ Delivered full-SDLC Java application development including design, unit/performance testing, code reviews, and production deployment. ▪ Mentored junior developers on OOP best practices and coding standards, reducing technical debt across the codebase.
YALAMANCHILI Software Exports (P) Limited
May 200711 moApr 2008

NAVI Mumbai

Shivakumar’s AI Stack

claude
claude

Education

Mumbai university

Bachelor of Science, Mathematics

Mumbai university

20033 yrs2006

Join Shivakumar and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss

Shivakumar Appadurai on Tal

Headline

Senior Vice President at BNY

About

I lead the engineering of enterprise-scale GenAI infrastructure at JPMorgan Chase — LLM gateways, RAG pipelines, and agentic AI systems used by 5,000+ data scientists across 8 Lines of Business, processing 30M+ API calls and 40B+ tokens daily at 99.9% availability. As SVP of LLM Platform Engineering, I lead cross-regional teams (India, US, UK, APAC) building the AI backbone that regulated financial services run on — combining 18+ years of Java/Spring Boot distributed systems depth with modern GenAI frameworks: LangGraph, LangChain, Azure OpenAI, and MCP/A2A agent protocols. Selected outcomes: — Architected the firm-wide LLM Gateway with token-level access control, PII redaction, and audit logging meeting financial-grade compliance — Built LangGraph ReAct agentic systems and open search-based RAG pipelines in production, including MNPI-compliant data filtering for financial data — Cut LLM deployment cycle time 60% via Terraform IaC + Azure DevOps blue-green deployments — Built AI observability tooling tracking token usage, latency, cost, and model drift at scale. Open to Director / VP / SVP Engineering and AI Platform leadership conversations.

Location

Bengaluru

AI stack

claude

Work experience

Senior Vice President at BNY, Aug 2026 - Present · 2 mos, Pune City, Maharashtra, India, AI/Machine Learning Software Engineer and Architect designs, builds, and scales intelligent systems.

Senior Vice President at JPMorganChase, Feb 2025 - Jun 2026 · 1 yr 5 mos, India, Architected the firm-wide LLM Platform on Azure OpenAI, serving 5,000+ data scientists across 8 Lines of Business — processing 30M+ API calls and 40B+ tokens daily at 99.9% availability and sub-300ms P95 latency. Built LangGraph ReAct agentic AI systems and FAISS-based RAG pipelines, enabling intelligent document retrieval and automated reasoning workflows at enterprise scale. Engineered a secure LLM Gateway with token-level access controls, PII redaction pipelines, and audit logging aligned to financial-grade regulatory and compliance requirements. Reduced LLM model deployment cycle time by 60% through Azure DevOps CI/CD pipelines, Terraform IaC, and containerized blue-green deployment strategies. Developed Python-based LLM evaluation and observability pipelines tracking response quality, token usage, latency, and model drift — enabling data-driven model upgrade decisions. Led a cross-regional team of 15+ engineers across India, US, UK, and APAC; drove OKR-based planning, design reviews, and blameless post-mortems.

Vice President at JPMorganChase, May 2022 - Jan 2025 · 2 yrs 9 mos, Led the design and delivery of the Newton Spring Boot/Kafka task orchestration platform, processing high-throughput distributed workloads across Investment Banking and Asset Management. Managed a team of 10+ engineers; established Agile ceremonies, engineering excellence standards, and on-call SLO frameworks reducing P1 incidents by 40%. Drove the initial Azure OpenAI integration proof-of-concept that evolved into the firm-wide LLM Platform, presenting business case and architecture to senior stakeholders. Owned cloud infrastructure modernization on Azure — Kubernetes cluster management, Terraform automation, and migration of legacy services to containerized microservices.

Associate at JPMorganChase, Nov 2016 - May 2022 · 5 yrs 7 mos, Mumbai, Maharashtra, India, Delivered Java/Spring Boot microservices for core banking workflows across Retail Banking and Operations, supporting millions of daily transactions. Contributed to API gateway design and service mesh implementation, improving inter-service reliability and reducing p99 latency by 30%. Led technical onboarding and mentoring of junior engineers; built internal coding standards and code review guidelines adopted across the team.

Associate Consultant at Tata Consultancy Services, May 2011 - Nov 2016 · 5 yrs 7 mos, Mumbai Area, India, ▪ Led a team of 20 engineers delivering high-throughput Java / Spring Boot microservices and J2EE applications for enterprise clients in the BFSI and retail sectors. ▪ Architected distributed microservice solutions using Spring Boot and REST APIs, transitioning monolithic legacy systems to modular, independently deployable services — improving release velocity by 40%. ▪ Personally led hands-on coding and technical delivery of multiple Proof-of-Concept (POC) initiatives, validating new Spring Boot patterns, integration frameworks, and performance benchmarks ahead of full-scale production rollout. ▪ Established code review standards, CI/CD pipelines, and performance testing frameworks that reduced production incidents by 35% and improved overall platform stability.

Lead Application Developer at Tata Consultancy Services, May 2011 - Oct 2016 · 5 yrs 6 mos, Led a team of 20 engineers delivering Java / Spring Boot microservices for BFSI and retail clients and drove POC-to-production delivery, CI/CD pipelines and code review practices, reducing incidents by 35% and improving release velocity by 40%.

Sr Software Engineer at Hexaware Technologies, May 2010 - May 2011 · 1 yr 1 mo, Mumbai Metropolitan Region, ▪ Developed and maintained enterprise Java applications; coordinated with onsite teams for requirement clarification, effort estimation, and delivery planning. ▪ Contributed to performance testing, defect resolution, and optimization of database-heavy modules, improving query response times by 25%.

Sr Software Enginear at Puratech Solutions (India) Pvt. Ltd., Jun 2008 - Apr 2010 · 1 yr 11 mos, Mumbai Area, India, ▪ Delivered full-SDLC Java application development including design, unit/performance testing, code reviews, and production deployment. ▪ Mentored junior developers on OOP best practices and coding standards, reducing technical debt across the codebase.

Java Developer at YALAMANCHILI Software Exports (P) Limited, May 2007 - Apr 2008 · 11 mo, NAVI Mumbai

Education

Bachelor of Science, Mathematics, Mumbai university