Senior Vice President at BNY

Pune City, Maharashtra, India

India


Mumbai, Maharashtra, India

Mumbai Area, India


Mumbai Metropolitan Region
_pvt._ltd.-f02943ad.jpg&w=3840&q=75)
Mumbai Area, India

NAVI Mumbai


Bachelor of Science, Mathematics
Mumbai university
Join Shivakumar and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal BossSenior Vice President at BNY
I lead the engineering of enterprise-scale GenAI infrastructure at JPMorgan Chase — LLM gateways, RAG pipelines, and agentic AI systems used by 5,000+ data scientists across 8 Lines of Business, processing 30M+ API calls and 40B+ tokens daily at 99.9% availability. As SVP of LLM Platform Engineering, I lead cross-regional teams (India, US, UK, APAC) building the AI backbone that regulated financial services run on — combining 18+ years of Java/Spring Boot distributed systems depth with modern GenAI frameworks: LangGraph, LangChain, Azure OpenAI, and MCP/A2A agent protocols. Selected outcomes: — Architected the firm-wide LLM Gateway with token-level access control, PII redaction, and audit logging meeting financial-grade compliance — Built LangGraph ReAct agentic systems and open search-based RAG pipelines in production, including MNPI-compliant data filtering for financial data — Cut LLM deployment cycle time 60% via Terraform IaC + Azure DevOps blue-green deployments — Built AI observability tooling tracking token usage, latency, cost, and model drift at scale. Open to Director / VP / SVP Engineering and AI Platform leadership conversations.
Bengaluru
claude
Senior Vice President at BNY, Aug 2026 - Present · 2 mos, Pune City, Maharashtra, India, AI/Machine Learning Software Engineer and Architect designs, builds, and scales intelligent systems.
Senior Vice President at JPMorganChase, Feb 2025 - Jun 2026 · 1 yr 5 mos, India, Architected the firm-wide LLM Platform on Azure OpenAI, serving 5,000+ data scientists across 8 Lines of Business — processing 30M+ API calls and 40B+ tokens daily at 99.9% availability and sub-300ms P95 latency. Built LangGraph ReAct agentic AI systems and FAISS-based RAG pipelines, enabling intelligent document retrieval and automated reasoning workflows at enterprise scale. Engineered a secure LLM Gateway with token-level access controls, PII redaction pipelines, and audit logging aligned to financial-grade regulatory and compliance requirements. Reduced LLM model deployment cycle time by 60% through Azure DevOps CI/CD pipelines, Terraform IaC, and containerized blue-green deployment strategies. Developed Python-based LLM evaluation and observability pipelines tracking response quality, token usage, latency, and model drift — enabling data-driven model upgrade decisions. Led a cross-regional team of 15+ engineers across India, US, UK, and APAC; drove OKR-based planning, design reviews, and blameless post-mortems.
Vice President at JPMorganChase, May 2022 - Jan 2025 · 2 yrs 9 mos, Led the design and delivery of the Newton Spring Boot/Kafka task orchestration platform, processing high-throughput distributed workloads across Investment Banking and Asset Management. Managed a team of 10+ engineers; established Agile ceremonies, engineering excellence standards, and on-call SLO frameworks reducing P1 incidents by 40%. Drove the initial Azure OpenAI integration proof-of-concept that evolved into the firm-wide LLM Platform, presenting business case and architecture to senior stakeholders. Owned cloud infrastructure modernization on Azure — Kubernetes cluster management, Terraform automation, and migration of legacy services to containerized microservices.
Associate at JPMorganChase, Nov 2016 - May 2022 · 5 yrs 7 mos, Mumbai, Maharashtra, India, Delivered Java/Spring Boot microservices for core banking workflows across Retail Banking and Operations, supporting millions of daily transactions. Contributed to API gateway design and service mesh implementation, improving inter-service reliability and reducing p99 latency by 30%. Led technical onboarding and mentoring of junior engineers; built internal coding standards and code review guidelines adopted across the team.
Associate Consultant at Tata Consultancy Services, May 2011 - Nov 2016 · 5 yrs 7 mos, Mumbai Area, India, ▪ Led a team of 20 engineers delivering high-throughput Java / Spring Boot microservices and J2EE applications for enterprise clients in the BFSI and retail sectors. ▪ Architected distributed microservice solutions using Spring Boot and REST APIs, transitioning monolithic legacy systems to modular, independently deployable services — improving release velocity by 40%. ▪ Personally led hands-on coding and technical delivery of multiple Proof-of-Concept (POC) initiatives, validating new Spring Boot patterns, integration frameworks, and performance benchmarks ahead of full-scale production rollout. ▪ Established code review standards, CI/CD pipelines, and performance testing frameworks that reduced production incidents by 35% and improved overall platform stability.
Lead Application Developer at Tata Consultancy Services, May 2011 - Oct 2016 · 5 yrs 6 mos, Led a team of 20 engineers delivering Java / Spring Boot microservices for BFSI and retail clients and drove POC-to-production delivery, CI/CD pipelines and code review practices, reducing incidents by 35% and improving release velocity by 40%.
Sr Software Engineer at Hexaware Technologies, May 2010 - May 2011 · 1 yr 1 mo, Mumbai Metropolitan Region, ▪ Developed and maintained enterprise Java applications; coordinated with onsite teams for requirement clarification, effort estimation, and delivery planning. ▪ Contributed to performance testing, defect resolution, and optimization of database-heavy modules, improving query response times by 25%.
Sr Software Enginear at Puratech Solutions (India) Pvt. Ltd., Jun 2008 - Apr 2010 · 1 yr 11 mos, Mumbai Area, India, ▪ Delivered full-SDLC Java application development including design, unit/performance testing, code reviews, and production deployment. ▪ Mentored junior developers on OOP best practices and coding standards, reducing technical debt across the codebase.
Java Developer at YALAMANCHILI Software Exports (P) Limited, May 2007 - Apr 2008 · 11 mo, NAVI Mumbai
Bachelor of Science, Mathematics, Mumbai university