Headline

Staff Data Engineer at Visa

About

Staff Software Engineer with 13+ years of experience designing and building large-scale distributed systems, backend platforms, data platforms, and cloud-native applications across the US and India. M.S. in Computer Science from the University of Southern California (USC). Most recently at Visa, I led the design and development of highly scalable and resilient platforms providing secure access to Visa data for internal and external users. My experience spans the complete engineering lifecycle - architecture and design, hands-on development, containerization, deployment, scaling, observability, production operations, and live-site reliability. I have built distributed backend platforms and high-throughput REST APIs using Java and Spring Boot, including multi-datacenter architectures with load balancing, automated failover, highly available data stores, and production monitoring. I have also worked extensively with Kafka and event-driven architectures for asynchronous processing, auditing, and stream processing. On the data engineering side, I have designed and developed large-scale Spark/Scala pipelines processing millions of transaction records daily, along with ETL workflows and secure data delivery systems. My experience also includes Kubernetes,, Docker, Redis, MySQL, Kafka, observability and monitoring, CI/CD, and production infrastructure. Beyond individual contribution, I have led technical initiatives from inception to production, driven architecture and design decisions, mentored engineers, and worked across teams to deliver complex platform capabilities. I am currently expanding my work in Generative AI and AI-assisted software engineering, with a focus on LLMs, RAG, agentic workflows, semantic retrieval, and building AI-powered applications. Core areas: Distributed Systems | Backend Engineering | Platform Engineering | Data Engineering | System Design | Java | Spring Boot | Python | Spark/Scala | Kafka | REST APIs | Kubernetes | Docker | Redis | MySQL | Observability | GenAI

Location

San Jose

AI stack

claude code

Cline

Work experience

Staff Data Engineer at Visa, May 2023 - Jul 2026 · 3 y 2 mo, Bengaluru, Karnataka, India

Senior Software Engineer at Visa, Apr 2017 - May 2023 · 6 yrs 2 mos, Palo Alto, California, Data API platform group. Focussed on providing horizontal Micro service solutions to enable data platform partners build vertical solutions. Experience working on provisioning platform features built using Spring boot micro services , containerized using Docker, Experienced orchestrating containers using Kubernetes. Experienced working using Kafka as a messaging channel to audit events/ Kafka Streams to aggregate incoming events. Experienced setting up monitoring/alerting using Prometheus based alerts/Sysdig alerts for Openshift. Technologies - Java/Python/Spring boot/Kafka/Kafka Streams/Docker/Kubernetes/Sysdig/Prometheus/Redis for pub-sub

Software Engineer at Nimble Storage, Feb 2015 - Apr 2017 · 2 yrs 3 mos, San jose,California, I started working as a full time software Engineer at Nimble since Feb 2015. I currently work for the Infrastructure/automation team at Nimble. 1) Worked on writing/consuming REST APIs using python's Django to submit Jobs to Mesos via the messaging queue service Kafka.(Python, Django) 2)Worked on multi processing of jobs which get submitted to Mesos and made sure that there was no contention/deadlock of resource reservation and resource freeing between multiple jobs.(Python, SQL) 3)Developed Database modules to perform DB operations using Python's object relational mapper SQLAlchemy(Python,SQLAlchemy) 4)Worked on an infrastructure framework to perform networking operations over ssh and telnet and SCP(paramiko ,telnetlib) 5)Developed an Automation framework in Java using VMware's Vcenter SDK to provision nimble storage as a VM managed by an ESX server. Framework involved the capability to provision a VMFS VM/VVol VM on a nimble volume mounted as a VMFS datastore and perform operations on a cluster of VMs like taking a snapshot of the VM,cloning the VM, Vmotion/Svmotion/Xvmotion of the VM, perform I/O on the VM etc (Java , Vcenter SDK , VVols, ESX cli, Jsch)

Software Engineer at Lam Research, Jul 2011 - Jul 2013 · 2 yrs 1 mo, Bengaluru, Karnataka, India, I worked at Lam Research(previously known as Novellus Systems) for 2 years.I worked on 2 projects during this time.The first one was on JAVA where I worked on building an automation framework to automate test cases. The second one was on ASP.NET with C# as back end language. This tool was used to remotely analyse the performance of LAM tools and plot different types of charts based on the number of warnings/faults that occurred on the tools.

Education

Master's degree, Computer Science, University of Southern California

Bachelor's degree in Engineering, Computer Science, PESSE

Public links

leetcode: https://leetcode.com/rajeevr1989