Ishaan Jaffer profile photo 1 on Tal

Ishaan Jaffer

Co-Founder & CTO LiteLLM (YC W23) | 53K+ Github stars | Hiring

United States
Hiring

SDE 2

LiteLLM (YC W23)

LiteLLM (YC W23) logo

Build the foundational infrastructure for AI model orchestration and observability at a high-growth YC-backed startup.

Koramangala, Bengaluru

20–30 INR / yearly

CTC

3–6 years

Exp

Hybrid

Work mode

About Ishaan

LiteLLM (YC W23)
Jan 20233 yrs 8 mosPresent

San Francisco Bay Area

Open-source AI Gateway with 54K+ stars on GitHub and trusted by companies like Rocket Money, Samsara, Lemonade, and Adobe. We have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund.
Coinbase
Aug 20226 mosJan 2023

San Francisco Bay Area

Coinbase
Aug 20211 yrJul 2022

San Francisco Bay Area

• Designed, built and tested systems to interact with new Blockchains adding New Assets Under Custody • Led and implemented asset addition scaling solutions to increase bandwidth by 400% and decrease latency by 85%
Carnegie Mellon University School of Computer Science
Dec 20206 mosMay 2021

Pittsburgh, Pennsylvania, United States

Software Engineer at the TEEL Lab (teel.cs.cmu.edu) developing a course on Artificial Intelligence using big data and ML/cognitive services from the major cloud service providers.
Carnegie Mellon University School of Computer Science
Aug 20205 mosDec 2020

Pittsburgh, Pennsylvania, United States

Working with Prof. Nakahira on provably safe frameworks for learning-based control in autonomous vehicles
Carnegie Mellon University School of Computer Science
Jan 20201 yrDec 2020

Pittsburgh, Pennsylvania

TA for 15-112: Fundamentals of Programming and Computer Science and 15-440 Distributed Systems • Support ~500 students in managing course load and learning to program in Python • Work with professors and staff of 50 TA’s to develop course and maximize student success and engagement • Led weekly recitations for 30 students to facilitate problem-solving skills based on class material
Lunegy.edu
Apr 20208 mosNov 2020

Mumbai, Maharashtra, India

- Started a company where I spent 250+ hours building and debugging projects with developers - Built 30 projects, including a stock trading bot, AI Chess Engine, OpenCV Exercise analyser
Qualcomm
Jun 20203 mosAug 2020

San Diego, California

• Conceptualized and developed an Extract, Transform, Load (ETL) system to pipeline large datasets to testing teams, improving load times from 30 seconds to 2 seconds (15x Speedup) • Led the design, development and launch of dashboards, automated data pulls and analyses to drive key testing decisions for 5G chipset teams

Education

Carnegie Mellon University

Bachelor of Science - BS, Electrical and Computer Engineering, Minor in Machine Learning

Carnegie Mellon University

20174 yrs2021
The Cathedral and John Connon School

International Baccalaureate, Computer Science, Business, Physics

The Cathedral and John Connon School

20152 yrs2017

Join Ishaan and 10k+ other professionals on

Tal Boss

Tal is the app where bosses meet engineers & builders directly, without middlemen

Download Tal Boss
TAL BY GRAPEVINE
Message Ishaan

Ishaan Jaffer on Tal

Headline

Co-Founder & CTO LiteLLM (YC W23) | 53K+ Github stars | Hiring

About

I am a Co-Founder and CTO with a deep background in scaling high-performance AI infrastructure. Previously a Software Engineer at Coinbase, I now lead development at LiteLLM, an open-source AI gateway with over 53,000 GitHub stars. My technical expertise spans distributed systems, machine learning, and hardware-level optimization, backed by a degree from Carnegie Mellon. I am passionate about building efficient, developer-centric AI tooling that solves real-world production challenges.

Location

United States

Work experience

Co-Founder & CTO at LiteLLM (YC W23), Jan 2023 - Present · 3 yrs 8 mos, San Francisco Bay Area, Open-source AI Gateway with 54K+ stars on GitHub and trusted by companies like Rocket Money, Samsara, Lemonade, and Adobe. We have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund.

Software Engineer II at Coinbase, Aug 2022 - Jan 2023 · 6 mos, San Francisco Bay Area

Software Engineer at Coinbase, Aug 2021 - Jul 2022 · 1 yr, San Francisco Bay Area, • Designed, built and tested systems to interact with new Blockchains adding New Assets Under Custody • Led and implemented asset addition scaling solutions to increase bandwidth by 400% and decrease latency by 85%

Software Engineer at Carnegie Mellon University School of Computer Science, Dec 2020 - May 2021 · 6 mos, Pittsburgh, Pennsylvania, United States, Software Engineer at the TEEL Lab (teel.cs.cmu.edu) developing a course on Artificial Intelligence using big data and ML/cognitive services from the major cloud service providers.

Research Assistant at Carnegie Mellon University School of Computer Science, Aug 2020 - Dec 2020 · 5 mos, Pittsburgh, Pennsylvania, United States, Working with Prof. Nakahira on provably safe frameworks for learning-based control in autonomous vehicles

Teaching Assistant at Carnegie Mellon University School of Computer Science, Jan 2020 - Dec 2020 · 1 yr, Pittsburgh, Pennsylvania, TA for 15-112: Fundamentals of Programming and Computer Science and 15-440 Distributed Systems • Support ~500 students in managing course load and learning to program in Python • Work with professors and staff of 50 TA’s to develop course and maximize student success and engagement • Led weekly recitations for 30 students to facilitate problem-solving skills based on class material

Founder at Lunegy.edu, Apr 2020 - Nov 2020 · 8 mos, Mumbai, Maharashtra, India, - Started a company where I spent 250+ hours building and debugging projects with developers - Built 30 projects, including a stock trading bot, AI Chess Engine, OpenCV Exercise analyser

Software Engineering Intern at Qualcomm, Jun 2020 - Aug 2020 · 3 mos, San Diego, California, • Conceptualized and developed an Extract, Transform, Load (ETL) system to pipeline large datasets to testing teams, improving load times from 30 seconds to 2 seconds (15x Speedup) • Led the design, development and launch of dashboards, automated data pulls and analyses to drive key testing decisions for 5G chipset teams

Education

Bachelor of Science - BS, Electrical and Computer Engineering, Minor in Machine Learning, Carnegie Mellon University

International Baccalaureate, Computer Science, Business, Physics, The Cathedral and John Connon School