Ishaan Jaffer
Co-Founder & CTO at LiteLLM (YC W23)
United States
Summary
🤩
Rockstar🎓
Top SchoolIshaan Jaffer is a founder and engineering leader with 9 years of experience building scalable, production-grade systems across fintech and ML infrastructure. As Co-Founder & CTO of LiteLLM (YC W23) he architects the Python SDK and LLM Gateway that normalizes 100+ model providers into an OpenAI-compatible API, bridging cloud, research, and enterprise LLMs. Previously at Coinbase he shipped high-throughput blockchain asset onboarding systems that boosted throughput 4x and slashed latency by 85%, demonstrating a blend of low-level performance tuning and product-driven engineering. His background combines research-grade rigor from Carnegie Mellon with hands-on startup execution dating back to his own early company and multiple internships, giving him both systems depth and entrepreneurial grit. Notably, he has experience operationalizing ML and big-data pipelines across major cloud providers and building developer-facing SDKs that simplify complex distributed integrations.
9 years of coding experience
5 years of employment as a software developer
Bachelor of Science - BS Electrical and Computer Engineering Minor in Machine Learning, Bachelor of Science - BS Electrical and Computer Engineering Minor in Machine Learning at Carnegie Mellon UniversityInternational Baccalaureate Computer Science Business Physics, International Baccalaureate Computer Science Business Physics at The Cathedral and John Connon School
English, Hindi
Stackoverflow
1reputation
73reached
0answers
1question
Github Skills (200)
language-model10
bug-tracker10
datasets10
chat10
automation10
gpt4all10
code-generation10
image-generation10
foundation-models10
crawler10
llama-index10
webscraping10
api10
llmops10
autonomous-agents10
Programming languages (27)
Github contributions (5)
BerriAI/litellm
Jul 2023 - Jun 2026
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Contributions:14 releases, 1411 reviews, 5512 PRs in 2 years 11 months
aianthropicazurellmload-balancing
BerriAI/clerkie-cli
Dec 2022 - Jan 2023
Clerkie-cli is a terminal tool that uses an LLM to help debug and troubleshoot coding errors in any programming language. It offers explanations, suggested fixes, guidance, alternative approaches, and code examples. It is useful for developers of all skill levels.
Contributions:3 releases, 31 commits, 30 pushes in 14 days
clillmprogramming-language
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.