Ishaan Jaffer
Co-Founder & CTO at LiteLLM (YC W23)
United States
Summary
🤩
Rockstar🎓
Top SchoolIshaan Jaffer is a founder and engineering leader with 9 years of experience building scalable, production-grade systems across fintech and ML infrastructure. As Co-Founder & CTO of LiteLLM (YC W23) he architects the Python SDK and LLM Gateway that normalizes 100+ model providers into an OpenAI-compatible API, bridging cloud, research, and enterprise LLMs. Previously at Coinbase he shipped high-throughput blockchain asset onboarding systems that boosted throughput 4x and slashed latency by 85%, demonstrating a blend of low-level performance tuning and product-driven engineering. His background combines research-grade rigor from Carnegie Mellon with hands-on startup execution dating back to his own early company and multiple internships, giving him both systems depth and entrepreneurial grit. Notably, he has experience operationalizing ML and big-data pipelines across major cloud providers and building developer-facing SDKs that simplify complex distributed integrations.
8 years of coding experience
5 years of employment as a software developer
Bachelor of Science - BS Electrical and Computer Engineering Minor in Machine Learning, Bachelor of Science - BS Electrical and Computer Engineering Minor in Machine Learning at Carnegie Mellon UniversityInternational Baccalaureate Computer Science Business Physics, International Baccalaureate Computer Science Business Physics at The Cathedral and John Connon School
English, Hindi
Stackoverflow
1reputation
73reached
0answers
1question
Github Skills (200)
interpreter10
azure-machine-learning10
octave10
datasets10
chat10
automation10
gpt4all10
foundation-models10
crawler10
sidekick10
webscraping10
session-replay10
webui10
api10
llmops10
Programming languages (22)
Github contributions (5)
BerriAI/clerkie-cli
Dec 2022 - Jan 2023
Clerkie-cli is a terminal tool that uses an LLM to help debug and troubleshoot coding errors in any programming language. It offers explanations, suggested fixes, guidance, alternative approaches, and code examples. It is useful for developers of all skill levels.
Contributions:3 releases, 31 commits, 30 pushes in 14 days
suggestedfixesexplanationsllmfor-developers
BerriAI/litellm
Jul 2023 - Apr 2025
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
Contributions:13 releases, 711 reviews, 3833 PRs in 1 year 8 months
ai-gatewayanthropicazure-openaibedrockgateway
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.