Jon Li is a technical leader and engineer with seven years of experience building distributed systems, ML infrastructure, and cloud-native platforms, now focused on GenAI inference and Kubernetes at Anthropic. He spent over a decade at Google driving GKE and inference price-performance optimizations—work that included disaggregated serving, prefix caching, and LLM prefill—to make large-model serving cost-effective at scale. Earlier roles span Ads measurement and attribution that delivered billions in incremental YouTube ad revenue, full-stack startup CTO experience at a YC company, and engineering positions at Amazon and Cisco. Jon blends hands-on systems design with product strategy and talent development, repeatedly taking research-grade ideas into production. Based in Seattle with a Computer Engineering degree from University of Maryland, he has a rare mix of startup grit and hyperscale engineering rigor. Notably, his recent focus on inference infra reflects an uncommon depth in both ML model plumbing and cloud economics.
7 years of coding experience
16 years of employment as a software developer
BS Computer Engineering, BS Computer Engineering at University of Maryland - A. James Clark School of Engineering
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.