Yihua Cheng
Chief Technology Officer at Tensormesh
United States
Summary
🤩
Rockstar🎓
Top SchoolYihua Cheng is a technology leader and CTO with eight years of experience building real-time systems and ML infrastructure, currently leading engineering at TensorMesh. He has a strong research-to-product track record from internships at Conviva, Microsoft, Alibaba Cloud, and MEGVII, where he focused on real-time data processing, video conferencing platforms, TCP congestion control, and core ML engines. An active open-source core developer on projects like LMCache and vllm, he bridges high-performance model serving and production deployment. Yihua is pursuing a PhD in Computer Science at the University of Chicago after earning a CS bachelor’s from Peking University, combining rigorous academic training with hands-on systems engineering. Notably, his background emphasizes low-latency distributed systems and ML serving—skills he now applies to scale inference infrastructure at a startup pace.
9 years of coding experience
Bachelor's degree, Computer Science, Bachelor's degree, Computer Science at Peking UniversityDoctor of Philosophy - PhD, Computer Science, Doctor of Philosophy - PhD, Computer Science at University of Chicago
Github Skills (30)
pytorch10
llama10
inference10
tpu10
amd10
llm10
driver10
openai10
cuda10
transformer10
gpt10
k8s10
nvidia8
benchmark8
ai6
Programming languages (7)
Github contributions (5)
ApostaC/LMCache
Jun 2024 - Jul 2026
Contributions:312 pushes, 138 branches in 2 years 1 month
ApostaC/vllm
Dec 2024 - Jan 2026
A high-throughput and memory-efficient inference and serving engine for LLMs
Contributions:2 reviews, 4 PRs, 75 pushes in 1 year
inference
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.