Lang Zhao
Senior Software Engineer at Galileo
San Jose, California, United States
Summary
👤
Senior🎓
Top SchoolLang Zhao is a Senior Software Engineer with 11 years of experience specializing in turning cutting-edge LLMs into production-grade, low-latency inference systems. Based in San Jose, he leads GPU- and system-level performance work—optimizing KV cache reuse, quantization, and continuous batching with TensorRT-LLM and Triton to deliver high throughput under strict SLAs. He designs multi-tenant serving architectures with intelligent load balancing and resource-aware scheduling, and has a background in compiler-level MLIR optimizations for graph fusion and execution efficiency. Lang moves quickly to evaluate new inference paradigms and emerging GPU hardware, blending deep performance tuning with pragmatic system design. Despite a modest GitHub bio, his track record spans enterprise AI at Galileo (now part of Cisco), applied ML at ByteDance, and research-rooted work from Purdue, reflecting both production impact and academic rigor.
11 years of coding experience
4 years of employment as a software developer
Bachelor's degree, Flying Vehicle Power Engineering, Bachelor's degree, Flying Vehicle Power Engineering at Beihang UniversityMaster of Science - MS, Machine Learning, Master of Science - MS, Machine Learning at Purdue University - Office of the Vice Provost for Graduate Students and Postdoctoral Scholars
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (26)
git7
java7
letter7
bottom7
github7
fetch6
tokudb6
realtime6
database5
ionic-framework5
apm5
mvc5
python5
monitoring5
mysql4
Programming languages (3)
Github contributions (5)
zhaoshiling1017/ONE
Nov 2016 - Apr 2017
Contributions:4 commits, 3 pushes, 1 branch in 5 months
zhaoshiling1017/ThreadProject
Apr 2015 - Oct 2017
Contributions:2 pushes, 1 branch in 2 years 6 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.