Zhemin Huang
Member Of Technical Staff at Microsoft AI
Palo Alto, California, United States
Summary
👤
Senior🎓
Top SchoolZhemin Huang is a software engineer specializing in ML systems and distributed systems with nine years of experience and recent MS work from Stanford. Currently a Member of Technical Staff at Microsoft AI working on MSI pretraining infrastructure, he previously built inference frameworks and optimized attention kernels at ByteDance and AWS/Annapurna Labs. His background blends academic research—LLM agent parallel thinking and serverless platform performance—from Stanford, SJTU and NUS with hands-on system software experience at NVIDIA and industry labs. Based in Palo Alto, Zhemin is comfortable moving models to production at scale and has a track record of bridging research ideas into performant infra—a profile shaped by work across ML systems, cloud infra, and low-level optimization.
9 years of coding experience
3 years of employment as a software developer
Bachelor of Engineering - BE Computer Software Engineering, Bachelor of Engineering - BE Computer Software Engineering at Shanghai Jiao Tong UniversityExchange Student Computer Science, Exchange Student Computer Science at National University of SingaporeShanghai High SchoolMaster of Science - MS Electrical Engineering (Software Systems Track), Master of Science - MS Electrical Engineering (Software Systems Track) at Stanford University
English, Chinese
Github Skills (22)
rft9
distill9
multimodal9
embedding9
cuda9
lora8
inference8
llm8
pytorch8
llama7
yahoo7
agent7
transformer7
machine-learning6
benchmarking6
Programming languages (3)
Github contributions (5)
xtommy-1/bookstore_backend
Sep 2021 - Nov 2022
Contributions:29 commits, 5 pushes in 1 year 2 months
zheminh/Investas
Sep 2021 - Nov 2022
Contributions:6 commits, 7 pushes, 1 branch in 1 year 2 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.