Guanhua Wang
Research Scientist at Meta
Bellevue, Washington, United States
Summary
🤩
Rockstar🎓
Top SchoolGuanhua Wang is a research scientist specializing in accelerating GenAI training and distributed machine learning, currently on Meta’s PyTorch team after leading DeepSpeed efforts at Microsoft. He holds a Ph.D. in Computer Science from UC Berkeley under Prof. Ion Stoica and brings a decade of experience building high-performance, distributed ML infrastructure for organizations including Microsoft, Berkeley RISE Lab, and J.P. Morgan. His work spans systems, networking, and communication optimization for large-scale GPU clusters, with notable contributions to DeepSpeed features like Domino and ZeRO++ that cut communication overhead for huge language models. Based in Bellevue, WA, he combines academic rigor with production impact—moving ideas from research prototypes to tools used by Microsoft and OpenAI model training pipelines. An underappreciated strength is his cross-domain fluency from wireless and mobile networking to cloud-scale ML, enabling end-to-end performance gains.
10 years of coding experience
12 years of employment as a software developer
Doctor of Philosophy (Ph.D.) Computer Science, Doctor of Philosophy (Ph.D.) Computer Science at University of California, BerkeleyBachelor's Degree Computer Science, Bachelor's Degree Computer Science at Southeast UniversityHong Kong University of Science and Technology (HKUST)
English, Chinese
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (84)
transformers10
cnn-classification10
python10
transformer-models10
deep-learning10
gpu10
compression10
smart-contracts10
gpu-acceleration10
efficientnet10
optimization10
distributed-training10
imagenet10
sysml10
acceleration10
Programming languages (5)
Github contributions (5)
GuanhuaWang/SystemPaper
Dec 2016 - Jun 2020
Contributions:313 commits, 311 pushes, 1 branch in 3 years 6 months
GuanhuaWang/sensAI
Mar 2019 - Jan 2021
sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data
Contributions:118 commits, 7 pushes in 1 year 11 months
cifar-10cifar-100cifar10cifar100cnn-classification
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.