Liwei Peng
Principal Software Engineer, Azure ML AI Infrastructure at Microsoft
Redmond, Washington, United States
Summary
👤
Senior🎓
Top SchoolLiwei Peng is a Principal Software Engineer at Microsoft specializing in large-scale distributed AI training infrastructure and GPU deep learning performance tuning. With 11+ years across Azure and Alibaba, he blends low-level C++/Python systems engineering with PyTorch/TensorFlow model optimization, RDMA GPU communication, and HPC expertise (MPI, schedulers). He helped design Azure AI supercomputer Singularity and co-authored papers including EFLOPS (HPCA 2020) and StructBERT (ICLR 2020), the latter driving a top GLUE result. His background spans shipping Linux agents and cross-platform tooling to building production NLP and multimodal models for anti-fraud at Alibaba, evidencing both system and applied ML impact. Comfortable from kernel-level networking to model pretraining, he repeatedly improves training scalability, speed, and memory efficiency at cloud scale. Based in Redmond, he brings a rare mix of scientific training and decades of production-grade distributed systems craftsmanship.
11 years of coding experience
22 years of employment as a software developer
Bachelor of Science - BS, Physics, Bachelor of Science - BS, Physics at Nankai UniversityMCS, Computer Science, MCS, Computer Science at Rice UniversityMaster of Science - MS, Computational Biology, Master of Science - MS, Computational Biology at Tsinghua University
Github Skills (133)
transformers10
language-model10
python10
hyper-v10
deep-learning10
gpu10
compression10
fluentd10
pre-trained-model10
transformer10
nlp10
jax10
translation10
multimodal-deep-learning10
speech-synthesis10
Programming languages (6)
Github contributions (5)
Azure/fluentd-plugin-mdsd
Jun 2016 - Sep 2017
Azure Linux monitoring agent (mdsd) output plugin for fluentd
Contributions:7 releases, 85 commits, 61 PRs in 1 year 2 months
agentfluentd-pluginlinuxfluentdazure
Azure/azure-linux-extensions
Jun 2017 - Jun 2017
Linux Virtual Machine Extensions for Azure
Contributions:2 commits, 2 PRs, 1 push in 1 day
hyper-vlinuxvirtual-machineextensionsazure
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.