Peng Sun
Singapore
Summary
🤩
Rockstar🎓
Top SchoolPeng Sun is an experienced AI infrastructure and distributed systems engineer with 11 years optimizing large-scale GPU clusters, data-center networks, and high-performance storage for deep learning. He has led and built infrastructure teams at MiroMind.ai and Shanghai AI Lab and served as AI Infra Lead at a stealth startup, combining hands-on systems tuning with research-driven methods. His background includes running 100-node clusters during a PhD at Nanyang Technological University and production optimizations at SenseTime, giving him rare end-to-end expertise from cluster orchestration to network-aware training. Deeply curious about AI systems (self-described "always a student for AI System"), he blends machine learning knowledge with practical performance engineering to squeeze efficiency from complex distributed training workloads.
11 years of coding experience
14 years of employment as a software developer
Bachelor of Engineering (B.Eng.), Automation Engineer Technology/Technician, Bachelor of Engineering (B.Eng.), Automation Engineer Technology/Technician at Shandong UniversityDoctor of Philosophy (PhD), Computer Engineering, Doctor of Philosophy (PhD), Computer Engineering at Nanyang Technological University Singapore
Github Skills (23)
pytorch10
python10
machine-learning10
numpy10
llm10
deep-learning10
gpu10
rlhf10
neural-network10
gpt10
gpu-acceleration10
chatbot10
acceleration9
autograd9
tensorflow9
Programming languages (1)
Github contributions (5)
cap-ntu/UniCAP
Nov 2015 - Nov 2015
Contributions:38 commits, 36 pushes, 2 branches in 6 days
InternLM/InternEvo
Jan 2024 - Mar 2025
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
Contributions:9 releases, 229 reviews, 188 PRs in 1 year 2 months
910bdeepspeed-ulyssesflash-attentiongemmainternlm
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.