Justin Chiu
Principal Machine Learning Engineer at Amazon
Seattle, Washington, United States
Summary
👤
Senior🎓
Top SchoolJustin Chiu is a Member of Technical Staff at Amazon with eight years of experience specializing in deep learning, distributed systems, and optimization, currently focused on scaling and optimizing large language models at AWS. He has driven multi-million- and multi-billion-dollar infrastructure savings through distributed training and inference optimizations, including a widely noticed ZeRO3 improvement merged into DeepSpeed and an Expert Parallelism scheme for Trainium accelerators. Comfortable shipping across research and production, he has led cross-team architecture changes, network and multi-DC training decisions, and pretraining/RLHF work for Titan LLMs. Justin’s background in biochemistry and early hands-on research hints at a methodical, experimental approach to system design and performance tuning. He publishes code on GitHub and blends low-level performance engineering (AVX2, vectorization) with large-scale system strategy.
8 years of coding experience
8 years of employment as a software developer
Bachelor of Science - BS, Biochemistry, Bachelor of Science - BS, Biochemistry at University of Washington
Github Skills (48)
pytorch10
distributed-training10
python10
mixture-of-experts10
acceleration10
machine-learning10
inference10
building-blocks10
numpy10
nvidia10
data-parallelism10
deepspeed10
deep-learning10
self-attention10
tensorflow10
Programming languages (4)
Github contributions (5)
jfc4050/dlcalc
Feb 2024 - Feb 2025
Contributions:9 releases, 135 pushes, 1 branch in 1 year
jfc4050/DeepSpeed
May 2021 - Apr 2023
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
Contributions:98 pushes, 4 branches, 3 comments in 1 year 11 months
pytorchdeepspeeddeep-learningeffectiveoptimization
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.