Justin Chiu
Member Of Technical Staff at Amazon
Seattle, Washington, United States
Summary
👤
Senior🎓
Top SchoolJustin Chiu is a Member of Technical Staff at Amazon with eight years of experience specializing in deep learning, distributed systems, and optimization, currently focused on scaling and optimizing large language models at AWS. He has driven multi-million- and multi-billion-dollar infrastructure savings through distributed training and inference optimizations, including a widely noticed ZeRO3 improvement merged into DeepSpeed and an Expert Parallelism scheme for Trainium accelerators. Comfortable shipping across research and production, he has led cross-team architecture changes, network and multi-DC training decisions, and pretraining/RLHF work for Titan LLMs. Justin’s background in biochemistry and early hands-on research hints at a methodical, experimental approach to system design and performance tuning. He publishes code on GitHub and blends low-level performance engineering (AVX2, vectorization) with large-scale system strategy.
9 years of coding experience
9 years of employment as a software developer
Bachelor of Science - BS, Biochemistry, Bachelor of Science - BS, Biochemistry at University of Washington
Github Skills (38)
pytorch10
distributed-training10
python10
mixture-of-experts10
machine-learning10
inference10
building-blocks10
numpy10
data-parallelism10
deepspeed10
deep-learning10
self-attention10
gpu10
autograd10
neural-network10
Programming languages (4)
Github contributions (5)
jfc4050/detect-to-track
Feb 2019 - Aug 2019
correlation feature based object tracking
Contributions:103 commits, 66 pushes, 1 branch in 5 months
object-trackingcomputer-visionconvolutional-neural-networkscppcuda
jfc4050/dlcalc
Feb 2024 - Apr 2026
random command line tools for deep learning
Contributions:13 releases, 185 pushes, 2 branches in 2 years 2 months
command-line-tooldeep-learning
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.