Qi Sun
Researcher at Sakana AI
Minato, Japan
Summary
🤩
Rockstar🎓
Top SchoolQi Sun is a researcher and software engineer based in Minato, Japan, with five years of experience focused on advancing large language model capabilities and production infra. At Sakana AI they lead “senior coach” work teaching LLMs new skills via evolutionary context search and collaboration, with multiple ICLR and other top-conference papers under their belt. Their background spans hands-on systems engineering—accelerating AlphaFold2 on Intel CPUs and building GPU clusters—to designing novel model-training techniques like evolutionary model merging and token-dropping. Currently pursuing a doctorate in computer science at Institute of Science Tokyo after an MEng from Tokyo Institute of Technology, they combine rigorous academic research with pragmatic infra delivery. Notably, they pair deep ML research with the willingness to “glue to a chair” debugging distributed systems until production works. They enjoy building interesting, useful tools that bridge cutting-edge models and real-world engineering.
5 years of coding experience
Master of Engineering - MEng, Computer Science, Master of Engineering - MEng, Computer Science at Tokyo Institute of TechnologyDoctor's Degree, Computer Science, Doctor's Degree, Computer Science at Institute of Science Tokyo (Science Tokyo)Bachelor of Engineering - BE, Computer Science, Bachelor of Engineering - BE, Computer Science at Dalian University of Technology
Github Skills (38)
pytorch10
inference10
cuda10
gpt10
amd9
llm9
tpu9
llama9
mlops9
llmops9
transformer9
xpu8
evaluation8
deepspeed6
deep-learning6
Programming languages (3)
Github contributions (5)
floatingbigcat/PictureBed
Aug 2022 - Sep 2023
Contributions:534 pushes, 1 branch in 1 year
floatingbigcat/mm_builder
Apr 2023 - Sep 2023
Contributions:7 reviews, 9 PRs, 17 pushes in 4 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.