Wonho Song
AI Research Engineer LLM Pretraining Team at Upstage
Gyeonggi, South Korea
Summary
👤
Senior🎓
Top SchoolWonho Song is an AI research engineer with eight years of experience specializing in large language model pretraining and fine-tuning, currently on Upstage’s LLM Pretraining Team. He led the pretraining of a 22B-parameter foundation model that achieved an 80 MMLU score and previously pushed model scaling, multilingual continued pretraining, and context-length extension work. A competitive Kaggle Master with multiple top finishes and academic competition wins, he brings a strong empirical mindset from reproducible contest environments into production ML. Notably, he engineered cost-efficient depth up-scaling from 7B to 10.7B and drove a first-place solution on the HuggingFace Open LLM Leaderboard. He combines rigorous academic training from KAIST and Chung-Ang University with hands-on product deployments across healthcare, finance, and e-commerce domains. Beyond model building, he mentors as an object detection instructor at Boostcamp, blending teaching with cutting-edge research practice.
8 years of coding experience
2 years of employment as a software developer
Bachelor's degree, Industrial Security, Summa Cum Laude, Bachelor's degree, Industrial Security, Summa Cum Laude at Chung-Ang UniversityMaster's degree, Graduate School of Information Security, Master's degree, Graduate School of Information Security at Korea Advanced Institute of Science and Technology(KAIST)
Github Skills (36)
cuda8
pytorch8
evaluation7
toolbox7
romaji7
benchmark7
inference7
transformer7
object-detection7
faster-rcnn6
nlp6
evaluation-framework6
gpt6
vision-transformer6
amd6
Programming languages (4)
Github contributions (5)
SONG-WONHO/start_NumPy
Aug 2017 - Dec 2018
Contributions:28 commits, 11 pushes, 1 branch in 1 year 4 months
SONG-WONHO/baekjoon
Jul 2017 - Nov 2022
Contributions:42 commits, 20 pushes, 1 branch in 5 years 4 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.