Shun Kiyono is a Machine Learning Engineer with 11 years of experience specializing in NLP and a Ph.D. in Information Sciences from Tohoku University. His research on semi-supervised methods for grammatical error correction and machine translation evolved into hands-on development of Large Language Models across pre-training and post-training stages (SFT, DPO, etc.). He has combined academic rigor with production-focused engineering at RIKEN, LINE, SB Intuitions, and now Cohere, shipping data pipelines and model training workflows. An active contributor to speech and translation tooling, he has practical experience preparing subword tokenization and BPE pipelines for the widely used ESPnet toolkit. Based in Sendai, Japan, he is passionate about building impactful AI systems that bridge research advances and deployable solutions. His profile and publications reveal a pattern of turning novel learning techniques into reproducible, scalable training pipelines.
Contributions:16 commits, 7 PRs, 10 comments in 1 month
Contributions summary:Shun primarily focused on modifying and creating scripts related to data preparation, tokenization, and BPE (Byte Pair Encoding) training for machine translation tasks. Their commits show the integration of subword-nmt, indicating a focus on improving the model's ability to handle out-of-vocabulary words. These changes were implemented to prepare data for the ESPnet toolkit, specifically for IWSLT16 dataset, suggesting a hands-on role in preparing training data for machine translation models. The commits also showcase the modification of the run script, indicating the user's involvement in the training and evaluation pipeline.
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.