Role in this project:
ML Engineer Contributions:69 commits, 14 PRs, 120 pushes in 2 years 2 months
Contributions summary:Anton contributed to the `ru-gpts` repository, which focuses on Russian GPT3 models. Their work involved modifying the `generate_transformers.py` script, likely to refine the text generation process, incorporating clearer prompts. They also updated scripts related to pretraining the models, and fixed errors related to different model parallel unit (mpu) configurations. Furthermore, they provided example code for finetuning and generating text with the RuGPT3 models using Hugging Face Transformers.
pytorchnlpnatural-language-processinggpt3
Contributions:27 commits, 22 pushes, 1 branch in 1 month
javascript