Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models
Role in this project:
ML Engineer Contributions:34 commits, 1 PR, 8 comments in 1 month
Contributions summary:Jack contributed to the `big-bench` repository by implementing a unit conversion task using Python. They focused on creating a task generator that produces examples in a JSON format. Key changes include adding functionalities to round numbers and formatting the examples into JSON for the model. The user also moved variables to the main section and integrated a configuration file, ultimately building a task designed for evaluating language models.
language-model
Contributions:2 reviews, 1 PR, 2 pushes in 2 years 5 months
roboticsros2dvsros-packagesros