Scenic: A Jax Library for Computer Vision Research and Beyond
Role in this project:
ML Engineer Contributions:5 commits in 3 months
Contributions summary:Aaron primarily contributed to the core machine learning aspects of the Scenic library. Their work included adding a LARS optimizer, correcting a missing GELU activation in a BERT model layer, and modifying the training utils. They also made changes relating to how a job restarts and the global step is handled during resuming model training from a checkpoint, ensuring correct randomization.
computer-visionjaxdeep-learningtransformersvision-transformer
Role in this project:
ML Engineer Contributions:5 commits in 1 month
Contributions summary:Aaron contributed significantly to the SupCon (Supervised Contrastive Learning) project within the Google Research repository. Their work focused on fine-tuning hyperparameters, including learning rates, weight decay, and optimizer parameters (RMSProp and LARS), across multiple ResNet architectures (ResNet50, ResNet101, ResNet200) for the ImageNet dataset. The user also addressed software compatibility and bug fixes as well as updating and adapting loss functions.
googlemachine-learningai