Fast Neural Machine Translation in C++
Role in this project:
Back-end Developer & ML Engineer Contributions:62 commits, 3 pushes, 1 branch in 3 years 9 months
Contributions summary:Alham focused on enhancing the `marian` repository with parameter sharding techniques, aimed at improving performance on multi-GPU environments. Their contributions included the implementation of parameter sharding, the introduction of sparse tensor operations and its related operations, and optimizing data movement during the forward and backward passes. Further work was done on gradient dropping for reducing the memory footprint. Finally, the user also added support for moving average and exponential smoothing, providing a means to smooth out the model's training.
machine-translationtranslationneural-machine-translationcudagpu
Contributions:1 PR, 56 pushes, 1 branch in 4 years 1 month