A fast MoE impl for PyTorch
Role in this project:
ML Engineer Contributions:17 reviews, 9 commits, 10 PRs in 7 months
Contributions summary:Mingshu primarily contributed to bug fixes and improvements within the `fastmoe` repository, which focuses on a fast MoE implementation for PyTorch. Their work involved resolving issues related to the GShardGate, type mismatches, and shape inconsistencies. Additionally, the user added a condition to skip parameter popping and fixed a bug related to a proper communication group, showcasing their involvement in optimizing the library's functionality and correctness.
pytorchmoemixture-of-expertsimplpytorch-lightning
Contributions:123 commits, 4 pushes, 1 branch in 1 year 3 months