Compiler for Neural Network hardware accelerators
Role in this project:
Backend Developer & Performance Engineer Contributions:81 commits, 80 PRs, 3 comments in 1 year 11 months
Contributions summary:Michael focused on performance microbenchmarks within the Glow compiler for neural network hardware accelerators. Their contributions included creating and modifying microbenchmarks for GEMM, addition, SLS (Sparse Lengths Weighted Sum), batch GEMM, and transpose operations. They implemented and optimized these benchmarks, with a focus on measuring GFLOPS and GBytes/sec, indicating a strong emphasis on performance profiling and code optimization within the Glow framework. They also made contributions related to adding new kernels and features to the project.
compilerhardwareneural-network
FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
Role in this project:
ML Engineer Contributions:3 releases, 2 reviews, 32 commits in 8 months
Contributions summary:Michael's contributions primarily involve implementing and optimizing operations within the fbgemm library, particularly focusing on jagged tensor manipulations. The user added a new operator, `dense_to_jagged`, which converts a dense tensor into a jagged tensor, and also refactored existing jagged tensor operations, improving performance by converting to dense tensors for elementwise operations. Further work included debugging and benchmarking the new jagged tensor operations. They also integrated a prototype jagged operator from NVIDIA and added a benchmark.
machine-learningmatrix-multiplication