A high-throughput and memory-efficient inference and serving engine for LLMs
Contributions:1 PR, 110 pushes, 23 branches in 1 year 3 months
inference
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Contributions:3 reviews, 1 PR, 76 pushes in 1 year 11 months
jaxmachine-learningpytorchtensorflowtransformers