A collection of libraries to optimise AI model performances
Role in this project:
ML Engineer Contributions:21 releases, 103 reviews, 24 commits in 11 months
Contributions summary:Diego primarily contributed to optimizing AI model performance within the `optimate` repository. Their work involved integrating and refining Hugging Face models, along with ONNX, OpenVINO, and TensorRT optimization techniques. Key efforts include implementing a Hugging Face API, addressing errors in various runtime environments (ONNXRuntime, OpenVINO, TensorRT), and modifying model behaviors for CPU and GPU utilization, indicating a focus on inference acceleration.
aianalyticsartificial-intelligencelarge-language-modelsllm
Contributions:179 pushes, 1 branch in 1 year