LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Contributions:1 release, 1 review, 1 PR in 1 year
inferencelarge-language-modelsedge-aion-device-aion-device-llm
Contributions:3 pushes, 2 branches in 6 months