Universal LLM Deployment Engine with ML Compilation
Role in this project:
Back-end Developer & API Developer Contributions:7 reviews, 36 PRs, 4 pushes in 7 months
Contributions summary:Kartik primarily focused on developing the REST API for the project, specifically for OpenAI compatibility. They implemented features such as presence and frequency penalties, conversation history support, and parameters like max_gen_len, n, and stop_str. The user also refactored generation configurations and added documentation for parameters. Moreover, they worked on function calling integration within the REST API, enabling tools and function calls.
language-modelllmmachine-learning-compilationtvm
Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
Contributions:2 PRs, 75 pushes, 48 branches in 7 months