Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, GraphRAG, DeepSpeed, Axolotl, etc
Role in this project:
Back-end Developer & ML Engineer Contributions:250 reviews, 151 commits, 269 PRs in 2 years 2 months
Contributions summary:Changmin primarily contributed to the model conversion process within the repository, specifically focusing on integrating and converting different model types, including those from GPTQ, into a format compatible with the BigDL-LLM framework. They worked on converting model scripts into shell scripts for efficient model conversion. The user's work encompassed various aspects of model conversion, including modifying existing model conversion tools and integrating GPTQ models, which improved model deployment and usability. They also addressed code quality and documentation issues.