Ti Cheng
Senior Software Engineer (AI) at Clay-Technology World
Taipei, Taiwan
Summary
👤
Senior🎓
Top SchoolTi Cheng is a Senior Software Engineer specializing in LLMs and NLP with seven years of experience delivering faster, more accurate AI inference for production systems. He has hands-on expertise across Transformer architectures and inference acceleration techniques—such as speculative decoding variants (Kangaroo, Medusa, Hydra, Eagle) and ongoing Arctic Inference research—applied with tools like vLLM, SGLang, PyTorch, CUDA and Triton. Ti has led end-to-end initiatives from LoRA/QLoRA fine-tuning to building RAG systems for intelligent customer service, achieving measurable gains like 100% inference speedups and model accuracies up to 97% in commercial projects. An active open-source contributor (HuggingFace TRL, FlagEmbedding) and blogger at Clay-Technology World, he blends research-driven optimization with production engineering. Based in Taipei, he’s currently focused on fast-llm-inference and low-level GPU kernel optimization to make large models more accessible and efficient.
7 years of coding experience
4 years of employment as a software developer
Master of Science - MS, Computer Science, Master of Science - MS, Computer Science at 國立政治大學
Github Skills (26)
pytorch10
llama10
machine-learning10
inference10
tpu10
reinforcement-learning10
amd10
llm10
mlops10
deep-learning10
llmops10
language-modeling10
xpu10
cuda10
transformer10
Programming languages (1)
Github contributions (5)
ccs96307/LeetCode
May 2021 - Jan 2023
Contributions:203 commits, 317 pushes, 1 branch in 1 year 7 months
ccs96307/font-to-png
Mar 2020 - Jul 2022
Contributions:10 commits, 9 pushes, 1 branch in 2 years 4 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.