Yuchen Jin
Member Of Technical Staff at Databricks
San Francisco, California, United States
Summary
🤩
Rockstar🎓
Top SchoolYuchen Jin is an experienced ML systems engineer and technical leader with eight years building production-grade ML compilers, model-serving infrastructure, and GPU-accelerated inference platforms from research prototypes to commercial products. Based in San Francisco, he co-founded Hyperbolic to deliver GPU cloud and AI inference services and previously led development of Relax, the next-generation graph-level language in the Apache TVM compiler while at OctoML. His open-source contributions to TVM and mlc-llm show deep backend and systems expertise—implementing Relax VM codegen and DLPack Python array API support and expanding Rust-based ChatModule support for universal LLM deployment. He blends research rigor (PhD work at University of Washington) with hands-on engineering, shipping LR scheduling and distributed training improvements in industry internships. Colleagues rely on him to simplify interoperability bottlenecks between runtimes, compilers, and serving layers, and he has a knack for surfacing usability fixes that materially improve deployability.
8 years of coding experience
5 years of employment as a software developer
Doctor of Philosophy - PhD, Computer Science, Doctor of Philosophy - PhD, Computer Science at University of WashingtonBachelor's degree, Computer Science, Bachelor's degree, Computer Science at Huazhong University of Science and Technology
Github Skills (18)
develop10
c-language10
language-model10
compilation10
python10
machine-learning10
llm10
compiler-compiler10
vms10
compile10
cuda10
compiler10
rust10
cprogramming-language10
tvm9
Programming languages (5)
Github contributions (5)
apache/tvm
May 2021 - Jul 2021
Open deep learning compiler stack for cpu, gpu and specialized accelerators
Role in this project:
Back-end Developer & ML Engineer
Back-end Developer & ML EngineerContributions:45 reviews, 10 commits, 26 PRs in 3 months
Contributions summary:Yuchen primarily contributed to the development of the Relax VM, a core component of the TVM project, focusing on its codegen and shape lowering aspects. Their work involved implementing support for the new Python array API with DLPack and addressing documentation issues, indicating a focus on improving interoperability and usability. Furthermore, the user refactored and updated the codebase, including renaming "gpu" to "cuda," integrating new VM functionalities, and optimizing code generation, demonstrating proficiency in compiler development within the context of machine learning.
metalvulkancompilertensoropencl
mlc-ai/mlc-llm
Sep 2023 - Jan 2024
Universal LLM Deployment Engine with ML Compilation
Role in this project:ML Engineer
ML EngineerContributions:8 PRs, 8 comments in 3 months
Contributions summary:Yuchen primarily contributes to the project by enhancing the `ChatModule` functionality, which is essential for the deployment of LLMs. Their work involves debugging the emoji handling in the REST API, indicating a focus on practical model serving and usability. The user also introduced and expanded Rust support within the repository, including the addition of Rust-based ChatModule interface, further demonstrating a contribution in LLM deployment. Furthermore, they modified the ChatModule API to support multiple prompts and improved its overall ergonomics.
language-modelllmmachine-learning-compilationtvm
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.