Rui Qiao
Software Engineer at Anyscale
San Francisco Bay Area United States
Summary
🤩
Rockstar🎓
Top SchoolRui Qiao is a software engineer based in the San Francisco Bay Area with deep expertise in distributed systems, search infrastructure, and large-scale ML runtimes. After several years leading search indexing and data-processing efforts at LinkedIn, Rui now contributes to cutting-edge LLM infrastructure at Anyscale, working on vLLM, Ray LLM, and Ray Compiled Graphs. His background includes internships at Google and Facebook focused on low-level platform research and program analysis, and he pairs strong academic credentials (MS and PhD-level study in computer science) with practical production experience. Rui is comfortable bridging research and production: he translates systems-level insights into scalable, reliable services that power search and model serving. An engineer who moves between storage, compute graphs, and inference stacks, he brings both algorithmic rigor and operational sensibility to performance-critical systems.
2 years of coding experience
7 years of employment as a software developer
Master's degree, Computer Science, Master's degree, Computer Science at Wuhan UniversityDoctor of Philosophy (Ph.D.), Computer Science, Doctor of Philosophy (Ph.D.), Computer Science at State University of New York at Stony Brook
Github Skills (28)
pytorch10
parallel10
python10
rllib10
data-science10
llama10
machine-learning10
inference10
large-language-models10
tpu10
reinforcement-learning10
java10
scaling10
amd10
llm-inference10
Programming languages (1)
Github contributions (5)
ruisearch42/vllm
Jun 2024 - Apr 2025
A high-throughput and memory-efficient inference and serving engine for LLMs
Contributions:267 pushes, 48 branches in 9 months
ruisearch42/ray
Mar 2024 - Apr 2025
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Contributions:952 pushes, 140 branches in 1 year 1 month
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.