Gene Der Su is a Senior Member of Technical Staff based in San Francisco with 11 years of experience building large-scale ML and data systems. Currently focused on training LLMs at scale on AMD hardware, he brings deep expertise in distributed ML serving from his work at Anyscale and contributions to the popular Ray project improving Serve’s HTTP/gRPC proxy, health checks, and scalability. His background spans end-to-end ML infrastructure—data pipelines, model training and promotion, simulation frameworks, and automated lineage—built across AWS services and on-prem clusters. He’s shipped production-grade pipelines that cut costs and execution time dramatically, migrated complex systems to Kubernetes/EKS, and engineered both offline and online ML abstractions. Equally comfortable in back-end DevOps and model engineering, he pairs practical systems design with hands-on optimization for stability and performance. A practical problem-solver, he often bridges research and production by turning experimental models into robust, observable services.
10 years of coding experience
10 years of employment as a software developer
Master's Degree Computer Science, Master's Degree Computer Science at University of California, Davis
Nanodegree Machine Learning, Nanodegree Machine Learning at Udacity
Bachelor's Degree Applied Mathematics with Physics emphasis, Bachelor's Degree Applied Mathematics with Physics emphasis at University of California, Merced
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Role in this project:
Back-end & DevOps Engineer
Contributions:4 releases, 1089 reviews, 369 PRs in 1 year 10 months
Contributions summary:Gene focused on improving the Ray Serve framework, particularly in its HTTP proxy and gRPC server functionalities. Their commits included enhancements to error handling and message construction for the gRPC proxy, along with improvements to health checks, proxy status management, and request handling. The user also implemented changes to improve scalability, stability, and robustness of the proxy and Serve's CLI.
Contributions:11 commits, 10 pushes, 1 branch in 6 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.