De Huo
Senior System Software Engineer at NVIDIA
Seattle, Washington, United States
Summary
🤩
Rockstar🎓
Top SchoolDe Huo is a system software engineer based in Seattle who builds and optimizes large-scale GPU and cloud inference platforms. With a background spanning OCI compute and AI services at Oracle to Triton inference work at NVIDIA, he focuses on distributed model serving, GPU resource management, Kubernetes, and production-grade model training/serving pipelines. Proficient in Python, Rust, Go, C++, Java, and shell scripting, he brings a systems-first approach to cloud-native ML infrastructure and low-level performance engineering. Early work on hypervisor fleet CI/CD, image building and large fleet patching gives him practical expertise in reliability and automation for at-scale compute environments. Although relatively early in his career, he has rapidly progressed into senior roles driving LLM and CV serving initiatives across cloud and edge deployments. His cross-cutting experience—spanning virtual machine infrastructure to GPU-backed inference—makes him effective at bridging infra, runtime, and ML serving concerns.
1 year of coding experience
5 years of employment as a software developer
University of California Santa CruzBachelor of Engineering Electrical Engineering and Automation, Bachelor of Engineering Electrical Engineering and Automation at Hohai University
English, Chinese
Github Skills (13)
tensorrt10
nvidia-docker10
nvidia10
machine-learning10
triton10
deep-learning10
inference10
gpu10
post-processing9
logic9
backend9
python7
core-library6
Programming languages (2)
Github contributions (4)
triton-inference-server/triton_cli
Feb 2025 - Mar 2025
Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inference Server.
Contributions:2 releases, 9 reviews, 16 PRs in 1 month
triton-inference-server/server
Feb 2025 - Apr 2025
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Contributions:5 reviews, 1 PR, 73 pushes in 1 month
nvidia-dockernvidiadeep-learninggpuinference
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.