Zheng Luo is a Senior Software Engineer specializing in AI inference and distributed systems with a decade of experience building production-scale cloud infrastructure. He helped found and scale the AWS Bedrock LLM inference platform from zero to over 100,000 GPUs, partnering closely with a top-tier AI unicorn to productionize large language model workloads. Before that he was a founding engineer on AWS WorkSpaces Secure Browser, designing microservices for enterprise remote browser lifecycles. His background in physics and data science (Fudan) and an MS in Computer Science (UC Irvine) informs a pragmatic, systems-oriented approach to LLMOps and cloud-native design. Now at NVIDIA, he continues to focus on pushing LLM inference performance and reliability at scale. Colleagues describe him as an engineer who pairs deep infrastructure expertise with a clear obsession for operational robustness.
10 years of coding experience
7 years of employment as a software developer
Undergraduate, Physics & Data Science, Undergraduate, Physics & Data Science at Fudan University
Contributions:37 commits, 21 PRs, 29 pushes in 1 month
user-page1point3acresphpcrawlforums
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Zheng Luo - Senior Software Engineer, AI Inference at NVIDIA