Hao Jin is a Staff Software Engineer in Palo Alto with 11 years of experience building high-performance cloud and ML systems, currently driving GenAI efficiency work on Google Cloud Vertex AI. He brings deep C++ and Python expertise and a strong ML-infrastructure track record from Meta and A9/Amazon, where he shipped large-scale LLM optimizations, model-system co-design, and GPU-serving improvements that materially reduced costs and raised throughput. A former EE student turned CMU-trained CS master, Hao blends DSP, circuits and computer-architecture intuition with practical systems engineering, enabling wins like sequence-length-aware dispatching and FP16 quantization without model regressions. He is an active contributor to Apache MXNet—implementing and hardening operators such as Correlation and LeakyReLU—which underscores his commitment to open-source ML tooling. Colleagues rely on him for bridging research and production: migrating training stacks, designing runtime/inductor integrations, and founding resource-aware tooling that informed modeling choices.
11 years of coding experience
8 years of employment as a software developer
Bachelor of Science (BS) Computer Engineering, Bachelor of Science (BS) Computer Engineering at University of Illinois Urbana-Champaign
Master of Science (M.S.) Computer Science, Master of Science (M.S.) Computer Science at Carnegie Mellon University
Bachelor of Engineering (BE) Electrical Electronics and Communications Engineering, Bachelor of Engineering (BE) Electrical Electronics and Communications Engineering at Shanghai Jiao Tong University
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
Role in this project:
Back-end Developer & ML Engineer
Contributions:141 commits, 437 PRs, 223 pushes in 2 years 1 month
Contributions summary:Hao's commits primarily focus on enhancing the functionality of the `mxnet` deep learning library. They implemented and improved the `Correlation` operator, making it compatible with various data types, including the addition of comprehensive unit tests. Additional contributions included adding support for the `LeakyReLU` operator, improving the `L2Normalization` operator, and addressing an issue in `sample_multinomial_op.h`, as well as optimizing other existing operators.
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.