Tianhao Zhou
Senior Software Engineer Gemini Model Optimization
Sunnyvale, California, United States
Summary
👤
Senior🎓
Top SchoolTianhao Zhou is a Senior Software Engineer based in Sunnyvale with nine years of experience building high-performance ML runtimes and production AI services. Currently focused on optimizing Gemini models at Google, he makes large language models faster, cheaper, and more capable while previously enabling bidirectional streaming and MoE prototypes for the same platform. His background includes system-level runtime and FPGA work at Xilinx—contributing to the widely used XRT project by improving debugging, profiling, and 64-bit counter handling—which underscores his strength in low-level performance and observability. Tianhao pairs academic rigor from UC Berkeley and international engineering training with hands-on experience in vision ML, robotics, and on-device NLU, enabling him to bridge research prototypes and production systems. Known for a practical, code-first approach (and a sense of humor about boba), he excels at making complex AI infrastructure reliable and debuggable.
9 years of coding experience
Master's degree Computer Science, Master's degree Computer Science at University of California, BerkeleyBachelor’s Degree Computer Engineering, Bachelor’s Degree Computer Engineering at University of Michigan College of EngineeringComputer Engineering, Computer Engineering at Technische Universität BerlinBachelor's degree Electrical Engineering and Computer Science, Bachelor's degree Electrical Engineering and Computer Science at Shanghai Jiao Tong University
Stackoverflow
804reputation
77kreached
10answers
19questions
Github Skills (19)
debugging10
debug10
c-language10
windowsrt10
linux-kernel10
cprogramming-language10
winrt10
system-design9
vitis9
fpga9
dart6
swift6
firebase6
flutter6
react6
Programming languages (19)
Github contributions (5)
Xilinx/XRT
Nov 2018 - May 2019
Run Time for AIE and FPGA based platforms
Role in this project:
Backend Developer & System Architect
Backend Developer & System ArchitectContributions:39 commits, 28 PRs, 32 comments in 6 months
Contributions summary:Tianhao primarily contributed to the backend of the `xrt` repository, specifically focusing on enhancing debugging capabilities and integrating performance monitoring. Their commits added checks for application debug loading and improved error messages, enhancing usability. Key contributions included modifying the debug IP layout read function, which involved adding version number reading, and fixing 64-bit counter issues, which indicates work on system level data structures. These changes suggest a focus on improving the runtime environment's debugging and profiling infrastructure.
vitisxilinxlinux-kernelxrtfpga
tianhaoz95/check-group-test
Sep 2020 - Feb 2022
Contributions:245 PRs, 38 pushes, 32 branches in 1 year 5 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.