Haotian Zhang
Research Scientist at NVIDIA
California, United States
Summary
🤩
Rockstar🎓
Top SchoolHaotian (Carl) Zhang is a research scientist with nine years of experience building large-scale vision and multimodal foundation models, now at NVIDIA after a pivotal research stint at Apple where he helped design AFM and led development of MM1/MM1.5 and the UI-focused Ferret family. His work bridges core research and applied systems—pioneering hybrid region representations for grounding, comprehensive ablation studies for multimodal pretraining, and practical pipelines that ship across mobile and TV platforms. Earlier internships at MSR contributed to GLIP/GLIPv2, unifying localization and vision-language pretraining and earning top conference recognition, and his PhD from UW focused on monocular 3D detection and tracking. Comfortable moving models from novel research to production-scale multimodal systems, he combines deep academic rigor with product-minded engineering across vision, language, and UI understanding.
9 years of coding experience
8 years of employment as a software developer
Doctor of Philosophy - PhD Electrical and Computer Engineering, Doctor of Philosophy - PhD Electrical and Computer Engineering at University of WashingtonBachelor of Science (BS) Electrical and Electronics Engineering, Bachelor of Science (BS) Electrical and Electronics Engineering at Shanghai Jiao Tong University
English, Chinese, Shanghainese, Spanish
Github Skills (98)
markdown10
visual-question-answering10
weakly-supervised-learning10
vision-and-language10
jekyll10
platform-independent9
nlp9
computer-vision9
simulator9
python9
deep-learning9
unreal9
foundation-models9
pytorch9
machine-learning9
Programming languages (4)
Github contributions (5)
Haotian-Zhang/haotian-zhang.github.io
May 2017 - Sep 2021
Contributions:36 pushes in 4 years 4 months
templategithub-pages-templatemmistakesmistakesjekyll
Haotian-Zhang/Learn_SLAMBOOK
Jul 2018 - Aug 2018
Contributions:46 commits, 39 pushes, 1 branch in 22 days
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.