Assistant Professor at University of North Carolina at Chapel Hill
Palo Alto, California, United States
Join Prog.AI to see contacts
Join Prog.AI to see contacts
Summary
👤
Senior
🎓
Top School
Huaxiu Yao is an Assistant Professor at UNC-Chapel Hill with a decade of experience bridging machine learning research and practical engineering. Trained with a PhD from Penn State and postdoctoral work at Stanford, Huaxiu has contributed to high-impact ML projects and conferences across areas like meta-learning, information science, and evaluation frameworks. He has hands-on experience extending the HELM framework to add sentiment-analysis scenarios for rigorous language model evaluation, signaling a rare blend of reproducible-research focus and production-oriented implementation. His background includes internships at major industry labs (Amazon A9, Salesforce, Alibaba, Tencent, Didi), reflecting an ability to translate academic ideas into deployed solutions. Based in Palo Alto, he combines deep academic publishing with active open-source contributions and cross-disciplinary collaborations in data science and society.
10 years of coding experience
5 years of employment as a software developer
High School, High School at Zhejiang Zhoushan Middle School
Doctor of Philosophy (PhD), Information Science and Technology, Doctor of Philosophy (PhD), Information Science and Technology at Penn State University
Bachelor’s Degree, Electronic Information Engineering, Bachelor’s Degree, Electronic Information Engineering at University of Electronic Science and Technology of China
Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in HEIM (https://arxiv.org/abs/2311.04287) and vision-language models in VHELM (https://arxiv.org/abs/2410.07112).
Role in this project:
ML Engineer
Contributions:23 commits in 1 month
Contributions summary:Huaxiu implemented and integrated IMDb and IMDb-contrast-sets scenarios into the HELM framework for evaluating language models. This involved creating Python scripts for data loading, scenario definition, and defining adapter specifications for model evaluation. The user also fixed comments and formatting issues within the new scenario files. This work indicates a focus on extending the framework's capabilities to incorporate sentiment analysis tasks.
Contributions:18 commits, 2 PRs, 5 pushes in 3 years 1 month
deep-learningpytorchaaai
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.