Rishi Bommasani is a PhD candidate at Stanford CS researching the societal impacts of AI with a focus on foundation models, where he helped build and now leads research activities at the Stanford Center for Research on Foundation Models (CRFM). Backed by an NSF Graduate Research Fellowship and advised by Percy Liang and Dan Jurafsky, he blends rigorous NLP research with system-level evaluation work. He contributes to open frameworks like HELM, helping improve transparency and benchmarking for language, vision-language, and text-to-image models. With prior internships on Mozilla’s DeepSpeech team and dual undergraduate training in computer science and mathematics from Cornell, he brings both applied engineering experience and strong theoretical grounding. Based in Palo Alto, he has seven years of experience shaping how large models are measured and governed, often focusing on evaluation scenarios and metric design that surface real-world harms and limitations.
7 years of coding experience
Bachelor's Degree, Computer Science, Bachelor's Degree, Computer Science at Cornell University
Doctor of Philosophy - PhD, Computer Science, Doctor of Philosophy - PhD, Computer Science at Stanford University
Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in HEIM (https://arxiv.org/abs/2311.04287) and vision-language models in VHELM (https://arxiv.org/abs/2410.07112).
Role in this project:
Back-end Developer
Contributions:16 reviews, 254 commits, 11 PRs in 10 months
Contributions summary:Rishi primarily worked on the `helm` repository, contributing to the scenario configurations and metrics. Their commits focused on fixing scenario names and finalizing scenarios. They also made changes to benchmarking files, including alterations to run specifications and basic metrics, which suggests involvement in the core evaluation framework logic.
Contributions:212 commits, 1 PR, 252 pushes in 3 years 4 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.