Tony Lee is a Stanford CS PhD candidate researching AI with a decade of software and ML engineering experience bridging research and production. He has held roles from senior SDE at Workday to R&D scientist at Stanford CRFM and a research engineer stint at Meta Superintelligence Labs, giving him deep expertise in model evaluation, API integration, and scalable systems. His open-source work includes backend contributions to HELM, a widely used framework for holistic language-model evaluation, where he integrated multiple vendor models and standardized tokenization/logprob metrics. He also improved robustness benchmarks in the WILDS project by tuning models and adding DistilBERT support, reflecting a practical focus on distributional shifts. Based in Palo Alto and advised by Percy Liang, Tony combines rigorous academic training with hands-on implementation skills across ML stacks. Colleagues value him for turning complex evaluation problems into maintainable, well-tested engineering solutions.
11 years of coding experience
10 years of employment as a software developer
University of California, San Diego
Doctor of Philosophy - PhD Computer Science, Doctor of Philosophy - PhD Computer Science at Stanford University
Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.
Role in this project:
Back-end Developer
Contributions:334 reviews, 1951 commits, 251 PRs in 1 year 2 months
Contributions summary:Tony's contributions focused on implementing features related to the integration of different models such as the Anthropic language model, the GooseAI language model, and Microsoft models. They modified client client code, added support for new models, including Luminous models, and the Google PaLM models, and handled the correct tokenization and logprob metrics from different model vendors. They added a separate test and did a lot of refactoring. The work demonstrates expertise in working with language model APIs and managing their differences.
A machine learning benchmark of in-the-wild distribution shifts, with data loaders, evaluators, and default models.
Role in this project:
ML Engineer
Contributions:27 reviews, 426 commits, 29 PRs in 1 year 1 month
Contributions summary:Tony primarily focused on modifying and updating the machine learning models, specifically related to hyperparameter tuning and model selection. Their contributions included updating hyperparameters for datasets like iWildCam and Camelyon, and integrating support for DistilBERT within the project. They also fixed paths and imports related to the model implementations.
dataloadermachine-learning
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.