Alexander Havrilla
Research Scientist at Google DeepMind
United Kingdom
Summary
🤩
Rockstar🎓
Top SchoolAlexander Havrilla is a research scientist at Google DeepMind with eight years of experience at the intersection of reinforcement learning and large language models, building methods for open-ended reasoning and synthetic data to improve AI reasoning. He holds a Doctor of Science in Machine Learning from Georgia Tech and has a track record of research internships at Meta, Microsoft, and Google, plus leadership in the open-source research group CarperAI where he helped drive practical RL-from-human approaches. His work spans theoretical probability research at CMU to applied model fine-tuning and synthetic data generation, reflecting both rigorous foundations and engineering impact. Based in the UK, he combines academic depth with startup-style initiative—evident from co-founding CarperAI and winning a StabilityAI PhD fellowship—making him adept at moving ideas from theory to open-source tools and production research.
8 years of coding experience
4 years of employment as a software developer
Doctor of Science Machine Learning, Doctor of Science Machine Learning at Georgia Institute of TechnologyMathematics and Computer Science, Mathematics and Computer Science at Carnegie Mellon UniversityDiploma College Prep, Diploma College Prep at Woodland Hills Junior Senior High School
Github Skills (48)
pytorch10
python10
machine-learning10
reinforcement-learning10
deep-learning10
tensorflow10
gpu10
natural-language-processing10
fairness-ml10
language-modeling10
transformer10
speech-recognition10
nlp10
transformers9
numpy9
Programming languages (6)
Github contributions (5)
Dahoas/Dahoas.github.io
Dec 2020 - Mar 2025
Contributions:79 pushes, 1 branch in 4 years 3 months
CarperAI/trlx
Jul 2022 - Dec 2022
Train transformer language models with reinforcement learning.
Contributions:70 commits, 2 PRs, 25 pushes in 4 months
nlpdeep-learningreinforcement-learningmachine-learningtransformer
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.