Gerson Kroiz
Senior ML AI Software Engineer at Google
Seattle, Washington, United States
Summary
🤩
Rockstar🎓
Top SchoolGerson Kroiz is a Senior ML/AI Software Engineer based in Seattle with seven years of experience bridging research and production across ML/NLP, HPC, and full-stack systems. At Google he develops AI code-assist tools and designs resiliency and optimization strategies for large-scale distributed training on TPUs and GPUs, building on earlier work integrating PyTorch Lightning with TPU stacks. His background includes mechanistic interpretability research, hands-on startup CTO experience launching a monetized NLP product, and academic projects in spatiotemporal modeling and scalable numerical methods. Comfortable moving code from prototype to production, he combines deep math and systems intuition—often optimizing parallel workflows and compiler-like performance paths that aren’t obvious from typical ML resumes.
6 years of coding experience
3 years of employment as a software developer
UMBC
Github Skills (54)
lightning10
pytorch10
artificial-intelligence10
python10
data-science10
lifecycle10
acceleration10
machine-learning10
large-language-models10
scaling10
numpy10
llm-inference10
llm10
cost-management10
infrastructure10
Programming languages (6)
Github contributions (5)
gkroiz/lit-gpt
Jun 2023 - May 2024
Implementation of the StableLM/Pythia/INCITE language models based on nanoGPT. Supports flash attention, LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Contributions:141 pushes, 16 branches in 11 months
gkroiz/Megatron-LM
Jun 2023 - Aug 2024
Ongoing research training transformer models at scale
Contributions:590 pushes, 14 branches, 1 comment in 1 year 2 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.