Dwarak Talupuru
Senior Staff Research Engineer at Cohere
London, England, United Kingdom
Summary
🎓
Top SchoolDwarak Talupuru is a Senior Staff Research Engineer based in London with eight years of experience specializing in LLM pretraining, distributed training, and performance engineering. At Cohere he leads training performance engineering and hardware-aligned architecture design, driving cost reductions for frontier models and enabling large-scale MoE training across thousands of GPUs. His background spans building TPU+JAX+Ray distributed frameworks, sparse-network research, and score-based generative models from research roles at Carnegie Mellon and startups. Known for shipping production-scale pretraining systems (Command R / R+ and Command A workstreams), he blends deep algorithmic insight with pragmatic systems optimization. Colleagues value his ability to translate hardware constraints into architecture and scaling strategies that materially lower training cost and time. He brings a rare combination of hands-on distributed systems craft and academic rigor applied to real-world LLM training challenges.
7 years of coding experience
6 years of employment as a software developer
BTech - Bachelor of Technology, BTech - Bachelor of Technology at Manipal Institute of Technologyhigh school, Computer science, high school, Computer science at velammal vidhyashram
Github Skills (64)
markdown10
neural-machine-translation10
natural-language-generation10
automatic-differentiation10
knowledge-graph10
gitpod10
github-pages10
jekyll10
modular9
multilingual9
pytorch9
autodiff9
python9
tpu9
machine-learning9
Programming languages (9)
Github contributions (5)
aced-differentiate/DeepUncertainty.jl
Aug 2021 - Feb 2022
Uncertainty quantification for Deep Learning models in Julia.
Contributions:54 commits, 29 PRs, 17 pushes in 6 months
deep-learninguncertainty-quantificationmachine-learningdeep-learning-modelsuncertainty
dbpedia/neural-rdf-verbalizer
May 2019 - Jan 2020
🗣 Multilingual RDF Verbalizer – Google Summer of Code 2019
Contributions:382 commits, 6 PRs, 15 pushes in 8 months
natural-language-generationdeep-learninggoogle-summer-of-codeknowledge-graphsummer
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.