Gokul Nadathur
Manager, PyTorch Distributed at Meta
Fremont, California, United States
Summary
🤩
Rockstar🎓
Top SchoolGokul Nadathur is a seasoned engineering leader with 20+ years of experience designing high-performance distributed systems and a decade focused on scalable AI infrastructure. Currently managing PyTorch Distributed at Meta, he drives strategy and core components for large-scale training—everything from TorchTitan and N-dimensional parallelism to the communication layers used in Llama pre-training and recommendation model scaling. His background spans storage and networking performance (NetApp, PernixData) to production ML platforms for Ads, Instagram, and Reels, giving him rare end-to-end expertise from low-level I/O and RDMA to HPC GPU clusters. Known for translating deep systems knowledge into practical, production-grade infrastructure, he blends academic rigor (MS, UW–Madison) with hands-on engineering across startups and hyperscale environments. An underappreciated strength is his knack for spotting cross-layer performance opportunities that unlock order-of-magnitude gains in real workloads.
10 years of coding experience
16 years of employment as a software developer
MS, Computer Science, MS, Computer Science at University of Wisconsin-MadisonB.Tech, Computer Science, B.Tech, Computer Science at Indian Institute of Technology (Banaras Hindu University), Varanasi
English, Tamil, Hindi
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (15)
neural-network10
acceleration10
machine-learning10
tensor10
deep-learning10
tensorflow10
gpu-acceleration10
gpu10
python10
numpy10
autograd10
pipeline6
pytorch5
controlling2
deploying2
Programming languages (1)
Github contributions (5)
gnadathur/Coding
Jun 2016 - Aug 2022
Contributions:6 PRs, 20 pushes, 4 branches in 6 years 2 months
cppc-plus-pluscpp17generic
gnadathur/papers
Jun 2016 - Sep 2016
Contributions:2 pushes, 1 branch in 2 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.