Vijay Korthikanti
Principal Research Scientist at NVIDIA
Hyderabad, Telangana, India
Summary
🤩
Rockstar🎓
Top SchoolVijay Korthikanti is a Principal Research Scientist based in Hyderabad with 11 years of experience specializing in large-scale deep learning, parallel computing, and hardware-software co-design. At NVIDIA he leads research for LLM training and inference (Megatron), drawing on prior roles at Cerebras, Intel/Nervana, and Synopsys where he bridged solver research, scalable ML systems, and accelerator-aware software. He holds a PhD from UIUC and has a track record of turning formal methods and parallel algorithms into production-grade ML infrastructure. Known for working at the intersection of algorithms and silicon, he brings both theoretical rigor and pragmatic engineering to scale model training and inference.
11 years of coding experience
9 years of employment as a software developer
B Tech Computer Science, B Tech Computer Science at Indian Institute of Technology, GuwahatiPhD Computer Science, PhD Computer Science at University of Illinois Urbana-Champaign
Github Skills (16)
transformers10
transformer-models10
transformer10
machine-learning10
pytorch10
scale10
nlp10
deep-learning10
large-language-models10
bert9
temporal-data9
pytorch-lightning9
language-model9
ray7
mixture-of-experts6
Programming languages (1)
Github contributions (4)
kvareddy/wolver
Jan 2015 - Apr 2015
Contributions:4 pushes in 3 months
kvareddy/apex
Aug 2022 - Aug 2022
A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
Contributions:1 push in 1 day
pytorchraymixed-precisiondeep-learningdistributed-training
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.