Amit Garg
Member Of Technical Staff at Microsoft
San Francisco Bay Area United States
Summary
👤
Senior🎓
Top SchoolAmit Garg is a Member of Technical Staff at Microsoft with a decade of experience building production-grade AI systems, specializing in fine-tuning large language models, LLM inference, and multimodal integration. He helped advance Microsoft’s Phi3 generative AI work and previously drove ML innovation at VMware, where he built end-to-end ML backends, a network intrusion detection system, and published PyPI packages. His background spans applied research—publishing IEEE conference work on transformers and GANs—to hands-on engineering with cloud platforms like Azure and scalable deployment. Based in Sunnyvale, he combines research rigor with product-focused execution and holds a Master’s in Software Engineering from San José State University. An inventor at heart, he has filed multiple patents in network security, reflecting a knack for turning novel ideas into practical systems.
10 years of coding experience
4 years of employment as a software developer
Master's degree Software Engineering, Master's degree Software Engineering at San José State UniversityBachelor of Technology (BTech) ECE, Bachelor of Technology (BTech) ECE at Guru Nanak Dev University
Github Skills (32)
transformers10
pytorch10
python10
machine-learning-models10
llama10
machine-learning10
inference10
multimodal10
tpu10
amd10
llm10
audio10
deep-learning10
openai10
natural-language-processing10
Programming languages (4)
Github contributions (5)
garg-amit/vllm
Jun 2024 - Feb 2025
A high-throughput and memory-efficient inference and serving engine for LLMs
Contributions:11 PRs, 89 pushes, 13 branches in 7 months
inference
garg-amit/CaptchaAutomation
Aug 2019 - Sep 2022
Contributions:17 pushes, 2 branches in 3 years
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.