Avinash Raj
Senior System Software Engineer at NVIDIA
Madurai, Tamil Nadu, India
Summary
👤
Senior🎓
Top SchoolAvinash Raj is a Senior System Software Engineer with a decade of experience building Python-first web and systems software, now applying his expertise at NVIDIA after seven years shaping APIs and LLM-enabled services at HEAVY.AI. He specializes in backend API development with Django, Flask and FastAPI, and has practical experience running custom LLMs on Hugging Face using Llama CPP and VLLM as well as contributing to LangChain. Comfortable across cloud and container tooling from GCP and Docker to SaltStack, Avinash bridges research-grade language model deployment and production-grade engineering. Based in Madurai, he combines hands-on implementation with a curiosity for pushing LLM performance in constrained environments, making him adept at turning experimental NLP work into reliable, scalable services.
11 years of coding experience
10 years of employment as a software developer
Btech Information Technology, Btech Information Technology at Hindusthan college of engineering and technology
English, Tamil
Stackoverflow
173,455reputation
21.4mreached
6,190answers
124questions
sql
top-5%
unix
top-5%
mysql
top-5%
ruby
top-5%
java
top-1%
sorting
top-5%
Github Skills (160)
python10
windows10
bash10
websocket10
grep10
gevent10
sed10
gpu10
pydata10
cpp10
pydantic10
javascript10
chatgpt10
r10
pandas10
Programming languages (10)
Github contributions (5)
Avinash-Raj/RegexTester
Jan 2016 - May 2016
Contributions:36 commits, 4 PRs, 28 pushes in 4 months
testingregular-expressionregular
Avinash-Raj/vllm
Jan 2024 - Mar 2025
A high-throughput and memory-efficient inference and serving engine for LLMs
Contributions:9 pushes, 5 branches in 1 year 1 month
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.