Avinash Raj is a Senior System Software Engineer with a decade of experience building Python-first web and systems software, now applying his expertise at NVIDIA after seven years shaping APIs and LLM-enabled services at HEAVY.AI. He specializes in backend API development with Django, Flask and FastAPI, and has practical experience running custom LLMs on Hugging Face using Llama CPP and VLLM as well as contributing to LangChain. Comfortable across cloud and container tooling from GCP and Docker to SaltStack, Avinash bridges research-grade language model deployment and production-grade engineering. Based in Madurai, he combines hands-on implementation with a curiosity for pushing LLM performance in constrained environments, making him adept at turning experimental NLP work into reliable, scalable services.
10 years of coding experience
10 years of employment as a software developer
Btech Information Technology, Btech Information Technology at Hindusthan college of engineering and technology
Contributions:29 commits, 2 PRs, 3 pushes in 15 days
javathirukkural
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Avinash Raj - Senior System Software Engineer at NVIDIA