Muthu A
Software Development Engineer II at Amazon
Sunnyvale, California, United States
Summary
👤
Senior🎓
Top SchoolMuthu A is a seasoned software engineer with 11 years of experience, currently optimizing LLM inference at Amazon to power the shopping assistant Rufus with low-latency, high-throughput production traffic (~1,500 TPS). He has driven measurable impact—boosting system throughput by 30%—by implementing continuous batching, streaming responses, and building benchmarking/profiling tools that exposed key deployment optimizations. Prior work spans GNN-driven ranking and behavior-transfer techniques that contributed to multi-million dollar revenue gains, plus infrastructure migrations and abuse-reordering systems that improved platform trust. With an MS in Computer Science from USC and hands-on experience with vLLM, AWS Neuron, and ANN search, he blends research rigor (computational biology and remote sensing projects) with production-scale ML systems engineering. Muthu’s uncommon mix of academic research and large-scale deployment experience helps bridge model-level insights to robust, observable inference pipelines.
11 years of coding experience
5 years of employment as a software developer
Master of Science - MS, Computer Science, Master of Science - MS, Computer Science at University of Southern CaliforniaBachelor of Technology - BTech, Information Technology, Bachelor of Technology - BTech, Information Technology at College of Engineering, Guindy
English, Tamil, Hindi
Github Skills (5)
processingjs5
pong4
ping2
javascript1
flask1
Programming languages (3)
Github contributions (5)
ceg-website/cegannauniv
Sep 2015 - Oct 2015
Contributions:42 commits, 6 pushes in 16 days
amuthu1996/academicpages.github.io
Sep 2018 - May 2019
Contributions:76 pushes, 1 branch in 7 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.