Gavin Li
Senior Software Engineer - AI Inference Platform
New York, New York, United States
Summary
🤩
Rockstar🎓
Top SchoolGavin Li is a Senior Software Engineer with a decade of experience building distributed systems and production-grade services, currently focused on AI inference platform engineering at Bloomberg in New York. He progressed from hands-on roles developing RabbitMQ-based data pipelines and microservices in Java, Python and Go to leading engineering teams responsible for scalable, resilient infrastructure. Gavin has a strong track record of optimizing system performance and reliability—examples include designing real-time monitoring tools and cutting search latency by 80% earlier in his career. Comfortable across the stack, he brings DevOps fluency with Docker, CI/CD, cloud provisioning and observability tooling to production ML deployment challenges. His background blends rigorous software engineering training (MS in Software Engineering) with practical experience troubleshooting live systems on call, which informs pragmatic architecture and operational decisions. Colleagues rely on him for turning complex distributed requirements into maintainable, testable platforms that keep high-throughput services running.
10 years of coding experience
12 years of employment as a software developer
Master's degree of Computer Science major in Software Engineering Software Engineering, Master's degree of Computer Science major in Software Engineering Software Engineering at The University of Texas at DallasBachelor's degree of engineering Electronic and Information Engineering, Bachelor's degree of engineering Electronic and Information Engineering at Shanghai University of Electric power
English, Chinese
Github Skills (30)
xgboost10
pytorch10
kubernetes10
artificial-intelligence10
kubeflow10
machine-learning10
inference10
standardized10
hpa10
llm-inference10
sklearn10
client-go10
mlops10
tensorflow10
aws10
Programming languages (2)
Github contributions (5)
HotsauceLee/kserve
Aug 2024 - Feb 2025
Standardized Serverless ML Inference Platform on Kubernetes
Contributions:88 pushes, 8 branches in 5 months
HotsauceLee/Leetcode
Apr 2016 - Sep 2021
Contributions:635 pushes, 1 branch in 5 years 6 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.