Chongming Ni
Machine Learning Engineer at Amazon Web Services (AWS)
United States
Summary
🤩
Rockstar🎓
Top SchoolChongming Ni is a machine learning engineer at Amazon Web Services with a year of industry experience and a strong background in cloud systems and computational biology. At AWS he has worked on Hyperplane and now focuses on inference optimization for Trainium, blending low-level systems thinking with ML deployment needs. Previously he engineered cloud dataplane features at Cisco, giving him practical expertise in high-throughput, production networking and distributed systems. Trained at Carnegie Mellon (M.S. Computational Biology) and Tsinghua (dual B.S. in Economics and Biochemistry), he brings a rare cross-disciplinary perspective that informs pragmatic model-serving solutions. Colleagues describe him as an engineer who translates research-grade ideas into efficient, scalable inference pipelines.
1 year of coding experience
3 years of employment as a software developer
B.S. Economics, B.S. Economics at Tsinghua UniversityM.S. Computational Biology, M.S. Computational Biology at Carnegie Mellon University
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (21)
pytorch10
llama10
inference10
tpu10
amd10
llm10
mlops10
llmops10
xpu10
cuda10
transformer10
gpt10
chips5
aws-services5
deep-learning3
Programming languages (1)
Github contributions (5)
chongmni-aws/vllm
Sep 2024 - Oct 2024
Contributions:7 pushes, 1 branch in 10 days
aws-neuron/upstreaming-to-vllm
Nov 2024 - Mar 2025
A high-throughput and memory-efficient inference and serving engine for LLMs
Contributions:1 review, 1 push, 1 branch in 3 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.