Noah Liu
Senior Software Engineer at Inspur Group
Hualien City, Taiwan Province
Summary
👤
Senior🎓
Top SchoolNoah Liu is a senior software engineer with 7 years of experience specializing in AI/ML system design and software-hardware co-design, currently based in Hualien, Taiwan. At Inspur he architected a high-security, self-hosted AI Agent platform using vLLM and local LLMs, delivering real-time, ChatGPT-like streaming with a 70% reduction in Time To First Token and strong on-premise data protection. He has deep backend and full-stack skills—FastAPI, SSE, Vue 3—and experience deploying optimized local inference on NVIDIA/ARM GPUs with multi-GPU tensor parallelism. His background spans firmware to cloud automation, from porting Android drivers and touchpad firmware to building Python-based test automation and CI/CD for LLM serving. Notably, he designed a TOON-format conversation pipeline that cuts token usage by 30–60% and engineered autonomous web-crawling Agents for real-time data synthesis. He combines practical low-level engineering with applied AI architecture to keep sensitive workflows performant and private.
7 years of coding experience
6 years of employment as a software developer
Master's Degree Electrical and Electronics Engineering, Master's Degree Electrical and Electronics Engineering at National Chiao Tung UniversityEE IC design Firmware, EE IC design Firmware at NCTU
English, Chinese
Github Skills (10)
validators9
cosmos9
tendermint7
android-applications6
chrome5
debug5
kotlin4
android4
developer-tools2
stetho2
Programming languages (1)
Github contributions (5)
thumbb13555/RoomDataBaseExample
Apr 2020 - Mar 2021
Contributions:5 commits, 3 pushes, 1 branch in 11 months
thumbb13555/CSVExample
May 2020 - Jul 2021
Contributions:3 commits, 2 pushes, 1 branch in 1 year 1 month
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.