Joshua Shapiro
Staff Machine Learning Engineer at AKASA
Washington, District of Columbia, United States
Summary
🤩
Rockstar🎓
Top SchoolJoshua Shapiro is a Staff Machine Learning Engineer with seven years of experience building production-grade ML systems, currently leading development of AKASA's medical coding solution and inference engine for LLMs exceeding 10B parameters. He combines research-to-production expertise—from language modeling and conversational AI at ASAPP to deep learning and temporal state detection at IBM Watson Research—with a focus on scalable, compute-agnostic tooling that accelerates iteration and cuts latency and training time. His recent work reduced inference latency 7x using VLLM, lifted entity extraction accuracy by 20%, and standardized offline evaluation to closely mirror production outcomes. Joshua also teaches a senior capstone course at George Washington University, bringing industry best practices into the classroom and mentoring the next generation of engineers. Comfortable across NLP, vision, and systems, he’s notable for automating heterogeneous compute workflows and shipping infrastructure that makes large models practical in regulated healthcare settings.
7 years of coding experience
11 years of employment as a software developer
Bachelor’s Degree Computer Science, Bachelor’s Degree Computer Science at The George Washington University - School of Engineering & Applied ScienceBachelor’s Degree Computer Science, Bachelor’s Degree Computer Science at Korea UniversityHigh School, High School at Jesuit High School
Github Skills (8)
recurrent-neural-networks10
arxiv9
gru9
nlp8
pytorch7
lstm7
deep-learning7
tensorflow5
Programming languages (1)
Github contributions (3)
asappresearch/aum
Mar 2020 - Dec 2020
Contributions:3 releases, 9 commits, 2 PRs in 8 months
ASAPPinc/sync-slack-status
Dec 2018 - Apr 2019
Contributions:6 pushes, 1 branch in 4 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.