Weiwei Yang
California, United States
Summary
🤩
RockstarWeiwei Yang is a Data & AI infrastructure engineer with nine years building large-scale, production-grade compute and scheduling systems, currently scaling elastic GPU and batch LLM inference platforms at Apple. He blends hands-on architecture and implementation—designing Spark services, virtual queues, multi-tenancy, and cloud autoscaling—with deep open-source leadership as a long-time Apache committer and co-creator/VP of YuniKorn. His contributions span core Hadoop/YARN internals, resource schedulers, and refactoring build/dependency systems in projects like Apache YuniKorn and Hadoop, reflecting a knack for simplifying complex distributed systems. Based in California, he mentors multiple Apache incubating projects and served as CNCF batch WG co-chair, signaling a rare combination of production impact and ecosystem stewardship. Notably, he led the first large-scale batch LLM inference infrastructure on cloud at Apple, prioritizing simplicity, efficiency, and observability.
10 years of coding experience
Github Skills (18)
dependency-management10
hadoop10
java10
javas10
go10
logging10
distributed-systems9
kubernetes-pods8
filesystem8
kubernetes8
data-structures6
datastructures-algorithms6
algorithms6
algorithm6
data-structure6
Programming languages (10)
Github contributions (5)
apache/yunikorn-core
Mar 2019 - May 2022
Apache YuniKorn Core
Role in this project:
Back-end Developer
Back-end DeveloperContributions:3 releases, 185 reviews, 194 commits in 3 years 2 months
Contributions summary:Weiwei primarily focused on updating dependencies and refactoring the codebase to be self-contained, indicating a focus on build processes and dependency management within the YuniKorn project. The commits also include modifications to core components, such as the logging system. The user's contributions involved changes to various core packages within the YuniKorn project. These changes suggest the user is working on the core functionalities of the project.
universal-resource-scheduleryunikornapacheapache-yarnkubernetes
apache/hadoop
Apr 2017 - Mar 2020
Apache Hadoop
Role in this project:Back-end Developer
Back-end DeveloperContributions:1 review, 533 commits, 1 PR in 2 years 11 months
Contributions summary:Weiwei's contributions primarily involved back-end development in the Hadoop ecosystem. The user addressed issues related to javadoc descriptions, short-circuit read failures, and lock avoidance in DataNode. Furthermore, the user made code changes to the Distributed Shell and applied improvements to the BlockReceiver and web UI components.
apache-hadoophadoop
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.