Rory Qi
ASF Member at Datastrato
United States
Summary
🤩
Rockstar🎓
Top SchoolRory Qi is a senior software engineer and Apache Software Foundation member with a decade of experience building distributed systems, remote shuffle services, and security features for large-scale data platforms. He chairs the Apache Uniffle PMC and serves on the Apache Gravitino PMC, contributing substantive back-end and DevOps work such as refactoring core modules, stabilizing tests, and initiating a Kubernetes operator to broaden deployment options. His industry experience spans Tencent and Baidu, where he optimized storage and compression for Iceberg, separated cold/hot storage, and improved mixed workload scheduling for Spark-based systems. At Datastrato he focuses on Gravitino security, implementing identifier authentication and access control, blending production-grade engineering with open-source stewardship. Colleagues describe him as a pragmatic problem-solver who quietly improves maintainability and deployment resilience across complex distributed codebases.
10 years of coding experience
6 years of employment as a software developer
西安电子科技大学
Github Skills (14)
javas10
spark10
shuffle10
java10
scripting9
kubernetes-pods9
devops9
shell9
script9
sh9
kubernetes9
mapreduce4
hadoop-mapreduce4
tez4
Programming languages (6)
Github contributions (5)
apache/uniffle
Jul 2022 - Nov 2022
Uniffle is a high performance, general purpose Remote Shuffle Service.
Role in this project:
Back-end & DevOps Engineer
Back-end & DevOps EngineerContributions:3 releases, 2325 reviews, 19 commits in 4 months
Contributions summary:Rory primarily contributed to the project by refactoring and fixing code style in the common, coordinator, and storage modules, improving the overall quality and maintainability of the codebase. They also worked on initializing the Kubernetes operator directory, adding scripts for building and testing the operator, thus expanding the deployment options. Furthermore, the user addressed startup shell problems by modifying environment variables and fixed a flaky test related to shuffle report generation.
rssshufflebig-datasparkpurpose
jerqi/Firestorm
Nov 2021 - Jul 2022
Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark applications to store shuffle data on remote servers
Contributions:2 PRs, 210 pushes, 82 branches in 8 months
firestormshuffleapachespark-applicationscapability
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.