Rui Wang - Software Engineer at The Apache Software Foundation

Rui Wang

Software Engineer at The Apache Software Foundation

Greater Seattle Area United States

Join Prog.AI to see contacts

Summary

🤩

Rockstar

🎓

Top School

Rui Wang is a seasoned software engineer with 12 years of experience specializing in backend systems, distributed storage, and data processing, currently contributing to Apache Spark at Databricks. He is an active Apache committer across multiple flagship projects—including Spark, Calcite, Beam, Ratis, and Ozone—where he has fixed SQL bugs, added BigQuery dialect support, implemented consensus and snapshot fixes, and improved table and catalog APIs. His work demonstrates deep expertise in query processing, type systems, and distributed consistency, with notable contributions to widely used open-source engines like Apache Spark and Calcite. Rui holds an MS in Computer Science from Carnegie Mellon and a dual-background bachelor’s combining international politics with computational science, a mix that sharpens his systems thinking and communication. He’s comfortable navigating both low-level protocol details and high-level SQL semantics, and often moves between refactors, tests, and production-facing features. Colleagues rely on him to bridge rigorous correctness (unit and integration tests) with pragmatic enhancements that improve developer and operator experience.

12 years of coding experience

Bachelor's degree, International Politics && Information and computational science, Bachelor's degree, International Politics && Information and computational science at Sun Yat-Sen University

Master of Science (MS), Computer Science, Master of Science (MS), Computer Science at Carnegie Mellon University

English

Stackoverflow

Stats

799reputation

59kreached

37answers

0questions

Github Skills (53)

apache-calcite10

ozone10

debug10

consensus10

c-language10

bigquery10

postgresql10

admin10

back-end-development10

evaluation10

datatypes10

expressions10

data-engineering10

testing10

databases10

Programming languages (8)

JavaC++ShellScalaGoHTMLJupyter NotebookPython

Github contributions (5)

cmu-db/peloton

Apr 2016 - May 2016

The Self-Driving Database Management System

Role in this project:

Back-end Developer

Contributions:194 commits, 8 PRs, 15 comments in 1 month

Contributions summary:Rui primarily focused on implementing and improving expression-related functionalities within the database management system. Their work involved adding copy functions to existing expressions, which included modifications to headers, and testing these additions. The commits show work related to string, date, plan nodes, and hash range expressions within the project. This demonstrates a focus on enhancing the system's core logic for query processing.

management-systemrdbmsdatabase-management-systemself-drivingdatabase

apache/spark

Mar 2022 - Jan 2023

Apache Spark - A unified analytics engine for large-scale data processing

Role in this project:

Back-end Developer & Data Engineer

Contributions:1202 reviews, 6 commits, 247 PRs in 9 months

Contributions summary:Rui contributed to the Apache Spark codebase by addressing a bug related to data type mismatches in the HAVING clause within SQL queries, adding support for the `split_part()` function, and adding support for boolean and binary types when casting partition values to a target type. They also worked on the deduplication of relations in nested subquery expressions. Furthermore, the user improved the support for creating and listing tables and also implemented the API for accessing related functionalities, such as `CacheTable`, `isCached`, `UncacheTable`, `setCurrentCatalog`, `currentCatalog`, `listCatalogs`.

analyticspythondata-processingsqlapache

Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.

Request Free Trial