Xingbo Jiang
Senior Software Engineer at Databricks
Fremont, California, United States
Summary
🤩
Rockstar🎓
Top SchoolXingbo Jiang is a Senior Software Engineer with a decade of experience building and optimizing distributed data systems, currently contributing to Apache Spark at Databricks from Fremont, CA. With a strong academic foundation in mathematics and computer science from Peking University, he brings deep expertise in databases, distributed systems, and data warehousing. His open-source work includes a notable Spark SQL optimizer fix to PushDownPredicate that prevents incorrect query results in non-deterministic conditions, and technical writing to keep Spark’s documentation and website accurate. Prior roles at Meituan and AppChina grounded him in large-scale data engineering and backend development. Colleagues rely on him for pragmatic, correctness-first solutions to complex query and optimizer challenges.
10 years of coding experience
7 years of employment as a software developer
Bachelor’s Degree, Mathematics, Bachelor’s Degree, Mathematics at Peking University
Github Skills (21)
apache-spark10
spark10
scala10
manage10
sql10
documentation10
website-admin10
optimizers9
optimizer9
big-data9
html8
testing8
algorithm7
algorithms7
data-structure7
Programming languages (3)
Github contributions (5)
apache/spark
Nov 2016 - Aug 2021
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer
Back-end DeveloperContributions:72 reviews, 14 commits, 190 PRs in 4 years 9 months
Contributions summary:Xingbo primarily contributed to improving the `PushDownPredicate` rule within the Apache Spark SQL module. They addressed issues related to predicate reordering in non-deterministic conditions to prevent incorrect results, specifically within the Optimizer component. The changes involved modifications to the `Optimizer.scala` and `FilterPushdownSuite.scala` files to enhance the handling of complex SQL queries. This included the expansion of test cases to ensure the fix's correctness.
analyticspythondata-processingsqlapache
apache/spark-website
Oct 2018 - Dec 2019
Apache Spark Website
Role in this project:Technical Writer
Technical WriterContributions:5 commits, 7 PRs, 2 pushes in 1 year 2 months
Contributions summary:Xingbo primarily contributed to the Apache Spark website by adding and updating documentation and examples. This includes adding documentation for the 3.0.0-preview release and updating the download page to reflect this new version. Furthermore, the user addressed an issue where preview versions were inappropriately listed in release notes for stable releases.
pythonsqlapachebig-dataspark
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.