Xudong Wang

Apache Arrow-Datafusion Committer

China
email-iconphone-icongithub-logolinkedin-logotwitter-logostackoverflow-logofacebook-logo
Join Prog.AI to see contacts
email-iconphone-icongithub-logolinkedin-logotwitter-logostackoverflow-logofacebook-logo
Join Prog.AI to see contacts

Summary

🤩
Rockstar
🎓
Top School
Xudong Wang is a systems-focused backend engineer and Apache Arrow–DataFusion committer with seven years building high-performance data systems. He was a founding engineer on Datafuse Labs’ query engine team where he drove optimizer work and implemented complex join and subquery execution, and previously contributed to storage and streaming projects at ByteDance and Alibaba Cloud. On GitHub he’s known for practical improvements to Apache DataFusion—adding schema-less CSV querying, UNION support, and bug fixes—and for extending real-time data mover Dozer with Python UDF support and pipeline robustness. Comfortable across query planning, execution, and storage layers, he blends production-grade engineering with open-source stewardship. Based in China, he combines deep database internals experience with a knack for removing hardcoded constraints to make systems more flexible and extensible.
code7 years of coding experience
job4 years of employment as a software developer
bookBachelor's degree Computer science, Bachelor's degree Computer science at Sichuan University
stackoverflow-logo

Stackoverflow

Stats
1reputation
0reached
0answers
0questions
github-logo-circle

Github Skills (11)

fusion10
etl10
query-engine10
apache-arrow10
rust10
sql10
data-pipelines9
python9
data-engineering9
data-pipeline9
api8

Programming languages (15)

JavaC++RustCDIGITAL Command LanguageMakefileGoHTML

Github contributions (5)

github-logo-circle
apache/datafusion

Sep 2021 - Jan 2023

Apache DataFusion SQL Query Engine
Role in this project:
userBack-end Developer
Contributions:575 reviews, 65 commits, 277 PRs in 1 year 4 months
Contributions summary:Xudong contributed to the Apache DataFusion SQL Query Engine, focusing on improving the system's functionality and addressing bugs. Their commits involved removing hardcoded values to enhance flexibility, supporting features such as querying CSV files without requiring a predefined schema and the implementation of the UNION operation. Additionally, the user addressed aliasing issues and fixed bugs.
querypythonquery-enginedataframerust
getdozer/dozer

Jan 2023 - Mar 2023

Dozer is a real-time data movement tool that leverages CDC from various sources and moves data into various sinks.
Role in this project:
userBack-end Developer
Contributions:25 reviews, 14 commits, 21 PRs in 1 month
Contributions summary:Xudong primarily contributed to improving the Dozer data movement tool's backend functionality. They bumped the `sqlparser` version, modified SQLite data type mappings, and fixed a typo. The user also worked on preventing duplicate CTE names and refactored code related to pipeline management. Furthermore, the user implemented and enhanced Python UDF support, showing a focus on extending the tool's capabilities.
realtimedatareal-time-datagrpcreal-time
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Xudong Wang - Apache Arrow-Datafusion Committer