Daoyuan Wang
技术专家 at Alibaba Group
Minhang District, Shanghai, China
Summary
🤩
Rockstar🎓
Top SchoolDaoyuan Wang is a seasoned backend engineer and technical expert with 12 years of experience building and hardening large-scale data processing systems, currently based in Minhang District, Shanghai and working at Alibaba Group. He has deep Hadoop/Spark expertise from a multi-year tenure at Intel and notable open-source contributions to Apache Spark—implementing SQL features, fixing edge cases in date/timestamp handling, and improving dynamic partitioning—and to the HiBench benchmarking suite where he streamlined configurations and removed redundant code. Comfortable operating across production code, refactors, and performance-oriented bug fixes, he combines pragmatic engineering with attention to data correctness and operational robustness. His Zhejiang University computer science background underpins a methodical approach to complex distributed systems, and his work reveals a preference for improving long-lived infrastructure over chasing greenfield novelty.
12 years of coding experience
5 years of employment as a software developer
Bachelor of Science (BS), Computer Science, Bachelor of Science (BS), Computer Science at Zhejiang University
Stackoverflow
21reputation
64reached
3answers
0questions
Github Skills (19)
hadoop-mapreduce10
scripting10
configuration-management10
bash10
mapreduce10
hadoop10
java10
scala10
javas10
sql10
data-structure9
data-structures9
datastore7
storage7
databases7
Programming languages (7)
Github contributions (5)
Intel-bigdata/HiBench
Apr 2014 - Sep 2016
HiBench is a big data benchmark suite.
Role in this project:
Back-end Developer
Back-end DeveloperContributions:40 commits, 3 PRs, 5 pushes in 2 years 5 months
Contributions summary:Daoyuan primarily contributed to the HiBench big data benchmark suite by fixing bugs, removing redundant code, and updating configurations related to the PageRank benchmark. They addressed issues with unbound variables, vertices size, and deprecated variables. Furthermore, the user focused on optimizing scripts by removing useless temporary files and streamlining the execution environment, primarily within the context of Hadoop and MapReduce. This involved modifying multiple configuration files and run scripts to reflect these changes.
benchmark-databenchmarkingbenchmark-suitebig-databenchmark
apache/spark
Apr 2015 - May 2015
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:Back-end Developer
Back-end DeveloperContributions:1 review, 3 commits, 105 PRs in 15 days
Contributions summary:Daoyuan primarily contributed to the backend of the Apache Spark project, focusing on improvements and bug fixes within the SQL and related modules. Their work included implementing features such as cross join and supporting the data structures, and handling edge cases in areas like date/timestamp conversion and dynamic partition keys. Additionally, the user was involved in refactoring and improving the code of existing functions and fixing related bugs.
analyticspythondata-processingsqlapache
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.