Weiyuan Wu
Software Engineering Advisor at D2X Group
Burnaby, British Columbia, Canada
Summary
🤩
Rockstar🎓
Top SchoolWeiyuan Wu is a software engineering advisor and researcher with 13 years' experience specializing in data-intensive systems and tooling. He brings deep systems-level expertise in Rust (7+ years) and Python, pairing production-grade engineering with academic rigor as a PhD candidate at Simon Fraser University. His open-source contributions include significant refactoring and core-performance work on widely used data projects (dataprep and connector-x), improving data loading and EDA tooling across Rust and Python boundaries. Past roles span data engineering and security-focused research, giving him practical experience building data warehouses, anti-spam/image search systems, and WAF rule generators. He also explores crypto trading strategies in his spare time, reflecting a curiosity for applied experimentation beyond his core research. Based in Burnaby, BC, he blends low-level performance optimization with data science tooling to make large-scale data workflows more reliable and accessible.
13 years of coding experience
2 years of employment as a software developer
BS, Information Security, 3.7, BS, Information Security, 3.7 at University of Electronic Science and Technology of ChinaDoctor of Philosophy - PhD, Doctor of Philosophy - PhD at Simon Fraser University
Chinese, English
Github Skills (13)
data-loading10
rust10
python10
eda9
exploratory-data-analysis9
data-structure9
dask9
pandas9
dataprep9
data-preprocessing9
data-structures9
memory-management9
testing8
Programming languages (23)
Github contributions (5)
sfu-db/connector-x
Jan 2021 - Nov 2022
Fastest library to load data from DB to DataFrames in Rust and Python
Role in this project:
Back-end Developer
Back-end DeveloperContributions:22 reviews, 406 commits, 47 PRs in 1 year 9 months
Contributions summary:Weiyuan updated the codebase by adding and modifying code across multiple files. Their contributions primarily focused on core functionalities such as memory allocation, testing, and integration with various libraries and dependencies, including Rust and Python. Key changes involved restructuring code and creating new components like a string writer and boolean columns for internal use cases. The user appears to be focused on enhancing the data loading process and optimizing the underlying data structures.
polarspythondataframesdataframerust
sfu-db/dataprep
May 2019 - Oct 2022
Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.
Role in this project:Full-stack Developer
Full-stack DeveloperContributions:29 releases, 92 reviews, 488 commits in 3 years 6 months
Contributions summary:Weiyuan primarily focused on refactoring and restructuring the `dataprep` project, creating the initial project structure, and creating package structures. These changes include the addition of a `setup.py` file for the installation and building of the project. The user also worked on integrating the project dependencies, and introduced features in the EDA module, creating and updating several plotting functions.
pythondatadataprepcleaningdatacleaning
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.