haoze
PhD Candidate
China
Summary
🤩
Rockstarhaoze is a PhD candidate and software engineer with nine years of hands-on experience building resilient back-end systems and data collection tools. Based in China, they have notably improved an open-source Sina Weibo crawler by fixing edge-case bugs, adding incremental "append" mode, cookie verification, and SQLite support to boost robustness and avoid rate limits. Their work demonstrates a pragmatic blend of research-driven rigor and production-focused engineering, particularly around reliable data ingestion. Comfortable with Python and back-end optimizations, haoze brings a careful attention to stability and incremental improvements that make systems more maintainable and scalable.
9 years of coding experience
Github Skills (12)
crawler10
debugging10
debug10
python10
webscraping10
sqlite9
optimization9
optimisation9
numerical-optimization9
algorithm9
code-optimization9
algorithms9
Programming languages (8)
Github contributions (5)
dataabc/weibo-crawler
Mar 2022 - Apr 2022
新浪微博爬虫，用python爬取新浪微博数据，并下载微博图片和微博视频
Role in this project:
Back-end Developer
Back-end DeveloperContributions:3 reviews, 10 commits, 7 PRs in 1 month
Contributions summary:Haoze primarily focused on enhancing the functionality and stability of the weibo-crawler project. They addressed bugs related to invalid user IDs and optimized the sleep time within the `get_user_info()` function to prevent being rate-limited. The user also implemented an "append" mode to the crawler, enabling incremental data retrieval. Furthermore, they added cookie verification and SQLite database support, increasing the project's robustness.
pythonweibo-spiderspiderweibocrawler
haozewu/linux-shell-example
Feb 2018 - Mar 2023
Contributions:2 PRs, 24 pushes, 5 branches in 5 years 2 months
unixmpilinuxunix-shellshell
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.