Polite, slim and concurrent web crawler.
Role in this project:
Back-end Developer Contributions:3 releases, 199 commits, 12 PRs in 8 years 9 months
Contributions summary:Martin primarily focused on implementing and refactoring core functionality for the web crawler. Contributions include introducing multi-goroutine support, adding log levels and logging improvements, and integrating the purell library for URL normalization. They also refactored the agent component and introduced a mechanism to handle requests based on head request before get setting, and implemented tests for checking the new features of the web crawler.
web-crawlercrawlerrobots-txt
A little like that j-thing, only in Go.
Role in this project:
Back-end Developer & Test Automation Engineer Contributions:21 releases, 13 reviews, 287 commits in 10 years 4 months
Contributions summary:Martin primarily contributed to adding and modifying features within the `goquery` library, a project for HTML parsing in Go. They implemented the `.Attr()` method to retrieve attribute values, significantly expanding the library's capabilities. The user also developed comprehensive unit tests for the added functionality and existing methods. The user's contributions demonstrate a focus on adding core functionality and ensuring the library's reliability.
goselector-stringsjqueryhtml-parsinggoquery