A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl, index, load-test or even download any web or enterprise domain and is configurable through a XML configuration file.
Phoneutria can be used for either checking the links of website or for load-testing purposes (i.e. the level of politeness can be configured).
It provides a plug-in mechanism for further extensions.
Commercial Use
Modify
Distribute
Place Warranty
Use Patent Claims
Sub-License
Hold Liable
Distribute Original
Disclose Source
Include Copyright
State Changes
Include License
Include Install Instructions
These details are provided for information only. No information here is legal advice and should not be used as such.
30 Day SummaryDec 18 2024 — Jan 17 2025
|
12 Month SummaryJan 17 2024 — Jan 17 2025
|