V

vidageek's crawler

Settings | Report Duplicate

0

I Use This!

Inactive

Commits : Listings

Analyzed 1 day ago. based on code collected 1 day ago.

Commit Message	Contributor	Files Modified	Lines Added	Lines Removed	Code Location	Date
Jul 28, 2024 — Jul 28, 2025 Showing page 3 of 5 Search / Filter on:
fixing url encoding when there are two or more parameters	Edmilson Miyasaki	More...				over 15 years ago
changing jvm version temporarily just to compile	Edmilson Miyasaki	More...				over 15 years ago
adding url normalization code from htmlunit (https://htmlunit.svn.sourceforge.net/svnroot/htmlunit/trunk/htmlunit - commit 5556)	Jonas Abreu	More...				over 15 years ago
raising concurrency of page crawler	Jonas Abreu	More...				over 15 years ago
fixing bug when urls have invalid chars (&)	Jonas Abreu	More...				over 15 years ago
fixing bug regarding encoding check (was only checking the first few bytes)	Jonas Abreu	More...				over 15 years ago
adding Frame support to the OkPage	Edmilson Miyasaki	More...				over 15 years ago
adding support for Frameset	Edmilson Miyasaki	More...				over 15 years ago
using icu4j to detect character encoding	fabio Massa	More...				over 15 years ago
implementing NOT FOUND status code	Edmilson Miyasaki	More...				over 15 years ago
fixed bug (thread pool shutdown was not called). added fallback for when charset cannot be found	Jonas Abreu	More...				over 15 years ago
upgrading http unit to 4.0	Jonas Abreu	More...				over 15 years ago
changing user agent	Jonas Abreu	More...				over 15 years ago
accept header	Jonas Abreu	More...				over 15 years ago
adding user agent	Jonas Abreu	More...				over 15 years ago
improving logging and downloader now does not retry failed urls	Jonas Abreu	More...				over 15 years ago
releasing resources	Jonas Abreu	More...				over 15 years ago
fixed some multi-threading bugs	Jonas Abreu	More...				over 15 years ago
solving many issues.	Jonas Abreu	More...				over 15 years ago
fixing bug regarding visited pages	Jonas Abreu	More...				over 15 years ago
fixing bug regarding visited pages	Jonas Abreu	More...				over 15 years ago
fixing some memory leaks	Jonas Abreu	More...				over 15 years ago
page downloading is done concurrently to improve performance	Jonas Abreu	More...				over 15 years ago
WebDownloader is now thread safe	Jonas Abreu	More...				over 15 years ago
ignoring some content types	Jonas Abreu	More...				over 15 years ago
just refactor names	Fabio Massa	More...				over 15 years ago
added tests for default and iframe links	Fabio Massa	More...				over 15 years ago
added tests and implementations to get default and iframe urls	Fabio Massa	More...				over 15 years ago
crawler converts downloaded string to utf-8	Jonas Abreu	More...				over 15 years ago
forcing maven to use utf-8	Jonas Abreu	More...				over 15 years ago

←
1
2
3
4
5
→