C

cloud-crawler

Settings | Report Duplicate

0

I Use This!

Inactive

Commits : Listings

Analyzed 5 days ago. based on code collected 6 days ago.

Commit Message	Contributor	Files Modified	Lines Added	Lines Removed	Code Location	Date
Mar 26, 2025 — Mar 26, 2026 Showing page 1 of 6 Search / Filter on:
missing param in knife config file	Charles Martin	More...				over 11 years ago
Update cloud-crawler.gemspec	Charles Martin	More...				almost 12 years ago
Delete urls	Charles Martin	More...				almost 12 years ago
Delete RELEASE_0.2_REQUIREMENTS	Charles Martin	More...				almost 12 years ago
Delete TODO	Charles Martin	More...				almost 12 years ago
Delete WISHES	Charles Martin	More...				almost 12 years ago
Delete #.po#	Charles Martin	More...				almost 12 years ago
nil?	Charles H Martin	More...				about 12 years ago
random user agents	Charles H Martin	More...				about 12 years ago
a	Charles H Martin	More...				about 12 years ago
minor test update	Charles H Martin	More...				over 12 years ago
test was not testing headless	Charles H Martin	More...				over 12 years ago
Merge pull request #18 from DavidLGoldberg/new_headless	Charles Martin	More...				over 12 years ago
Speeding up headless_wait in tests.	David L. Goldberg	More...				over 12 years ago
Fixes global tests.	David L. Goldberg	More...				over 12 years ago
Adds headless option for page's js content.	David L. Goldberg	More...				over 12 years ago
minor bug, page store was being saved even if save_batch is not specified. must specify save_batch to save the page store	Charles H Martin	More...				over 12 years ago
Merge remote-tracking branch 'upstream/master' into new_headless	David L. Goldberg	More...				over 12 years ago
Merge remote-tracking branch 'upstream/master' into new_headless	David L. Goldberg	More...				over 12 years ago
debugging bloomfilter	Charles H Martin	More...				over 12 years ago
added local saved_urls to cache until after post_batch / s3 save a bit wasteful for memory if we are saving already to s3_cache could use memory optimization here	Charles H Martin	More...				over 12 years ago
debugging bloomfilter: still not working as expected in batch crawl and mayb e not crawl job	Charles H Martin	More...				over 12 years ago
bloomfilter turned off by accdient	Charles H Martin	More...				over 12 years ago
dsl common test spec note that vanilla string compression does not yet work, only objects	Charles H Martin	More...				over 12 years ago
Changing example url.	David L. Goldberg	More...				over 12 years ago
Requiring headless.	David L. Goldberg	More...				over 12 years ago
skeleton spec for compress and decompess	Charles H Martin	More...				over 12 years ago
checkpointing set to false only a stop gap...be careful, could be very expensive	Charles H Martin	More...				over 12 years ago
bugs fixed in driver batch is now compressed properly	Charles H Martin	More...				over 12 years ago
bug fix in driver, not detected in spec / unit tests still debugging	Charles H Martin	More...				over 12 years ago

←
1
2
3
4
5
6
→