python_crawler

I Use This!

Inactive

Analyzed about 14 hours ago. based on code collected 2 days ago.

Project Summary

Python-driven web crawler and scraper. Uses BeautifulSoup to gather all URLs from a target page, and initiates a crawl from a start URL, considering Whitelist/Blacklist criteria that are populated in crawl.py

In a Nutshell, python_crawler...

...
has had 15 commits made by 1 contributors
representing 283 lines of code
...
is mostly written in Python
with a very low number of source code comments
...
has a codebase with a very short history
maintained by nobody
with stable Y-O-Y commits
...
took an estimated 1 years of effort (COCOMO model)
starting with its first commit in July, 2011
ending with its most recent commit almost 15 years ago

Quick Reference

Project Links:

Homepage
Download

Code Locations:

https://github.com/arbuckle/pyth...

Similar Projects:

Managers:

Become the first manager for python_crawler

This Project has No vulnerabilities Reported Against it

Did You Know...

...
65% of companies leverage OSS to speed application development in 2016
...
check out hot projects on the Open Hub
...
there are over 3,000 projects on the Open Hub with security vulnerabilities reported against them
...
data presented on the Open Hub is available through our API