python_crawler

I Use This!

Inactive

Analyzed 1 day ago. based on code collected 1 day ago.

Project Summary

Python-driven web crawler and scraper. Uses BeautifulSoup to gather all URLs from a target page, and initiates a crawl from a start URL, considering Whitelist/Blacklist criteria that are populated in crawl.py

In a Nutshell, python_crawler...

...
has had 15 commits made by 1 contributors
representing 283 lines of code
...
is mostly written in Python
with a very low number of source code comments
...
has a codebase with a very short history
maintained by nobody
with stable Y-O-Y commits
...
took an estimated 1 years of effort (COCOMO model)
starting with its first commit in July, 2011
ending with its most recent commit over 14 years ago

Quick Reference

Project Links:

Homepage
Download

Code Locations:

https://github.com/arbuckle/pyth...

Similar Projects:

Managers:

Become the first manager for python_crawler

This Project has No vulnerabilities Reported Against it

Did You Know...

...
in 2016, 47% of companies did not have formal process in place to track OS code
...
data presented on the Open Hub is available through our API
...
there are over 3,000 projects on the Open Hub with security vulnerabilities reported against them
...
anyone with an Open Hub account can update a project's tags