python_crawler

I Use This!

Inactive

Analyzed about 8 hours ago. based on code collected about 8 hours ago.

Project Summary

Python-driven web crawler and scraper. Uses BeautifulSoup to gather all URLs from a target page, and initiates a crawl from a start URL, considering Whitelist/Blacklist criteria that are populated in crawl.py

In a Nutshell, python_crawler...

...
has had 15 commits made by 1 contributors
representing 283 lines of code
...
is mostly written in Python
with a very low number of source code comments
...
has a codebase with a very short history
maintained by nobody
with stable Y-O-Y commits
...
took an estimated 1 years of effort (COCOMO model)
starting with its first commit in July, 2011
ending with its most recent commit almost 14 years ago

Quick Reference

Project Links:

Homepage
Download

Code Locations:

https://github.com/arbuckle/pyth...

Similar Projects:

Managers:

Become the first manager for python_crawler

This Project has No vulnerabilities Reported Against it

Did You Know...

...
nearly 1 in 3 companies have no process for identifying, tracking, or remediating known open source vulnerabilities
...
compare projects before you chose one to use
...
55% of companies leverage OSS for production infrastructure
...
check out hot projects on the Open Hub