python_crawler

I Use This!

Inactive

Analyzed about 7 hours ago. based on code collected about 7 hours ago.

Project Summary

Python-driven web crawler and scraper. Uses BeautifulSoup to gather all URLs from a target page, and initiates a crawl from a start URL, considering Whitelist/Blacklist criteria that are populated in crawl.py

In a Nutshell, python_crawler...

...
has had 15 commits made by 1 contributors
representing 283 lines of code
...
is mostly written in Python
with a very low number of source code comments
...
has a codebase with a very short history
maintained by nobody
with stable Y-O-Y commits
...
took an estimated 1 years of effort (COCOMO model)
starting with its first commit in July, 2011
ending with its most recent commit over 14 years ago

Quick Reference

Project Links:

Homepage
Download

Code Locations:

https://github.com/arbuckle/pyth...

Similar Projects:

Managers:

Become the first manager for python_crawler

This Project has No vulnerabilities Reported Against it

Did You Know...

...
nearly 1 in 3 companies have no process for identifying, tracking, or remediating known open source vulnerabilities
...
by exploring contributors within projects, you can view details on every commit they have made to that project
...
use of OSS increased in 65% of companies in 2016
...
search using multiple tags to find exactly what you need