python_crawler

I Use This!

Inactive

Analyzed about 4 hours ago. based on code collected about 6 hours ago.

Project Summary

Python-driven web crawler and scraper. Uses BeautifulSoup to gather all URLs from a target page, and initiates a crawl from a start URL, considering Whitelist/Blacklist criteria that are populated in crawl.py

In a Nutshell, python_crawler...

...
has had 15 commits made by 1 contributors
representing 283 lines of code
...
is mostly written in Python
with a very low number of source code comments
...
has a codebase with a very short history
maintained by nobody
with stable Y-O-Y commits
...
took an estimated 1 years of effort (COCOMO model)
starting with its first commit in July, 2011
ending with its most recent commit about 15 years ago

Quick Reference

Project Links:

Homepage
Download

Code Locations:

https://github.com/arbuckle/pyth...

Similar Projects:

Managers:

Become the first manager for python_crawler

This Project has No vulnerabilities Reported Against it

Did You Know...

...
65% of companies leverage OSS to speed application development in 2016
...
data presented on the Open Hub is available through our API
...
use of OSS increased in 65% of companies in 2016
...
compare projects before you chose one to use

Code

Lines of Code

Activity

Commits per Month

Community

Contributors per Month

Languages

Python	100%

30 Day Summary

Jun 30 2026 — Jul 30 2026

0 Commits
0 Contributors

12 Month Summary

Jul 30 2025 — Jul 30 2026

0 Commits
0 Contributors

Most Recent Contributors

David Arbuckle

Ratings

Be the first to rate this project

Click to add your rating

Review this Project!

python_crawler

Project Summary

Tags

In a Nutshell, python_crawler...

Quick Reference

This Project has No vulnerabilities Reported Against it

Did You Know...

Code

Lines of Code

Activity

Commits per Month

Community

Contributors per Month

Languages

30 Day Summary

12 Month Summary

Most Recent Contributors

Ratings

Project Summary

Code Data

SCM Data

Community Data