Project Summary
Pythonic Crawling / Scraping Framework Built on Eventlet
Features
* High Speed WebCrawler built on Eventlet.
* Supports databases engines like Postgre, Mysql, Oracle, Sqlite.
* Command line tools.
* Extract data using your favourite tool. XPath or Pyquery (A Jquery-like library for python).
* Cookie Handlers.
* Very easy to use (see the example).
Documentation
http://packages.python.org/crawley/
Badges
In a Nutshell, Crawley...
- ...
- ...
- ...
-
...
took an estimated 1 years of effort (COCOMO model)
starting with its first commit in September, 2011
ending with its most recent commit over 10 years ago
Quick Reference
GNU General Public License v3.0 or later
Permitted
Commercial Use
Modify
Distribute
Place Warranty
Use Patent Claims
Forbidden
Sub-License
Hold Liable
Required
Distribute Original
Disclose Source
Include Copyright
State Changes
Include License
Include Install Instructions
These details are provided for information only. No information here is legal advice and should not be used as such.
Project Security
Vulnerabilities per Version ( last 10 releases )
There are no reported vulnerabilities
Project Vulnerability Report
Security Confidence Index
Vulnerability Exposure Index
Did You Know...
-
...
use of OSS increased in 65% of companies in 2016
-
...
anyone with an Open Hub account can update a project's tags
-
...
65% of companies leverage OSS to speed application development in 2016
-
...
check out hot projects on the Open Hub
30 Day SummaryFeb 10 2026 — Mar 12 2026
|
12 Month SummaryMar 12 2025 — Mar 12 2026
|
