Analyzed
about 21 hours
ago.
based on code collected
about 21 hours
ago.
Project Summary
Scrapy is a fast high-level scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.
Badges
In a Nutshell, Scrapy...
- ...
- ...
-
...
has a well established, mature codebase
maintained by a very large development team
with stable Y-O-Y commits -
...
took an estimated 15 years of effort (COCOMO model)
starting with its first commit in June, 2008
ending with its most recent commit 3 days ago
Quick Reference
https://github.com/scrapy/scrapy
BSD 3-clause "New" or "Revised" License
Permitted
Commercial Use
Modify
Distribute
Place Warranty
Forbidden
Hold Liable
Use Trademarks
Required
Include Copyright
Include License
These details are provided for information only. No information here is legal advice and should not be used as such.
Project Security
Vulnerabilities per Version ( last 10 releases )
Project Vulnerability Report
Security Confidence Index
Poor security track-record
Favorable security track-record
Vulnerability Exposure Index
Many reported vulnerabilities
Few reported vulnerabilities
Did You Know...
-
...
nearly 1 in 3 companies have no process for identifying, tracking, or remediating known open source vulnerabilities
-
...
compare projects before you chose one to use
-
...
65% of companies leverage OSS to speed application development in 2016
-
...
you can subscribe to e-mail newsletters to receive update from the Open Hub blog
30 Day SummaryDec 26 2025 — Jan 25 2026
|
12 Month SummaryJan 25 2025 — Jan 25 2026
|
