robots.txt exclusion protocol implementation for Go language (golang).
Contains logically separate parser and checker.
Parser may be used to check robots.txt file for correctness.
Checker may be used for may-i-visit-this-url kind of queries against parsed robots.txt data.
Commercial Use
Modify
Distribute
Sub-License
Private Use
Hold Liable
Include Copyright
Include License
These details are provided for information only. No information here is legal advice and should not be used as such.
There are no reported vulnerabilities
30 Day SummaryMay 18 2026 — Jun 17 2026
|
12 Month SummaryJun 17 2025 — Jun 17 2026
|