Go-idn is a project that hopes to bring IDN and Stringprep to Go and aims to become feature compatible with libidn.
This library is in an EARLY stage, since I've only just forked and updated it from the original Google Code repository. Things WILL CHANGE and things MAY NOT WORK properly yet.
robots.txt exclusion protocol implementation for Go language (golang).
Contains logically separate parser and checker.
Parser may be used to check robots.txt file for correctness.
Checker may be used for may-i-visit-this-url kind of queries against parsed robots.txt data.
This site uses cookies to give you the best possible experience.
By using the site, you consent to our use of cookies.
For more information, please see our
Privacy Policy