WWW::RobotRules - database of robots.txt-derived permissions

WWW: https://metacpan.org/pod/WWW::RobotRules
