Check for robots

Easy script to check robots.txt content

Author
Alfonso Gomez
Daily installs
0
Total installs
23
Ratings
1 0 0
Version
0.1
Created
2017-08-02
Updated
2017-08-02
License
N/A
Applies to
All sites

Script designed to check the content of robots.txt file without the need of visiting the URL.