# robots.txt for http://www.arara.org User-agent: * # general Disallow: /LP-36-1.html # Request-rate: 1/5 # maximum rate is one page every 5 seconds # Visit-time: 0600-0845 # only visit between 06:00 and 08:45 UTC (GMT)