User-agent: * Disallow: /member.php Disallow: /search.php Disallow: /slideshow.php Disallow: /goto.php Crawl-delay: 5 Request-rate: 1/5 # maximum rate is one page every 5 seconds Visit-time: 0000-0400 # only visit between 06:00 and 08:45 UTC (GMT)