User-agent: * Crawl-delay: 120 Disallow: /cgi-bin Disallow: /beta Disallow: /beta2