User-agent: twiceler Disallow: / User-agent: * Disallow: Crawl-delay: 60 Disallow: /cgi-bin/ Disallow: /tmp Disallow: /logs Disallow: /adam Disallow: /files Disallow: /tools Disallow: /admin Disallow: /adlog Disallow: /rg Disallow: /gamefly Disallow: /buy Disallow: /datafeeds Disallow: /proxy Disallow: /usage Disallow: /ridegear Disallow: /games