# FULL access (FAST/AllTheWeb) User-agent: FAST-WebCrawler Disallow: # FULL access (Google) User-agent: Googlebot Disallow: # FULL access (Inktomi) User-agent: Slurp Disallow: # PARTIAL access (All Spiders) User-agent: * Disallow: /Flash/ Disallow: /scripts/