User-agent: Googlebot
User-agent: Scooter
User-agent: FAST-WebCrawler/
User-agent: Lycos_Spider_(T-Rex)
Disallow: /intranet