User-agent: * Disallow: /cgi-bin/ Disallow: /styles/ Disallow: /messaging/ Disallow: /temporary-stuff/ User-agent: LiteFinder Disallow: / #doesn't understand absolute/relative addresses, generates scads of 404s