User-Agent: * # Disallow all crawlers access to certain pages. Disallow: /images Disallow: /map Disallow: /*ref=* Disallow: /stats