User-agent: dotbot Disallow: / User-agent: * Disallow: /bin/ Disallow: /CSS/ Disallow: /images/ Disallow: /includes/ Disallow: /JavaScript/ Disallow: /_style/ Disallow: /customError.aspx/ Disallow: /results.aspx