User-agent: * Disallow: /download Disallow: /assets Disallow: /error Disallow: /scripts Disallow: /random Disallow: /awstats Disallow: /cgi-bin