User-agent: *
Allow:/
Disallow: /sitemap
Disallow: /thread/
Disallow: /bot/
Disallow: /traffic/
Disallow: /article/