# Prevent access from Gigabot User-agent: Gigabot Disallow: /results # Prevent access from Gigabot User-agent: yolinkBot Disallow: * User-agent: * Disallow: /emailafriend Disallow: /sendopinion Disallow: /login Disallow: /quickregister Disallow: /print Disallow: /results* Disallow: /xml/mobileapp/ Disallow: /scripts/edit/data/ Disallow: /abstract* Disallow: /lookbook/includes/* Disallow: /lookbook/search* Disallow: /lookbook/ajax/* User-agent: Googlebot-News Disallow: /article/ibm/ Sitemap: http://adage.com/adage.map_index.xml # Allow Google to access all assets through our CDN User-agent: * Allow: /assets/* Allow: /images/*