# Make changes for all web spiders # see http://support.microsoft.com/support/kb/articles/Q217/1/03.ASP User-agent: * #Disallow: / Disallow: User-agent: W3C-checklink Disallow: