Slow down the MSNBot

Add comment    

Johannes Beus

According to an article on webmasterworld.com, you are now able to limit the MSNBot:

User-Agent: msnbot
Crawl-Delay: 20

where20 is the amount of seconds that the MSNBot is supposed to wait between two pageviews.

• SEO Blog
  • Homepage
  • RSS-Feed, Full Feed
  • Über the blog, Blog charts
  • Archiv: 2003, 2004, 2005, 2006, 2007, 2008, 2009, 2010, 2011, 2012

• More posts
  • AdSense WebSearch
  • Overture with minimum turnover
  • AOL purchases Advertising.com
  • GMail Competition follows suit
  • Google PageRank Checksum Calcul...
  • Google wants to appeal to small...
  • Technology-preview for MSN-Search
  • MSN-Search gets a Facelift
  • GMail bans Account sale
  • Espotting merges with FindWhat.com
•