Slow down the MSNBot

According to an article on, you are now able to limit the MSNBot:

User-Agent: msnbot
Crawl-Delay: 20

where20 is the amount of seconds that the MSNBot is supposed to wait between two pageviews.

Related posts
Comments will be closed 30 days after the post was published.