Slow down the MSNBot

According to an article on webmasterworld.com, you are now able to limit the MSNBot:

User-Agent: msnbot
Crawl-Delay: 20

where20 is the amount of seconds that the MSNBot is supposed to wait between two pageviews.

Related posts
Comments
You have to be logged in to write comments.