Slow down the MSNBot

Johannes Beus
Johannes Beus
13. June 2004
Johannes Beus
Johannes Beus
Johannes Beus ist Gründer und Geschäftsführer von SISTRIX.

According to an article on webmasterworld.com, you are now able to limit the MSNBot:

User-Agent: msnbot
Crawl-Delay: 20

where20 is the amount of seconds that the MSNBot is supposed to wait between two pageviews.

Related posts
Comments
Comments will be closed 30 days after the post was published.