By default, our Optimizer crawler will use the following user agent when crawling your homepage:
Mozilla/5.0 (compatible; Optimizer)
In the project settings you can customize the user-agent according to your wishes and requirements. The next time the crawler is run, we will use the new user-agent you provided.
Access by the optimizer crawler always takes place via an IP address whose reverse DNS entry resolves to *.crawler.sistrix.net – this way you can make sure that it is really us crawling your domain and that nobody is abusing our user-agent.
