Can I also crawl projects that are protected by a .htaccess file?

Yes, the optimizer also supports access via .htcaccess to projects or sections thereof. To share the proper credentials with our crawler, click on “Settings” at the top right of your project and then go to “Crawler”. There, you will find two input fields for the user name and password for the HTTP-credentials. After you’ve entered and stored these values, the SISTRIX crawler uses these credentials, beginning with the next crawl.

optimizer_http-credentials