I have problems accessing a couple of websites, and they all seem to have the same problem, so I would really appreciate your help.
I have set up the web repositories according to "How to set up a Web Repository and Crawling it for Indexing", but I cannot see the website in the KM root. If I go to the component monitor and take a look at the repositories there, I can see the following error is returned: "HEAD /: 401 Access Denied".
I have noticed that these three sites have a pop-up, where you have to type in user/pass in order to access the webservers. Is the information entered in the HTML system under "User" and "Password" not forwarded to this dialog-box?
Or is there another place where I have to type in user/pass before the crawler is able to automatically enter and crawl the site?
Any help will be rewarded.