Problems crawling websites - website does not show in root

Hi guys

I have problems accessing a couple of websites, and they all seem to have the same problem, so I would really appreciate your help.

I have set up the web repositories according to "How to set up a Web Repository and Crawling it for Indexing", but I cannot see the website in the KM root. If I go to the component monitor and take a look at the repositories there, I can see the following error is returned: "HEAD /: 401 Access Denied".

I have noticed that these three sites have a pop-up, where you have to type in user/pass in order to access the webservers. Is the information entered in the HTML system under "User" and "Password" not forwarded to this dialog-box?

Or is there another place where I have to type in user/pass before the crawler is able to automatically enter and crawl the site?

Any help will be rewarded.

Best regards,

Martin