Today I'm at customer side and checked the configs. Seems like the web site cannot be crawled due to some misconfigurations in the Login module stack.
Do you use SPNego, too? What does your authentication stack look like?
Added:
Problem solved. After switching from SPNego to basic authentication everything works fine. Seems like I have to reconfigure authentication :-)
Message was edited by: Carsten Buechert