KB: HTTP401 error when using FQDN / custom host header to access IIS Virtual Server instead of local server name

Problem: Windows Server 2003 SP1 or later includes the Loopback Check security feature which blocks authentication if the FQDN or custom host header does not match the local server name.

Symptoms in SharePoint:

  • Get password prompt for 3 times and eventually authentication failure when accessing sites with FQDN / custom host header. But no problem when using local server name.
  • InfoPath Form Services data connection error 5566 when connecting SharePoint web services with FQDN / custom host header. But no problem when using local server name.

Resolution: http://support.microsoft.com/kb/896861 

Method 1: Specify host names (Preferred method if NTLM authentication is desired)

To specify the host names that are mapped to the loopback address and can connect to Web sites on your computer, follow these steps:

  1. Set the DisableStrictNameChecking registry entry to 1. For more information about how to do this, click the following article number to view the article in the Microsoft Knowledge Base:

    281308 (http://support.microsoft.com/kb/281308/ ) Connecting to SMB share on a Windows 2000-based computer or a Windows Server 2003-based computer may not work with an alias name

  2. Click Start, click Run, type regedit, and then click OK.
  3. In Registry Editor, locate and then click the following registry key:

    HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Lsa\MSV1_0

  4. Right-click MSV1_0, point to New, and then click Multi-String Value.
  5. Type BackConnectionHostNames, and then press ENTER.
  6. Right-click BackConnectionHostNames, and then click Modify.
  7. In the Value data box, type the host name or the host names for the sites that are on the local computer, and then click OK.
  8. Quit Registry Editor, and then restart the IISAdmin service.