# robots.txt User-agent: * Disallow: Disallow:/login.asp Disallow:/register.asp Disallow:/en/login.asp Disallow:/en/register.asp