User-agent: * Disallow: /auth/ Disallow: debug.html Disallow: test.html