User-agent: * Disallow: /auth/ Disallow: /bitrix/ Disallow: /search/index.php