User-agent: * Disallow: /nocrawl/ Disallow: /Access_Logs/ Disallow: /_db_backups/