User-agent: snap.com beta crawler v0 Disallow: / User-Agent: OmniExplorer_Bot Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /index_files/ Disallow: /source_code/ Disallow: /blog/admin/ Disallow: /rssca1rp/ Disallow: /rssgro1uper/ Disallow: /mysql/read_dump.php Disallow: /PMA/read_dump.php Disallow: /phpmyadmin/read_dump.php