#excludes certain directories from being indexed by search engines User-agent: * Disallow: /images/ Disallow: /aspnet_client/ Disallow: /music/ Disallow: /old_site/ Disallow: /DataBase/ Disallow: /very_old_site/ Disallow: /Library/ Disallow: /Logs/ Disallow: /cgi-bin/