# Tells all crawlers not to enter into directories of a website:
User-agent: *
Disallow: /emails/
Disallow: /files/
Disallow: /old/