# All robots will spider the domain User-agent: * Disallow: # Disallow directory /logs/ User-agent: * Disallow: /logs/ # Disallow directory /premium/ User-agent: * Disallow: /premium/ Disallow: /styles/ Disallow: /img/ Disallow: /sven/