# All robots will spider the domain User-agent: * Disallow: # Disallow directory /admin/ User-agent: * Disallow: /admin/ # Disallow directory /emp/ User-agent: * Disallow: /emp/ # Disallow directory /js/ User-agent: * Disallow: /js/