# All robots will spider the domain User-agent:* Disallow: # Disallow directory /admin/ User-agent: * Disallow: /admin/ # Disallow directory /includes/ User-agent: * Disallow: /includes/ # Disallow directory /connections/ User-agent: * Disallow: /connections/ # Disallow directory /database/ User-agent: * Disallow: /database/ # Disallow directory /templates/ User-agent: * Disallow: /templates/