# Keep spidering agents from digging into irrelevant material # or material that will get indexed in a useless way (better to # keep search results near the top of the site) User-agent: * Disallow: /include/ Disallow: include/