# Robots.txt file for spider exclusions User-agent: * Disallow: /