# robots.txt file for crawlers User-agent: * # All robots