New robots.txt commands: make sure that Google can index your site
It seems that Google is currently experimenting with new robots.txt commands. If your robots.txt file accidentally contains one of the new commands, it might be that your robots.txt file tells Google to go away.
What is a robots.txt file?
The robots.txt file is a simple text file that must be placed in your root directory (http://www.example.com/robots.txt). It [...]
RSS
