Irony: If Google Can't Reach Your Robots.txt File, It Might Not List Your Site
I reported at the Search Engine Roundtable this morning that Google said if your robots.txt is unreachable, your site might not make it into the Google index. By unreachable, Google means that if your server simply times …