More stats and analysis of robots.txt files
Today, we released new features for Sitemaps. — robots.txt analysis — If the site has a robots.txt file, the new robots.txt tab provides Googlebot's view of that file, including when Googlebot last accessed it, the status it returns, and if it blocks access to your home page.