Google has just pushed some updates to the reduce the Google crawl rate documentation. Most of the changes are just organizational to the content on the page but under the "Urgently reduce crawler ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results