The country's new robots.txt file
Someone beat me to this. The old robots.txt file for the whitehouse was massive. Pages would also come and go based on statements made then retracted like you can alter facts. They even had entries for 911 - something that we DO want search engines to fine. This is your tax dollars hard at work.
It is very cool the new one is so short, and that it was done in less than 24hrs. Let’s hope it stays this way!
