Delete robots.txt (#1631)

We've decided to allow search engines to crawl all versions of the site again so that we can experiment with using Google Search on the docs site.

Author: josh-wong