exclude ecosystem from searchengine crawlers

[merlinstuckenbrock]

Ecosystem instances should have the possibility to configure the searchability from google and other searchengines. Therefore a robots.txt should be configurable during setup process.

[tgrosser]

I can‘t imagine any reason for having a development platform, which is password protected, be findable by search engines. There is no need for a configuration option. Just install a default robots.txt which kerps away crawlers.