Adding a robots.txt (#129) #585

Job	Run time
Set CI/CD metadata	7s
Commit stage / Lint Terraform	9s
Commit stage / Scan dependencies	29s
Commit stage / Count lines of code	9s
Commit stage / Check file format	9s
Commit stage / Check Markdown format	6s
Commit stage / Check English usage	8s
Commit stage / Scan secrets	6s
Test stage / Unit tests	5s
Test stage / Linting	4s
Test stage / Test coverage	6s
Test stage / Perform static analysis	5m 16s
Build stage	0s
Acceptance stage	-1s
	6m 53s

Provide feedback