Adding a robots.txt #577

Job	Run time
Set CI/CD metadata	7s
Commit stage / Scan secrets	8s
Commit stage / Check Markdown format	6s
Commit stage / Scan dependencies	25s
Commit stage / Check file format	7s
Commit stage / Check English usage	16s
Commit stage / Lint Terraform	5s
Commit stage / Count lines of code	8s
Test stage / Linting	4s
Test stage / Unit tests	5s
Test stage / Perform static analysis	5m 15s
Test stage / Test coverage	6s
Build stage	0s
Acceptance stage	0s
	6m 52s

Provide feedback