acc: Add contains.py helper script (#3345)

## Changes
- New script 'contains' for acceptance tests.
- Update some tests to use that.
- Modify musterr not to log anything in the common case (when error did
happen). The log messages from musterr and contains.py race and result
in unstable output (musterr some_script | contains.py message).

## Why
This both records snapshot and communicates intent. 

#3339 (comment)

Author: denik

.wsignore

@@ -17,22 +17,8 @@ experimental/python/docs/images/databricks-logo.svg
 # In order to prevent that difference, hello.txt does not have a trailing newline.
 acceptance/selftest/record_cloud/volume-io/hello.txt
 
-# error output when artifact build fails contains trailing whitespace:
-acceptance/bundle/artifacts/shell/err-bash/output.txt
-acceptance/bundle/artifacts/shell/err-sh/output.txt
-
-# "bundle init" has trailing whitespace:
-acceptance/bundle/templates-machinery/helpers-error/output.txt
-
-# "bundle deploy" with apps has trailing whitespace:
-integration/bundle/testdata/apps/bundle_deploy.txt
-
-# Extra whitespace in test output:
-acceptance/bundle/resource_deps/bad_syntax/out.plan.terraform.txt
-acceptance/bundle/upload/internal_server_error/output.txt
-
-# Extra whitespace in command help:
-acceptance/cmd/workspace/apps/output.txt
+# bundle commands leave empty lines at the end; too many to list individually:
+acceptance/**/out*.txt
 
 # Extra whitespace in generated commands:
 cmd/workspace/**/*.go

acceptance/bin/contains.py

@@ -0,0 +1,18 @@
+#!/usr/bin/env python3
+import sys
+
+targets = sys.argv[1:]
+assert targets
+found = set()
+
+for line in sys.stdin:
+    sys.stdout.write(line)
+    for t in targets:
+        if t in line:
+            found.add(t)
+
+sys.stdout.flush()
+
+not_found = set(targets) - found
+for item in sorted(not_found):
+    sys.stderr.write(f"contains error: {item!r} not found in the output.\n")

acceptance/bundle/lifecycle/prevent-destroy/out.direct-exp.txt

@@ -4,8 +4,6 @@ Error: resources.pipelines.my_pipelines has lifecycle.prevent_destroy set, but t
 resources.schemas.my_schema has lifecycle.prevent_destroy set, but the plan calls for this resource to be recreated or destroyed. To avoid this error, disable lifecycle.prevent_destroy for resources.schemas.my_schema
 
 
-Exit code (musterr): 1
-
 >>> errcode [CLI] bundle plan
 recreate pipelines.my_pipelines
 
@@ -16,8 +14,6 @@ Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/prevent-destroy/de
 Error: resources.pipelines.my_pipelines has lifecycle.prevent_destroy set, but the plan calls for this resource to be recreated or destroyed. To avoid this error, disable lifecycle.prevent_destroy for resources.pipelines.my_pipelines
 
 
-Exit code (musterr): 1
-
 >>> errcode [CLI] bundle plan
 recreate pipelines.my_pipelines
 recreate schemas.my_schema
@@ -30,8 +26,6 @@ Error: resources.pipelines.my_pipelines has lifecycle.prevent_destroy set, but t
 resources.schemas.my_schema has lifecycle.prevent_destroy set, but the plan calls for this resource to be recreated or destroyed. To avoid this error, disable lifecycle.prevent_destroy for resources.schemas.my_schema
 
 
-Exit code (musterr): 1
-
 >>> errcode [CLI] bundle plan
 recreate pipelines.my_pipelines
 recreate schemas.my_schema

acceptance/bundle/lifecycle/prevent-destroy/out.terraform.txt

@@ -24,8 +24,6 @@ the scope of the plan using the -target flag.
 
 
 
-Exit code (musterr): 1
-
 >>> errcode [CLI] bundle plan
 Error: exit status 1
 
@@ -59,8 +57,6 @@ the scope of the plan using the -target flag.
 
 
 
-Exit code (musterr): 1
-
 >>> errcode [CLI] bundle plan
 Error: exit status 1
 
@@ -114,8 +110,6 @@ the scope of the plan using the -target flag.
 
 
 
-Exit code (musterr): 1
-
 >>> errcode [CLI] bundle plan
 recreate pipelines.my_pipelines
 recreate schemas.my_schema

acceptance/bundle/open/output.txt

@@ -23,8 +23,6 @@ Deployment complete!
 Opening browser at [DATABRICKS_URL]/jobs/[NUMID]?o=[NUMID]
 Error: exec: "open": cannot run executable found relative to current directory
 
-Exit code (musterr): 1
-
 === test auto-completion handler
 >>> [CLI] __complete bundle open ,
 foo

acceptance/bundle/python/restricted-execution/output.txt

@@ -17,9 +17,5 @@ value_from_env
 Error: Running Python code is not allowed when DATABRICKS_BUNDLE_RESTRICTED_CODE_EXECUTION is set
 
 
-Exit code (musterr): 1
-
 >>> musterr cat envs.txt
 cat: envs.txt: No such file or directory
-
-Exit code (musterr): 1

acceptance/bundle/resource_deps/bad_ref_string_to_int/out.plan.direct-exp.txt

@@ -4,5 +4,3 @@ Error: cannot plan resources.jobs.foo: cannot update tasks[0].run_job_task.job_i
 
 Error: planning failed
 
-
-Exit code (musterr): 1

acceptance/bundle/resource_deps/bad_ref_string_to_int/out.plan.terraform.txt

@@ -12,5 +12,3 @@ Error: Incorrect attribute value type
 Inappropriate value for attribute "job_id": a number is required.
 
 
-
-Exit code (musterr): 1

acceptance/bundle/resource_deps/create_error/out.deploy.direct-exp.txt

@@ -12,5 +12,3 @@ Error: cannot create resources.jobs.bar: dependency failed: resources.jobs.foo
 Error: cannot create resources.jobs.baz: dependency failed: resources.jobs.foo
 
 Updating deployment state...
-
-Exit code (musterr): 1

acceptance/bundle/resource_deps/create_error/out.deploy.terraform.txt

@@ -11,5 +11,3 @@ Error: cannot create job: INJECTED
 
 
 Updating deployment state...
-
-Exit code (musterr): 1