Skip to content

chore(tests): accuracy tests for MongoDB tools exposed by MCP server MCP-39 #1249

chore(tests): accuracy tests for MongoDB tools exposed by MCP server MCP-39

chore(tests): accuracy tests for MongoDB tools exposed by MCP server MCP-39 #1249

Triggered via pull request July 16, 2025 11:26
Status Failure
Total duration 6m 16s
Artifacts 3

code_health.yaml

on: pull_request
Matrix: Run MongoDB tests
Run Atlas tests
1m 51s
Run Atlas tests
Report Coverage
33s
Report Coverage
Fit to window
Zoom out
Zoom in

Annotations

41 errors, 19 warnings, and 2 notices
tests/accuracy/drop-collection.test.ts: tests/accuracy/sdk/describe-accuracy-tests.ts#L46
Error: MDB_ACCURACY_RUN_ID env variable is required for accuracy test runs! ❯ describeAccuracyTests tests/accuracy/sdk/describe-accuracy-tests.ts:46:15 ❯ tests/accuracy/drop-collection.test.ts:28:1
tests/accuracy/delete-many.test.ts: tests/accuracy/sdk/describe-accuracy-tests.ts#L46
Error: MDB_ACCURACY_RUN_ID env variable is required for accuracy test runs! ❯ describeAccuracyTests tests/accuracy/sdk/describe-accuracy-tests.ts:46:15 ❯ tests/accuracy/delete-many.test.ts:36:1
tests/accuracy/db-stats.test.ts: tests/accuracy/sdk/describe-accuracy-tests.ts#L46
Error: MDB_ACCURACY_RUN_ID env variable is required for accuracy test runs! ❯ describeAccuracyTests tests/accuracy/sdk/describe-accuracy-tests.ts:46:15 ❯ tests/accuracy/db-stats.test.ts:19:1
tests/accuracy/create-index.test.ts: tests/accuracy/sdk/describe-accuracy-tests.ts#L46
Error: MDB_ACCURACY_RUN_ID env variable is required for accuracy test runs! ❯ describeAccuracyTests tests/accuracy/sdk/describe-accuracy-tests.ts:46:15 ❯ tests/accuracy/create-index.test.ts:21:1
tests/accuracy/create-collection.test.ts: tests/accuracy/sdk/describe-accuracy-tests.ts#L46
Error: MDB_ACCURACY_RUN_ID env variable is required for accuracy test runs! ❯ describeAccuracyTests tests/accuracy/sdk/describe-accuracy-tests.ts:46:15 ❯ tests/accuracy/create-collection.test.ts:30:1
tests/accuracy/count.test.ts: tests/accuracy/sdk/describe-accuracy-tests.ts#L46
Error: MDB_ACCURACY_RUN_ID env variable is required for accuracy test runs! ❯ describeAccuracyTests tests/accuracy/sdk/describe-accuracy-tests.ts:46:15 ❯ tests/accuracy/count.test.ts:41:1
tests/accuracy/collection-storage-size.test.ts: tests/accuracy/sdk/describe-accuracy-tests.ts#L46
Error: MDB_ACCURACY_RUN_ID env variable is required for accuracy test runs! ❯ describeAccuracyTests tests/accuracy/sdk/describe-accuracy-tests.ts:46:15 ❯ tests/accuracy/collection-storage-size.test.ts:4:1
tests/accuracy/collection-schema.test.ts: tests/accuracy/sdk/describe-accuracy-tests.ts#L46
Error: MDB_ACCURACY_RUN_ID env variable is required for accuracy test runs! ❯ describeAccuracyTests tests/accuracy/sdk/describe-accuracy-tests.ts:46:15 ❯ tests/accuracy/collection-schema.test.ts:20:1
tests/accuracy/collection-indexes.test.ts: tests/accuracy/sdk/describe-accuracy-tests.ts#L46
Error: MDB_ACCURACY_RUN_ID env variable is required for accuracy test runs! ❯ describeAccuracyTests tests/accuracy/sdk/describe-accuracy-tests.ts:46:15 ❯ tests/accuracy/collection-indexes.test.ts:20:1
tests/accuracy/aggregate.test.ts: tests/accuracy/sdk/describe-accuracy-tests.ts#L46
Error: MDB_ACCURACY_RUN_ID env variable is required for accuracy test runs! ❯ describeAccuracyTests tests/accuracy/sdk/describe-accuracy-tests.ts:46:15 ❯ tests/accuracy/aggregate.test.ts:4:1
tests/integration/tools/mongodb/delete/dropCollection.test.ts > dropCollection tool > should have correct metadata: tests/integration/helpers.ts#L211
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/helpers.ts:211:30
tests/integration/tools/mongodb/delete/deleteMany.test.ts > deleteMany tool > should have correct metadata: tests/integration/helpers.ts#L211
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/helpers.ts:211:30
tests/integration/tools/mongodb/connect/connect.test.ts > Connect tool > should have correct metadata: tests/integration/helpers.ts#L211
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/helpers.ts:211:30
tests/integration/tools/mongodb/connect/connect.test.ts > SwitchConnection tool > should have correct metadata: tests/integration/helpers.ts#L211
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/helpers.ts:211:30
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with empty arrays: tests/matchers/toIncludeSameMembers.test.ts#L57
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:57:22
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with mixed type arrays: tests/matchers/toIncludeSameMembers.test.ts#L50
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:50:22
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with object arrays: tests/matchers/toIncludeSameMembers.test.ts#L43
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:43:22
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with string arrays: tests/matchers/toIncludeSameMembers.test.ts#L36
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:36:22
tests/integration/tools/mongodb/create/createCollection.test.ts > createCollection tool > with existing database > creates new collection: tests/integration/tools/mongodb/create/createCollection.test.ts#L58
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/tools/mongodb/create/createCollection.test.ts:58:50
tests/integration/tools/mongodb/create/createCollection.test.ts > createCollection tool > should have correct metadata: tests/integration/helpers.ts#L211
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/helpers.ts:211:30
tests/integration/tools/mongodb/connect/connect.test.ts > Connect tool > should have correct metadata: tests/integration/helpers.ts#L211
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/helpers.ts:211:30
tests/integration/tools/mongodb/connect/connect.test.ts > SwitchConnection tool > should have correct metadata: tests/integration/helpers.ts#L211
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/helpers.ts:211:30
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with empty arrays: tests/matchers/toIncludeSameMembers.test.ts#L57
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:57:22
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with mixed type arrays: tests/matchers/toIncludeSameMembers.test.ts#L50
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:50:22
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with object arrays: tests/matchers/toIncludeSameMembers.test.ts#L43
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:43:22
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with string arrays: tests/matchers/toIncludeSameMembers.test.ts#L36
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:36:22
tests/integration/tools/mongodb/create/createCollection.test.ts > createCollection tool > with existing database > creates new collection: tests/integration/tools/mongodb/create/createCollection.test.ts#L58
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/tools/mongodb/create/createCollection.test.ts:58:50
tests/integration/tools/mongodb/create/createCollection.test.ts > createCollection tool > should have correct metadata: tests/integration/helpers.ts#L211
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/helpers.ts:211:30
tests/integration/tools/mongodb/connect/connect.test.ts > Connect tool > should have correct metadata: tests/integration/helpers.ts#L211
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/helpers.ts:211:30
tests/integration/tools/mongodb/connect/connect.test.ts > SwitchConnection tool > should have correct metadata: tests/integration/helpers.ts#L211
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/integration/helpers.ts:211:30
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with empty arrays: tests/matchers/toIncludeSameMembers.test.ts#L57
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:57:22
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with mixed type arrays: tests/matchers/toIncludeSameMembers.test.ts#L50
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:50:22
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with object arrays: tests/matchers/toIncludeSameMembers.test.ts#L43
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:43:22
tests/matchers/toIncludeSameMembers.test.ts > toIncludeSameMembers matcher > should work with string arrays: tests/matchers/toIncludeSameMembers.test.ts#L36
Error: Invalid Chai property: toIncludeSameMembers ❯ tests/matchers/toIncludeSameMembers.test.ts:36:22
Report Coverage
Unable to download artifact(s): Artifact not found for name: test-results Please ensure that your artifact is not expired and the artifact was uploaded using a compatible version of toolkit/upload-artifact. For more information, visit the GitHub Artifacts FAQ: https://github.com/actions/toolkit/blob/main/packages/artifact/docs/faq.md
Run Atlas tests
No files were found with the provided path: coverage/lcov.info. No artifacts will be uploaded.
Run Atlas tests
1 added, 0 removed; done.
Run Atlas tests
rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL
Run Atlas tests
Updating certificates in /etc/ssl/certs...
Run Atlas tests
WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
Run MongoDB tests (ubuntu-latest)
No files were found with the provided path: coverage/lcov.info. No artifacts will be uploaded.
Run MongoDB tests (ubuntu-latest)
1 added, 0 removed; done.
Run MongoDB tests (ubuntu-latest)
rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL
Run MongoDB tests (ubuntu-latest)
Updating certificates in /etc/ssl/certs...
Run MongoDB tests (ubuntu-latest)
WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
Run MongoDB tests (macos-latest)
No ALTQ support in kernel ALTQ related functions disabled pf enabled
Run MongoDB tests (macos-latest)
No ALTQ support in kernel ALTQ related functions disabled
Run MongoDB tests (macos-latest)
pfctl: Use of -f option, could result in flushing of rules present in the main ruleset added by the system at startup. See /etc/pf.conf for further details.
Run MongoDB tests (macos-latest)
YES (0)
Run MongoDB tests (macos-latest)
2025-07-16 11:26:38.242 sysadminctl[837:4855] Creating home directory at /Users/mitmproxyuser
Run MongoDB tests (macos-latest)
2025-07-16 11:26:38.038 sysadminctl[837:4855] Assigning UID: 502 GID: 20
Run MongoDB tests (macos-latest)
2025-07-16 11:26:37.558 sysadminctl[837:4855] Creating user record…
Run MongoDB tests (macos-latest)
IOServiceMatchingfailed for: AppleM2ScalerCSCDriver
Run MongoDB tests (macos-latest)
2025-07-16 11:26:36.898 sysadminctl[837:4855] ---------------------------- 2025-07-16 11:26:36.898 sysadminctl[837:4855] No clear text password or interactive option was specified (adduser, change/reset password will not allow user to use FDE) ! 2025-07-16 11:26:36.898 sysadminctl[837:4855] ----------------------------
Run MongoDB tests (macos-latest)
The macos-latest label will migrate to macOS 15 beginning August 4, 2025. For more information see https://github.com/actions/runner-images/issues/12520
Run MongoDB tests (macos-latest)
The macos-latest label will migrate to macOS 15 beginning August 4, 2025. For more information see https://github.com/actions/runner-images/issues/12520

Artifacts

Produced during runtime
Name Size Digest
run-atlas-tests-permissions-fb738260f8c6d8211bca48d37c086309 Expired
140 Bytes
sha256:a9ebc6a22a22b8e033b41e2cba18a72edead7ef3f1821e6cbd69292ef2235c65
run-tests-permissions-60c6f9a4103f212dbe648e8156cd7759 Expired
140 Bytes
sha256:0b535bd1aa734dfcb061d4e0d5fb21fe826e6d234e8717a55005fa947cba9060
run-tests-permissions-7b8c9cd88bcec568f66a51f7f91be017 Expired
140 Bytes
sha256:e18787b85f5127007e73f21cc983902b1382f0953bd543250114cac1fa2f9ffe