Skip to content

Backport 3.6: Split test_psa_compliance.py #10400

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: mbedtls-3.6
Choose a base branch
from
Open

Backport 3.6: Split test_psa_compliance.py #10400

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
cdb46ea
Update framework with psa_compliance.py module
gilles-peskine-arm Sep 11, 2025
26df438
Import PSA compliance test script entry point from the framework
gilles-peskine-arm Sep 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion framework
Open in desktop
Submodule framework updated 10 files
+2 −0 scripts/all-helpers.sh
+9 −2 scripts/check-python-files.sh
+1 −1 scripts/check_files.py
+2 −0 scripts/mbedtls_framework/crypto_knowledge.py
+29 −4 scripts/mbedtls_framework/macro_collector.py
+189 −0 scripts/mbedtls_framework/psa_compliance.py
+7 −1 scripts/mbedtls_framework/psa_information.py
+6 −140 scripts/test_psa_compliance.py
+15 −1 tests/programs/metatest.c
+19 −2 tests/src/threading_helpers.c
29 changes: 29 additions & 0 deletions tests/scripts/test_psa_compliance.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
#!/usr/bin/env python3
"""Run the PSA Crypto API compliance test suite.

Clone the repo and check out the commit specified by PSA_ARCH_TEST_REPO and PSA_ARCH_TEST_REF,
then compile and run the test suite. The clone is stored at <repository root>/psa-arch-tests.
Known defects in either the test suite or TF-PSA-Crypto - identified by their test
number - are ignored, while unexpected failures AND successes are reported as errors, to help
keep the list of known defects as up to date as possible.
"""

# Copyright The Mbed TLS Contributors
# SPDX-License-Identifier: Apache-2.0 OR GPL-2.0-or-later

from typing import List

import scripts_path # pylint: disable=unused-import
from mbedtls_framework import psa_compliance

PSA_ARCH_TESTS_REF = 'v23.06_API1.5_ADAC_EAC'

# PSA Compliance tests we expect to fail due to known defects in Mbed TLS /
# TF-PSA-Crypto (or the test suite).
# The test numbers correspond to the numbers used by the console output of the test suite.
# Test number 2xx corresponds to the files in the folder
# psa-arch-tests/api-tests/dev_apis/crypto/test_c0xx
EXPECTED_FAILURES = [] # type: List[int]

if __name__ == '__main__':
psa_compliance.main(PSA_ARCH_TESTS_REF, expected_failures=EXPECTED_FAILURES)