From 9657812bad034ee61c8b36629839f3c9690fb215 Mon Sep 17 00:00:00 2001 From: PhilipPartsch <95444300+PhilipPartsch@users.noreply.github.com> Date: Mon, 11 Aug 2025 13:37:57 +0200 Subject: [PATCH 1/6] Explicit definition of test result and test log handling Signed-off-by: PhilipPartsch <95444300+PhilipPartsch@users.noreply.github.com> --- .../process_areas/verification/workproducts.rst | 16 ++++++++++++++-- 1 file changed, 14 insertions(+), 2 deletions(-) diff --git a/process/process_areas/verification/workproducts.rst b/process/process_areas/verification/workproducts.rst index db125a764..1ad650ea5 100644 --- a/process/process_areas/verification/workproducts.rst +++ b/process/process_areas/verification/workproducts.rst @@ -51,8 +51,14 @@ Platform (can be several levels), passed/failed and completeness verdict, including normal operation and failure reactions - The list of requirements may also contain other verification methods like "Analysis" - - Formal evidence about the preformed DFA. + - Formal evidence about the preformed DFA - Formal evidence about the performed Safety Analyses + - Test result per test case from + :need:`wp__verification__platform_test` and :need:`wp__verification__feat_int_test` + with status passed/failed/not_run + - Test log per test case from + :need:`wp__verification__platform_test` and :need:`wp__verification__feat_int_test` + with stutes passed/failed/not_run Feature ******* @@ -86,9 +92,15 @@ Module - Structural Coverage (C0 and C1, from unit testing on host) per unit - Static Code Analysis (including compiler warnings, automated checking of coding guidelines and additional checks) - - Formal evidence about the preformed DFA. + - Formal evidence about the preformed DFA - Formal evidence about the performed Safety Analyses - Software component qualification verification report + - Test result per test case from :need:`wp__verification__sw_unit_test`, + :need:`wp__verification__feat_int_test`, and :need:`wp__verification__comp_int_test` + with status passed/failed/not_run + - Test log per test case from :need:`wp__verification__sw_unit_test`, + :need:`wp__verification__feat_int_test`, and :need:`wp__verification__comp_int_test` + with stutes passed/failed/not_run Component ********* From 778b122707df6e863f1ca7fe3990242ddef23acb Mon Sep 17 00:00:00 2001 From: PhilipPartsch <95444300+PhilipPartsch@users.noreply.github.com> Date: Tue, 12 Aug 2025 11:26:24 +0200 Subject: [PATCH 2/6] fixed type of status --- process/process_areas/verification/workproducts.rst | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/process/process_areas/verification/workproducts.rst b/process/process_areas/verification/workproducts.rst index 4bbe29a91..5d5e2faf5 100644 --- a/process/process_areas/verification/workproducts.rst +++ b/process/process_areas/verification/workproducts.rst @@ -55,10 +55,10 @@ Platform - Formal evidence about the performed Safety Analyses - Test result per test case from :need:`wp__verification__platform_test` and :need:`wp__verification__feat_int_test` - with status passed/failed/not_run + with status passed/failed/not_run - Test log per test case from - :need:`wp__verification__platform_test` and :need:`wp__verification__feat_int_test` - with stutes passed/failed/not_run + :need:`wp__verification__platform_test` and :need:`wp__verification__feat_int_test` + with status passed/failed/not_run Feature ******* @@ -97,10 +97,10 @@ Module - Software component qualification verification report - Test result per test case from :need:`wp__verification__sw_unit_test`, :need:`wp__verification__feat_int_test`, and :need:`wp__verification__comp_int_test` - with status passed/failed/not_run + with status passed/failed/not_run - Test log per test case from :need:`wp__verification__sw_unit_test`, - :need:`wp__verification__feat_int_test`, and :need:`wp__verification__comp_int_test` - with stutes passed/failed/not_run + :need:`wp__verification__feat_int_test`, and :need:`wp__verification__comp_int_test` + with status passed/failed/not_run Component ********* From 2512f51885d9839f2d76cf1a6043345e0e4d58b5 Mon Sep 17 00:00:00 2001 From: PhilipPartsch <95444300+PhilipPartsch@users.noreply.github.com> Date: Tue, 12 Aug 2025 16:39:53 +0200 Subject: [PATCH 3/6] added test result and test log handling to test report templates and created requirement for test report archiving --- .../guidance/verification_process_toolreqs.rst | 13 ++++++++++++- .../guidance/verification_report_template.rst | 12 ++++++++++++ 2 files changed, 24 insertions(+), 1 deletion(-) diff --git a/process/process_areas/verification/guidance/verification_process_toolreqs.rst b/process/process_areas/verification/guidance/verification_process_toolreqs.rst index 933cca442..217ca4df3 100644 --- a/process/process_areas/verification/guidance/verification_process_toolreqs.rst +++ b/process/process_areas/verification/guidance/verification_process_toolreqs.rst @@ -147,9 +147,20 @@ Test Linking to Requirements :satisfies: wf__verification_mod_ver_report :complies: - Verification reports shall be automatically generated. These may be independent documents (i.e. not integrated into sphinx documentation). + The tool automatisation shall automatically generated the Verification reports. + These may be independent documents (i.e. not integrated into sphinx documentation). The content of the reports is specified in :need:`gd_temp__platform_ver_report` and :need:`gd_temp__mod_ver_report`. +.. gd_req:: Verification Report Archiving + :id: gd_req__verification_report_archiving + :status: valid + :tags: prio_1_automation, verification + :satisfies: wf__verification_mod_ver_report + :complies: + + The tool automatisation shall automatically archived the Verification reports for releases. + The reports are generated according to :need:`gd_req__verification_reporting`. + .. gd_req:: Verification Documentation Checks :id: gd_req__verification_checks :status: valid diff --git a/process/process_areas/verification/guidance/verification_report_template.rst b/process/process_areas/verification/guidance/verification_report_template.rst index c4f3de4df..aebac33ba 100644 --- a/process/process_areas/verification/guidance/verification_report_template.rst +++ b/process/process_areas/verification/guidance/verification_report_template.rst @@ -78,6 +78,12 @@ Verification Report Templates | | **5. Software component qualification verification report** | - Contains the needed verification results if for some components a qualification of pre-developed SW is performed. + | + | **6. Test results** + | - Test result per test case with status passed/failed/not_run + | + | **7. Test logs** + | - Test log per test case with status passed/failed/not_run **Note1:** The verification report is valid for the module version tagged together with the report @@ -120,6 +126,12 @@ Verification Report Templates | | **3. Safety Analysis Report** | - List of the performed Feature Safety Analysis, pass/fail with open mitigations + | + | **4. Test results** + | - Test result per test case with status passed/failed/not_run + | + | **5. Test logs** + | - Test log per test case with status passed/failed/not_run **Note1:** The verification report is valid for the platform version tagged together with the report From f3573aa501a2b0cfe44ba1da1b9ddf73ab5c2569 Mon Sep 17 00:00:00 2001 From: PhilipPartsch <95444300+PhilipPartsch@users.noreply.github.com> Date: Wed, 13 Aug 2025 13:16:00 +0200 Subject: [PATCH 4/6] fixed typos --- .../verification/guidance/verification_process_toolreqs.rst | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/process/process_areas/verification/guidance/verification_process_toolreqs.rst b/process/process_areas/verification/guidance/verification_process_toolreqs.rst index 217ca4df3..142ea6da6 100644 --- a/process/process_areas/verification/guidance/verification_process_toolreqs.rst +++ b/process/process_areas/verification/guidance/verification_process_toolreqs.rst @@ -147,7 +147,7 @@ Test Linking to Requirements :satisfies: wf__verification_mod_ver_report :complies: - The tool automatisation shall automatically generated the Verification reports. + The tool automatisation shall automatically generate the Verification reports. These may be independent documents (i.e. not integrated into sphinx documentation). The content of the reports is specified in :need:`gd_temp__platform_ver_report` and :need:`gd_temp__mod_ver_report`. @@ -158,7 +158,7 @@ Test Linking to Requirements :satisfies: wf__verification_mod_ver_report :complies: - The tool automatisation shall automatically archived the Verification reports for releases. + The tool automatisation shall automatically archive the Verification reports for releases. The reports are generated according to :need:`gd_req__verification_reporting`. .. gd_req:: Verification Documentation Checks From 91576c57006e204a01539532c3803c5a2c469afa Mon Sep 17 00:00:00 2001 From: PhilipPartsch <95444300+PhilipPartsch@users.noreply.github.com> Date: Thu, 14 Aug 2025 11:15:17 +0200 Subject: [PATCH 5/6] fixed links to new ID schema --- process/process_areas/verification/workproducts.rst | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/process/process_areas/verification/workproducts.rst b/process/process_areas/verification/workproducts.rst index 5d5e2faf5..567f21cd6 100644 --- a/process/process_areas/verification/workproducts.rst +++ b/process/process_areas/verification/workproducts.rst @@ -54,10 +54,10 @@ Platform - Formal evidence about the preformed DFA - Formal evidence about the performed Safety Analyses - Test result per test case from - :need:`wp__verification__platform_test` and :need:`wp__verification__feat_int_test` + :need:`wp__verification_platform_test` and :need:`wp__verification_feat_int_test` with status passed/failed/not_run - Test log per test case from - :need:`wp__verification__platform_test` and :need:`wp__verification__feat_int_test` + :need:`wp__verification_platform_test` and :need:`wp__verification_feat_int_test` with status passed/failed/not_run Feature @@ -95,11 +95,11 @@ Module - Formal evidence about the preformed DFA - Formal evidence about the performed Safety Analyses - Software component qualification verification report - - Test result per test case from :need:`wp__verification__sw_unit_test`, - :need:`wp__verification__feat_int_test`, and :need:`wp__verification__comp_int_test` + - Test result per test case from :need:`wp__verification_sw_unit_test`, + :need:`wp__verification_feat_int_test`, and :need:`wp__verification_comp_int_test` with status passed/failed/not_run - - Test log per test case from :need:`wp__verification__sw_unit_test`, - :need:`wp__verification__feat_int_test`, and :need:`wp__verification__comp_int_test` + - Test log per test case from :need:`wp__verification_sw_unit_test`, + :need:`wp__verification_feat_int_test`, and :need:`wp__verification_comp_int_test` with status passed/failed/not_run Component From f6283c9d3ef6091a0642d2ac89c80f341502e11a Mon Sep 17 00:00:00 2001 From: PhilipPartsch <95444300+PhilipPartsch@users.noreply.github.com> Date: Thu, 14 Aug 2025 13:00:58 +0200 Subject: [PATCH 6/6] fixed typo in performed --- process/process_areas/verification/workproducts.rst | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/process/process_areas/verification/workproducts.rst b/process/process_areas/verification/workproducts.rst index 567f21cd6..e23430413 100644 --- a/process/process_areas/verification/workproducts.rst +++ b/process/process_areas/verification/workproducts.rst @@ -51,7 +51,7 @@ Platform (can be several levels), passed/failed and completeness verdict, including normal operation and failure reactions - The list of requirements may also contain other verification methods like "Analysis" - - Formal evidence about the preformed DFA + - Formal evidence about the performed DFA - Formal evidence about the performed Safety Analyses - Test result per test case from :need:`wp__verification_platform_test` and :need:`wp__verification_feat_int_test` @@ -92,7 +92,7 @@ Module - Structural Coverage (C0 and C1, from unit testing on host) per unit - Static Code Analysis (including compiler warnings, automated checking of coding guidelines and additional checks) - - Formal evidence about the preformed DFA + - Formal evidence about the performed DFA - Formal evidence about the performed Safety Analyses - Software component qualification verification report - Test result per test case from :need:`wp__verification_sw_unit_test`,