Explicit definition of test result and test log handling (#150)

* Explicit definition of test result and test log handling

Signed-off-by: PhilipPartsch <[email protected]>

Author: PhilipPartsch

process/process_areas/verification/guidance/verification_process_toolreqs.rst

@@ -153,9 +153,20 @@ Test Linking to Requirements
     :satisfies: wf__verification_mod_ver_report
     :complies:
 
-    Verification reports shall be automatically generated. These may be independent documents (i.e. not integrated into sphinx documentation).
+    The tool automation shall automatically generate the Verification reports.
+    These may be independent documents (i.e. not integrated into sphinx documentation).
     The content of the reports is specified in :need:`gd_temp__platform_ver_report` and :need:`gd_temp__mod_ver_report`.
 
+.. gd_req:: Verification Report Archiving
+    :id: gd_req__verification_report_archiving
+    :status: valid
+    :tags: prio_1_automation, verification
+    :satisfies: wf__verification_mod_ver_report
+    :complies:
+
+    The tool automation shall automatically archive the Verification reports for releases.
+    The reports are generated according to :need:`gd_req__verification_reporting`.
+
 .. gd_req:: Verification Documentation Checks
     :id: gd_req__verification_checks
     :status: valid

process/process_areas/verification/guidance/verification_report_template.rst

@@ -78,6 +78,12 @@ Verification Report Templates
       |
       | **5. Software component qualification verification report**
       | - Contains the needed verification results if for some components a qualification of pre-developed SW is performed.
+      |
+      | **6. Test results**
+      | - Test result per test case with status passed/failed/not_run
+      |
+      | **7. Test logs**
+      | - Test log per test case with status passed/failed/not_run
 
     **Note1:** The verification report is valid for the module version tagged together with the report
 
@@ -120,6 +126,12 @@ Verification Report Templates
       |
       | **3. Safety Analysis Report**
       | - List of the performed Feature Safety Analysis, pass/fail with open mitigations
+      |
+      | **4. Test results**
+      | - Test result per test case with status passed/failed/not_run
+      |
+      | **5. Test logs**
+      | - Test log per test case with status passed/failed/not_run
 
     **Note1:** The verification report is valid for the platform version tagged together with the report
 

process/process_areas/verification/workproducts.rst

@@ -51,8 +51,14 @@ Platform
      (can be several levels), passed/failed and completeness verdict, including normal
      operation and failure reactions
    - The list of requirements may also contain other verification methods like "Analysis"
-   - Formal evidence about the preformed DFA.
+   - Formal evidence about the performed DFA
    - Formal evidence about the performed Safety Analyses
+   - Test result per test case from
+     :need:`wp__verification_platform_test` and :need:`wp__verification_feat_int_test`
+     with status passed/failed/not_run
+   - Test log per test case from
+     :need:`wp__verification_platform_test` and :need:`wp__verification_feat_int_test`
+     with status passed/failed/not_run
 
 Feature
 *******
@@ -86,9 +92,15 @@ Module
    - Structural Coverage (C0 and C1, from unit testing on host) per unit
    - Static Code Analysis (including compiler warnings, automated checking of coding guidelines
      and additional checks)
-   - Formal evidence about the preformed DFA.
+   - Formal evidence about the performed DFA
    - Formal evidence about the performed Safety Analyses
    - Software component qualification verification report
+   - Test result per test case from :need:`wp__verification_sw_unit_test`,
+     :need:`wp__verification_feat_int_test`, and :need:`wp__verification_comp_int_test`
+     with status passed/failed/not_run
+   - Test log per test case from :need:`wp__verification_sw_unit_test`,
+     :need:`wp__verification_feat_int_test`, and :need:`wp__verification_comp_int_test`
+     with status passed/failed/not_run
 
 Component
 *********