Skip to content

Commit 61aa62e

Browse files
authored
Merge pull request #233 from etas-contrib/feature/issue_164_rename_platform_test
replace platform test with platform integration test
2 parents 24c7db0 + ae4721a commit 61aa62e

File tree

12 files changed

+4457
-57
lines changed

12 files changed

+4457
-57
lines changed

process/general_concepts/_assets/score_building_blocks_meta_model.drawio.svg

Lines changed: 1615 additions & 4 deletions
Loading

process/general_concepts/_assets/score_traceability_model_wp_overview.drawio.svg

Lines changed: 1212 additions & 4 deletions
Loading

process/general_concepts/score_building_blocks_concept.rst

Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -25,9 +25,9 @@ The following figure gives an overview about the building blocks of the project
2525
(blue box, top, 2nd column). The objectives of the project platform include
2626
enabling of feature integration for different use cases and domains. This includes safety-critical
2727
applications. Thus the intention is, that the platform can be developed as a Safety
28-
Element out of Context (**SEooC**) (green box, top, 1 column). The objectives of the platform are
28+
Element out of Context (**SEooC**) (green box, top, 1st column). The objectives of the platform are
2929
expressed as concrete **Stakeholder Requirements** (blue box, top, 2nd column), which can be tested
30-
by provided **Platform Tests** (blue box, top, 5nd column) for reference hardware platforms. The
30+
by provided **Platform Integration Tests** (blue box, top, 5th column) for reference hardware platforms. The
3131
platform consists of **Features** (yellow box, middle, 2nd column).
3232

3333
Further the project provides **Software Modules** (red box, middle, 1st column), which can also be
@@ -37,28 +37,28 @@ highest level component in our model. A Software Module represents e.g. executab
3737

3838
Components are the major building blocks of the platform. Components consists of **Units**
3939
(grey box, bottom, 2nd column), the lowest level in our model. The represent the source code,
40-
which implements the Unit. Units has a **Detailed Design** (grey box, middle, 3nd column), which is
41-
also implemented by the **Source Code** (grey box, bottom, 3nd column). The Detailed Design is
42-
verified by **Unit Tests** (grey box, middle, 5nd column).
40+
which implements the Unit. Units has a **Detailed Design** (grey box, middle, 3rd column), which is
41+
also implemented by the **Source Code** (grey box, bottom, 3rd column). The Detailed Design is
42+
verified by **Unit Tests** (grey box, middle, 5th column).
4343

44-
Components are defined by **Component Requirements** (green box, middle, 3nd column) and the
45-
**Component Architecture** (green box, middle, 4nd column). A **Component Safety Analysis**
46-
(green box, middle, 6nd column) is required to verify the Component Architecture, whereby
44+
Components are defined by **Component Requirements** (green box, middle, 3rd column) and the
45+
**Component Architecture** (green box, middle, 4th column). A **Component Safety Analysis**
46+
(green box, middle, 6th column) is required to verify the Component Architecture, whereby
4747
violations of safety requirements must be documented. Potential faults
4848
may mitigated by updating the Component Requirements or by the **Component Assumptions of Use**
4949
(green box, middle, 8nd column). The latter one must be considered by the user of the Component.
50-
**Component Tests** (green box, middle, 5nd column) verify the Component requirements, and
51-
**Component Integration Tests** (green box, middle, 7nd column) verify the Component Architecture
50+
**Component Tests** (green box, middle, 5th column) verify the Component requirements, and
51+
**Component Integration Tests** (green box, middle, 7th column) verify the Component Architecture
5252
as well as the Integration of multiple Units to a Component.
5353

5454
As mentioned above a Software Module is defined as a Component or a set of components realizing a
5555
Feature of the platform. Features consists of Components and are defined by **Feature Requirements**
56-
(yellow box, middle, 3nd column) and the **Feature Architecture** (yellow box, middle, 4nd column).
57-
A **Feature Safety Analysis** (yellow box, middle, 6nd column) is required to verify the Feature
56+
(yellow box, middle, 3rd column) and the **Feature Architecture** (yellow box, middle, 4th column).
57+
A **Feature Safety Analysis** (yellow box, middle, 6th column) is required to verify the Feature
5858
Architecture, whereby violations of safety requirements must be documented. Potential
5959
faults may mitigated by updating the Feature Requirements or by the
6060
**Feature Assumptions of Use** (yellow box, middle, 8nd column). The latter one must be considered
61-
by the user of the Feature. **Feature Integration Tests** (yellow box, middle, 5nd column) verify
61+
by the user of the Feature. **Feature Integration Tests** (yellow box, middle, 5th column) verify
6262
the Feature Requirements and the Feature Architecture as well as the Integration of multiple Units
6363
to a Component.
6464

process/process_areas/problem_resolution/problem_resolution_getstrt.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@ deviation of an expected result.
2727
Examples for problem origins:
2828

2929
* Deviations relating to requirements, architecture, implementation or code found by user of the platform.
30-
* Deviations found by contributor based on component, feature or platform integration tests.
30+
* Deviations found by contributor based on component, feature or Platform Integration Tests.
3131
* Deviations found by Quality Management activities as defined in the Quality Management Plan.
3232

3333
Therefore guidelines :need:`gd_temp__problem_template`,

process/process_areas/quality_management/guidance/quality_plan_guideline.rst

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -65,10 +65,10 @@ Guideline Quality Management Plan
6565
|
6666
| **Planning integration and verification:**
6767
| Integration on the target hardware is not done in the scope of the SW platform project, but SW/SW integration up to the feature level is performed and its test results are part of the :need:`wp__verification_platform_ver_report`.
68-
| The integration on the target hardware, done by the distributor or OEM, is supported by delivering a set of HW/SW feature integration and platform tests which were already run successfully on a reference HW platform.
68+
| The integration on the target hardware, done by the distributor or OEM, is supported by delivering a set of HW/SW feature integration and Platform Integration Tests which were already run successfully on a reference HW platform.
6969
| This is planned by the respective workproducts:
7070
| * :need:`wp__verification_feat_int_test`
71-
| * :need:`wp__verification_platform_test`
71+
| * :need:`wp__verification_platform_int_test`
7272
| Verification planning is documented in :need:`wp__verification_plan`
7373
|
7474
| **Scheduling of audits, conformance checks, work product reviews, release verification and approval:**

process/process_areas/safety_management/guidance/guideline_safety_management.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,7 +78,7 @@ Safety Management Guideline
7878
| The integration on the target hardware done by the distributor or OEM is supported by delivering a set of HW/SW integration tests which were already run successfully on a reference HW platform.
7979
| This is planned by the respective work products:
8080
| * :need:`wp__verification_feat_int_test`
81-
| * :need:`wp__verification_platform_test`
81+
| * :need:`wp__verification_platform_int_test`
8282
| Verification planning is documented in :need:`wp__verification_plan`
8383
|
8484
| **Scheduling of confirmation reviews, audit and assessment:**

process/process_areas/security_management/guidance/security_management_guideline.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -121,7 +121,7 @@ Security Management Guideline
121121
This is planned by the respective work products:
122122

123123
* :need:`wp__verification_feat_int_test`
124-
* :need:`wp__verification_platform_test`
124+
* :need:`wp__verification_platform_int_test`
125125

126126
Verification planning is documented in :need:`wp__verification_plan`
127127

process/process_areas/verification/guidance/verification_process_toolreqs.rst

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@ Test Linking to Requirements
2222
:id: gd_req__verification_link_tests
2323
:status: valid
2424
:tags: prio_1_automation, verification
25-
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_test
25+
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_int_test
2626
:complies: std_req__iso26262__support_6432
2727

2828

@@ -54,7 +54,7 @@ Test Linking to Requirements
5454
:id: gd_req__verification_link_tests_cpp
5555
:status: valid
5656
:tags: prio_1_automation, verification
57-
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_test
57+
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_int_test
5858
:complies: std_req__iso26262__support_6432
5959

6060

@@ -87,21 +87,21 @@ Test Linking to Requirements
8787
:id: gd_req__verification_link_tests_python
8888
:status: valid
8989
:tags: prio_1_automation, verification
90-
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_test
90+
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_int_test
9191
:complies: std_req__iso26262__support_6432
9292

9393

94-
For linking python tests to requirements **metadata** shall be used.
95-
For this the 'add_test_properties' decorator has been provided.
94+
For linking python tests to requirements **metadata** shall be used.
95+
For this the 'add_test_properties' decorator has been provided.
9696
You need to add it to the test and fill out:
97-
98-
* partially_verifies OR fully_verifies
99-
* test_type
97+
98+
* partially_verifies OR fully_verifies
99+
* test_type
100100
* derivation_technique
101101

102102
For allowed values for test_type & derivation_technique please check :need:`gd_req__verification_link_tests`
103103
Further more, this decorator will also check if your test has a `docstring` which should act as the description of the test.
104-
104+
105105

106106
.. code-block:: python
107107
@@ -118,7 +118,7 @@ Test Linking to Requirements
118118
:id: gd_req__verification_link_tests_rust
119119
:status: valid
120120
:tags: prio_1_automation, verification
121-
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_test
121+
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_int_test
122122
:complies: std_req__iso26262__support_6432
123123

124124
For linking Rust tests to requirements **#[record_property]** shall be used:
@@ -141,7 +141,7 @@ Test Linking to Requirements
141141
:id: gd_req__verification_independence
142142
:status: valid
143143
:tags: done_automation, verification
144-
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_test
144+
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_int_test
145145
:complies:
146146

147147
The approver of a pull request shall differ from the author(s) of the pull request in all pull requests.
@@ -171,14 +171,14 @@ Test Linking to Requirements
171171
:id: gd_req__verification_checks
172172
:status: valid
173173
:tags: prio_1_automation, verification
174-
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_test
174+
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_int_test
175175
:complies:
176176

177177
The following checks shall be implemented on test metadata:
178178

179179
- TestType and DerivationTechnique shall be set
180180
- Description shall not be empty
181-
- In a Platform Test Partially/FullyVerifies shall be set to a Platform Requirement
181+
- In a Platform Integration Test Partially/FullyVerifies shall be set to a Platform Requirement
182182
- If Partially/FullyVerifies are set in Feature Integration Test these shall link to Feature Requirements
183183
- If Partially/FullyVerifies are set in Component Integration Test these shall link to Component Requirements
184184
- If Partially/FullyVerifies are set in Unit Test these shall link to Component Requirements
@@ -187,7 +187,7 @@ Test Linking to Requirements
187187
:id: gd_req__verification_checks_extended
188188
:status: draft
189189
:tags: verification
190-
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_test
190+
:satisfies: wf__verification_unit_test, wf__verification_comp_int_test, wf__verification_feat_int_test, wf__verification_platform_int_test
191191
:complies:
192192

193193
The following checks shall be implemented on test metadata:

process/process_areas/verification/verification_concept.rst

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -155,7 +155,7 @@ Following aspect should be considered when developing test cases:
155155
For integration testing, the ITF (Integration Test Framework) is used.
156156

157157
For more information, see ``[TODO: Link to ITF documentation once available. Related feature request is #599]``.
158-
* **Platform Testing:** Test the platform with configured features as a whole.
158+
* **Platform Integration Testing:** Test the platform with configured features as a whole.
159159
* **Regression Testing:** Ensure that changes do not introduce new defects.
160160
Automate regression tests where possible as they will get executed as part of the CI.
161161
* **Performance Testing (when applicable):** Evaluate the performance characteristics of the code,
@@ -173,7 +173,7 @@ integration tests linking to the component requirements and architecture.
173173
Traceability of feature integration tests shall be established through linking those test cases to
174174
feature requirements and architecture as features describe the integrated behavior of all components.
175175

176-
Traceability of platform tests shall be established through linking those test cases to
176+
Traceability of platform integration tests shall be established through linking those test cases to
177177
stakeholder requirements as stakeholder requirements describe the platform behavior.
178178

179179
Note that all the above tests shall only link to requirements of type "Functional" and "Interface".

process/process_areas/verification/workflows.rst

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -90,20 +90,20 @@ Workflow Verification
9090
The tests are automatically executed as part of the CI after PR merge.
9191
In case of changes at inputs, the workflow need to be executed again as part of maintenance.
9292

93-
.. workflow:: Create/Maintain Platform Test
94-
:id: wf__verification_platform_test
93+
.. workflow:: Create/Maintain Platform Integration Test
94+
:id: wf__verification_platform_int_test
9595
:status: valid
9696
:tags: verification
9797
:responsible: rl__contributor
9898
:approved_by: rl__committer, rl__testing_community
9999
:supported_by: rl__safety_manager
100100
:input: wp__requirements_stkh, wp__verification_plan
101-
:output: wp__verification_platform_test
101+
:output: wp__verification_platform_int_test
102102
:contains: gd_req__verification_link_tests, gd_req__verification_link_tests_cpp, gd_req__verification_link_tests_python, gd_req__verification_link_tests_rust, gd_req__verification_independence, gd_guidl__verification_specification
103103
:has: doc_concept__verification_process, doc_getstrt__verification_process
104104

105-
Platform test cases are based on Stakeholder requirements. This is the highest test level.
106-
Any contributor can create a platform test and create a PR for it.
105+
Platform Integration Test cases are based on Stakeholder requirements. This is the highest test level.
106+
Any contributor can create a platform integration test and create a PR for it.
107107
During the review process the test cases will be approved by a committer.
108108
Committer and contributor need to differ.
109109
The tests are automatically executed as part of the CI after PR merge.
@@ -183,7 +183,7 @@ Workflow Verification
183183
wp__feature_arch, wp__platform_sw_release_note, wp__platform_mgmt,
184184
wp__feature_fmea, wp__feature_dfa, wp__platform_dfa,
185185
wp__sw_arch_verification, wp__requirements_inspect,
186-
wp__verification_feat_int_test, wp__verification_platform_test
186+
wp__verification_feat_int_test, wp__verification_platform_int_test
187187
:output: wp__verification_platform_ver_report
188188
:contains: gd_temp__platform_ver_report
189189
:has: doc_concept__verification_process, doc_getstrt__verification_process

0 commit comments

Comments
 (0)