started adapting testing notes

Signed-off-by: Matthias Büchse <matthias.buechse@alasca.cloud>

Author: mbuechse

Standards/scs-0100-w1-flavor-naming-implementation-testing.md

@@ -167,9 +167,12 @@ None so far.
 
 ### Implementation
 
-The script [`flavor-names-openstack.py`](https://github.com/SovereignCloudStack/standards/tree/main/Tests/iaas/flavor-naming/flavor-names-openstack.py)
-talks to the OpenStack API of the cloud specified by the `OS_CLOUD` environment and queries properties and
-checks the names for standards compliance.
+We implemented two testcases, paralleling the two items in the "Errors" section above:
+
+- `scs-0100-syntax-check` ensures that any name starting with `SCS-` adheres to the standard;
+- `scs-0100-semantics-check` ensures that any such name is telling the truth as specified in the standard.
+
+These testcases can be checked using [`openstack_test.py`](https://github.com/SovereignCloudStack/standards/tree/main/Tests/iaas/openstack_test.py).
 
 ## Manual tests
 

Standards/scs-0101-w1-entropy-implementation-testing.md

@@ -60,8 +60,16 @@ as ensured by the image metadata standard.
 
 ### Implementation
 
-The script [`entropy-check.py`](https://github.com/SovereignCloudStack/standards/blob/main/Tests/iaas/entropy/entropy-check.py)
-connects to OpenStack and performs the checks described in this section.
+We implemented the following testcases that reflect the items in the above section
+on automated tests:
+
+- `scs_0101_image_property`,
+- `scs_0101_flavor_property`,
+- `scs_0101_entropy_avail`,
+- `scs_0101_rngd`,
+- `scs_0101_fips_test` (covers both the error and warning case).
+
+These testcases can be checked using [`openstack_test.py`](https://github.com/SovereignCloudStack/standards/blob/main/Tests/iaas/openstack_test.py).
 
 ## Manual tests
 

Standards/scs-0102-v1-image-metadata.md

@@ -239,9 +239,3 @@ A boolean property that is not present is considered to be `false`.
   contact for issues with this image. Note that this field must only be set if the
   service provider does provide support for this image included in the image/flavor
   pricing (but it might be provided by a contracted 3rd party, e.g. the OS vendor).
-
-### Conformance Tests
-
-The script `image-md-check.py` retrieves the
-image list from a configured cloud and checks each image for the
-completeness and consistency of mandatory properties.

Standards/scs-0102-w1-image-metadata-implementation-testing.md

@@ -16,16 +16,35 @@ for these images.
 
 ## Automated tests
 
-### Images sample
-
-Some checks need to be performed on a live instance. All publicly available images on this instance
-will be checked for either only the mandatory properties or possibly also the recommended ones.
-Additionally, a user can also decide to test their private images, although this isn't a necessity.
-
-### Implementation
-
-The script [`image-md-check.py`](https://github.com/SovereignCloudStack/standards/blob/main/Tests/iaas/image-metadata/image-md-check.py)
-connects to OpenStack and performs the checks described in this section.
+We implemented a host of testcases to reflect the requirements and recommendations of the standard. The following
+testcases ensure that fields have proper values:
+
+- `scs_0102_prop_architecture`,
+- `scs_0102_prop_hash_algo`,
+- `scs_0102_prop_min_disk`,
+- `scs_0102_prop_min_ram`,
+- `scs_0102_prop_os_version`,
+- `scs_0102_prop_os_distro`,
+- `scs_0102_prop_hw_disk_bus`,
+- `scs_0102_prop_hypervisor_type`,
+- `scs_0102_prop_hw_rng_model`,
+- `scs_0102_prop_image_build_date`,
+- `scs_0102_prop_image_original_user`,
+- `scs_0102_prop_image_source`,
+- `scs_0102_prop_image_description`,
+- `scs_0102_prop_replace_frequency`,
+- `scs_0102_prop_provided_until`,
+- `scs_0102_prop_uuid_validity`,
+- `scs_0102_prop_hotfix_hours`.
+
+The property `patchlevel` is not tested because it is entirely optional.
+
+The following testcase ensures that each image is as recent as claimed by its `replace_frequency`:
+
+- `scs_0102_image_recency`
+
+The script [`openstack_test.py`](https://github.com/SovereignCloudStack/standards/blob/main/Tests/iaas/openstack_test.py)
+can be used to check these testcases.
 
 ## Manual tests