Examples to show some problems in Specmatic

---

Specmatic Contract Test ignored "explode: false" for parameters with "array" type

---

Specmatic backward-compatibility check does not detect changes in included files

Specmatic's "backward-compatibility-check" does not detect changes in included files if the "root" file is not modified.

==> CORRECTED in Specmatic 2.7.6

changes in included file that does not have 'openapi' element

• make breaking change in "includedSimple.yaml" (for example rename "data" to something else)
• start specmatic backward compatibility check: java -jar specmatic.jar backward-compatibility-check
• Specmatic will NOT see any changes in OpenApi:

Specmatic Version: 2.6.0
 No specs were changed, skipping the check.

• make some change in "root.yaml" (for example add space somewhere)
• start specmatic backward compatibility check: java -jar specmatic.jar backward-compatibility-check
• Specmatic will see changes in OpenApi:

Specmatic Version: 2.6.0
Checking backward compatibility of the following specs:
  - Specs that have changed:
    1. D:\my\SpecmaticBackwardCompatibilityCheck\.\root.yaml

  - Specs referring to the changed specs:
    1. .\includedAsOpenApiDocument.yaml
    2. .\root.yaml
...

Note: Here can you see that "includedSimple.yaml" is not listed in the output, but "includedAsOpenApiDocument.yaml" is listed, even it is not changed.

changes in included file that have 'openapi' element

• make breaking change in "includedAsOpenApiDocument.yaml" (for example rename "data" to something else)
• start specmatic backward compatibility check: java -jar specmatic.jar backward-compatibility-check
• Specmatic will see changes in OpenApi:

Specmatic Version: 2.6.0
Checking backward compatibility of the following specs:
  - Specs that have changed:
    1. D:\my\SpecmaticBackwardCompatibilityCheck\.\includedAsOpenApiDocument.yaml
  - Specs referring to the changed specs:
    1. .\root.yaml
    2. .\includedAsOpenApiDocument.yaml
...

---

if included file is renamed or moved to another directory, Specmatic backward-compatibility-check interprets this non-breaking changes as breaking changes

Specmatic's "backward-compatibility-check" does not interpret some non-breaking changes as non-breaking – if included file is renamed or moved to another directory:

==> CORRECTED in Specmatic 2.7.6

rename the included file “includedAsOpenApiDocument.yaml” into (for example) “includedOpenApiDocument.yaml“ and start backward-compatibility-check: java -jar specmatic.jar backward-compatibility-check

Return code: 1
Output:

Specmatic Version: 2.6.0
Checking backward compatibility of the following specs:
- Specs that have changed:
    1. D:\my\SpecmaticBackwardCompatibilityCheck\.\includedOpenApiDocument.yaml
    2. D:\my\SpecmaticBackwardCompatibilityCheck\.\root.yaml
- Specs referring to the changed specs:
    1. .\includedOpenApiDocument.yaml
    2. .\root.yaml
--------------------
1. Running the check for D:\my\SpecmaticBackwardCompatibilityCheck\.\includedOpenApiDocument.yaml:
   read(...) must not be null

This change is not breakable, the OAS is only reorganized but not changed at all.