Concept: reference_integration - integration test cases

[AlexanderLanin]

Extract integration test cases from reference_integration into a separate repository reference_integration_tests?

(This is a follow-up of https://github.com/orgs/eclipse-score/discussions/1966)

Pros = separate repo

• Separation of concerns
  • separate git logs
  • Note: Reference integration will be spammed by auto commits (e.g. hourly)
• Different workflows for test case modification
• In case tests are marked and not branched per version, new test cases can be easily added to multiple versions

Cons = keep in reference_integration

• Test cases are highly coupled with integrated modules and their versions
• Test cases cannot be developed without running them through integration repository
• "Start simple", see comment below

Discussion 2025-11-19

@PiotrKorkus, @igorostrowskiq, @kgraeper, @AlexanderLanin, @nradakovic, @evinoth1206

• No new arguments besides the ones above
• hourly git spam is probably the strongest argument for separation

Decision 2025-11-19

Keep feature_integration_tests within reference_integration for now. Revisit this topics once we have more tests included, and the os_images are extracted. E.g. after next release.

[opajonk]

Adding my personal experience here, since I cannot join today's meeting: after having worked in all scenarios (mono-repo <--> excessive multi-repo, and diverse steps in between), my personal opinion about git repos is quite clear: start with less, split when a concrete reason arises, in practice - do not assume this upfront. Splitting is a much simpler operation than most people expect.

Why? --> The overhead of many repositories is significant, and only very rarely worth the price. Each repository adds cognitive load, another level of complexity to understand (especially for newcomers), another PR that needs management for complex changes and another potential for mistakes.

Sometimes, there is a very good up-front reason for a separate repo: you fork something and want to "remain attached to upstream".