Skip to content

Adding scores for TT-Changes#8

Merged
aschemmel-tech merged 1 commit intomainfrom
aschemmel-tech-tt-changes-score
Dec 10, 2025
Merged

Adding scores for TT-Changes#8
aschemmel-tech merged 1 commit intomainfrom
aschemmel-tech-tt-changes-score

Conversation

@aschemmel-tech
Copy link

No description provided.

@coveralls
Copy link

Coverage Status

coverage: 99.186%. remained the same
when pulling e4dbb47 on aschemmel-tech-tt-changes-score
into f61e53b on main.

@github-actions github-actions bot removed the L label Dec 2, 2025

Pull requests in the nlohmann/json repository are merged only after code review.

aschemmel-tech: taken over score from "OpenSSF Scorecard Report"
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

where can I find this Report?

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can find the report by opening the full JLS-06.md file, as the link is provided in the reference.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.


The develop branch of nlohmann/json is protected, i.e. no direct commits are possible.

aschemmel-tech: no other pushes as from nlohman are observable
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

codeowner is defined, only nlohman is allowed to merge

@@ -1,8 +1,8 @@
# This file is automatically generated by dotstop and should not be edited manually.
# Generated using trustable 2025.10.22.
# Generated using trustable 2025.9.16.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is a problem, if different version are used here? Why not always the same version, latest, is applied?

Copy link

@Erikhu1 Erikhu1 Dec 2, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is indeed strongly recommended to be consistent with the trudag version. This is enforced if one uses the dev container when editing or adding SME scores.

As can be seen, the script which installs trudag in the dev container is currently pinned to version 2025.10.22: https://github.com/eclipse-score/inc_nlohmann_json/blob/f61e53be2bba6d0e091a9bbe4252190e5e5f8019/.devcontainer/S-CORE/post_create_script.sh#L8

@aschemmel-tech Please reopen the project in the dev container as such:
image

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have problems updating my local trudag version. Cannot update at the moment.

Known bugs, misbehaviours and CVEs are analyzed and either fixed or mitigated in the nlohmann/json repository. No newline at end of file
Known bugs, misbehaviours and CVEs are analyzed and either fixed or mitigated in the nlohmann/json repository.

aschemmel-tech: evidences support bugs and CVE fixing, no mitigation actions are offered. No newline at end of file
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could not find any mitigation to a CVE report? Would not rate this so high, do you have evidences, beside some CVEs reported?

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All CVEs were fixed or mitigated in nlohmann/json. As shown in the second reference in this statement, the are "0 existing vulnerabilities detected": https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson#section-Vulnerabilities

---

Outstanding CVEs are analyzed within eclipse-score/inc_nlohmann_json to determine whether they can be dismissed, and/or are relevant for S-CORE's use cases of the nlohmann/json library. No newline at end of file
Outstanding CVEs are analyzed within eclipse-score/inc_nlohmann_json to determine whether they can be dismissed, and/or are relevant for S-CORE's use cases of the nlohmann/json library.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could not find any analysis, only empty tickets reporting something, where are the analyzed?

Copy link

@Erikhu1 Erikhu1 Dec 2, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The analysis comprises determining whether outstanding CVEs can be dismissed and/or are relevant for S-CORE.

The first reference in this statement shows that 0 CVEs are outstanding in nlohmann/json. The second reference shows which security alerts were dismissed as "false positive" or "used in test".

Within our development repo, the same steps were taken, to dismiss e.g., any false positives raised by code scanning tools. None are remaining now:
image

The same steps are to be taken for any security alerts raised by code scanning tools in https://github.com/eclipse-score/inc_nlohmann_json/security. So far, every single alert raised can be dismissed as false positive or used in test. Please however note that the detailed security page on github is only viewable by committers or administrators of the repo (I think). As such, I am not able to do so myself as I do not have the necessary permissions in eclipse-score.

Copy link

@Erikhu1 Erikhu1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Many thanks for the SME scores. Just 2 remarks from my side:

  1. It is highly recommended to use the dev container when performing the SME review. Doing so ensures that the correct version of trudag is being used. See my comment on .dotstop.dot below for more details on this.

  2. To my understanding, the SME reviewer is not expected to motivate their scoring, especially not directly in the statement, as this would be displayed in the generated report:

    • Instead, any feedback to the contributors of the TSF documentation (e.g., me), can be given directly, or as review comments to the contributors' PR, or proposed as merge requests. The feedback to the contributors shall however be separated from the SME scoring.
    • Furthermore, if one SME does not agree with the SME score of another reviewer, they shall not try to convince the other party to change or edit their score. Instead, the opinion of the SME reviewer who disagrees with the existing scores should be reflected by simply putting their own scores.
    • The point (that SMEs are not expected to motivate their scoring) might however be subject to change. CodeThink is currently looking at alternatives to allow SME reviewers to document the reasoning behind their scores (see tracked issue here https://gitlab.com/CodethinkLabs/trustable/trustable/-/issues/371).


Pull requests in the nlohmann/json repository are merged only after code review.

aschemmel-tech: taken over score from "OpenSSF Scorecard Report"
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can find the report by opening the full JLS-06.md file, as the link is provided in the reference.

@@ -1,8 +1,8 @@
# This file is automatically generated by dotstop and should not be edited manually.
# Generated using trustable 2025.10.22.
# Generated using trustable 2025.9.16.
Copy link

@Erikhu1 Erikhu1 Dec 2, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is indeed strongly recommended to be consistent with the trudag version. This is enforced if one uses the dev container when editing or adding SME scores.

As can be seen, the script which installs trudag in the dev container is currently pinned to version 2025.10.22: https://github.com/eclipse-score/inc_nlohmann_json/blob/f61e53be2bba6d0e091a9bbe4252190e5e5f8019/.devcontainer/S-CORE/post_create_script.sh#L8

@aschemmel-tech Please reopen the project in the dev container as such:
image

Known bugs, misbehaviours and CVEs are analyzed and either fixed or mitigated in the nlohmann/json repository. No newline at end of file
Known bugs, misbehaviours and CVEs are analyzed and either fixed or mitigated in the nlohmann/json repository.

aschemmel-tech: evidences support bugs and CVE fixing, no mitigation actions are offered. No newline at end of file
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All CVEs were fixed or mitigated in nlohmann/json. As shown in the second reference in this statement, the are "0 existing vulnerabilities detected": https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson#section-Vulnerabilities

---

Outstanding CVEs are analyzed within eclipse-score/inc_nlohmann_json to determine whether they can be dismissed, and/or are relevant for S-CORE's use cases of the nlohmann/json library. No newline at end of file
Outstanding CVEs are analyzed within eclipse-score/inc_nlohmann_json to determine whether they can be dismissed, and/or are relevant for S-CORE's use cases of the nlohmann/json library.
Copy link

@Erikhu1 Erikhu1 Dec 2, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The analysis comprises determining whether outstanding CVEs can be dismissed and/or are relevant for S-CORE.

The first reference in this statement shows that 0 CVEs are outstanding in nlohmann/json. The second reference shows which security alerts were dismissed as "false positive" or "used in test".

Within our development repo, the same steps were taken, to dismiss e.g., any false positives raised by code scanning tools. None are remaining now:
image

The same steps are to be taken for any security alerts raised by code scanning tools in https://github.com/eclipse-score/inc_nlohmann_json/security. So far, every single alert raised can be dismissed as false positive or used in test. Please however note that the detailed security page on github is only viewable by committers or administrators of the repo (I think). As such, I am not able to do so myself as I do not have the necessary permissions in eclipse-score.

@aschemmel-tech
Copy link
Author

  • Without being able to state on which considerations a SME gives his score is for me a no-go. How would one be able to update the score later if something changes? Documenting in the PR as a review comment I do not see appropriate (because there is no relation to setting the score).
  • I have troubles updating the trudag version in my local environment. Could you please check if this has any impact on the hashes? The need for such local configuration should not exist.

Copy link

@Erikhu1 Erikhu1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The points in my previous review comment were discussed in baselibs meeting 12/3/2025.

  • The current comments in the statements for motivating the SME score are to be kept as a temporary solution, while we monitor the progress of https://gitlab.com/CodethinkLabs/trustable/trustable/-/issues/371 .
  • While it is recommended to use the dev container to be consistent with the trudag version pinned, these specific version updates did not affect scoring or hashing, so ok for this time.

@aschemmel-tech aschemmel-tech merged commit ee6f77a into main Dec 10, 2025
86 checks passed
@aschemmel-tech aschemmel-tech deleted the aschemmel-tech-tt-changes-score branch December 10, 2025 14:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants