Conversation
* Remove unnecessary workflows - CIFuzz requires additional setup at the google service - MacOS and Windows are irrelevant for s-core - We will setup our own documentation * Replace 'latest' compiler versions by an exact version - 'latest' compilers may lead to irreproducible results - current v3.12.0 does not run without errors with 'latest' compilers - Remove very old clang compilers (<17) as the corresponding old docker images lead to errors - ci_static_analysis_clang target needs to use clang 18 or newer because of new compiler flags --------- Co-authored-by: Nils Eberhardt <nils.eberhardt@d-fine.com>
-Add devcontainer with Debian Image -Add Dockerfile with specific tools that might be useful
- Ignore bazel build artifacts
- Add eclipse-score Bazel registry
- Add modules used by s-core
- Add documentation to deploy s-core website
- Add s-core license check
- Deploy s-core website instead of nlohmann in publish_documentation.yml
- Add concept, introduction and report TOC
- Add TAs, TTs AoU, ... to Apply TSF - Add .dotstop.dot to overview hashes, links, nodes with Trudag
The s-core workflow from the cicd-workflow repository requires a main branch
Adds capturing and storage of test data in Ubuntu-Workflow. Test data are stored in the separate branch save_historical_data in the database TSF/TestResultData.db. Commit messages of commits: * add test data storage possibility * remove key issue * adapt commit message & add fail-save for empty commit * make skript nicer * prepare Ubuntu artifact * make Ubuntu artifact * Fix typo * Fix stupid mistake? * remove debug message * tweak permissions * so better? * fix branch naming issue * Fix branch naming issue try 2 * add missing space * add test result data generation * Fix awfully wrong statement * Fix copying mistake * increase limit for test output * remove comma * add data_store_documentation * add removal of obsolete data * increase captured data * fix issue * Add missing bracket * add missing spaces * Remove AOU-26 * Fix non-sense test * add fail-save for empty data * fix ubuntu workflow * fix data_store in workflow * fix branch for PR * fix security issues --------- Co-authored-by: Nils Eberhardt <nils.eberhardt@d-fine.com>
Implements custom validator check_test_results, which uses the artifact of the ubuntu-workflow to accurately calculate a fraction of passed test-cases. * add test result checker * test for skipped tests * add test for non-existent test data * comment validators * extend documentation * document validator check_test_results() * pin versions * Fix broken grammar * add missing commata --------- Co-authored-by: Nils Eberhardt <nils.eberhardt@d-fine.com>
* add automatic partial graph generator * add linking to plots in documentation * add linkage to report generator * revert changes for development purposes * Change JLEX into links * reorder documentation * rework plotting * adapt documentation generator to argument * change link of top-top-layer node * pin versions * Fix broken grammar * add missing commata * clarify role of input for shell scripts * change variable name --------- Co-authored-by: Nils Eberhardt <nils.eberhardt@d-fine.com>
* Fix missing variables * update trudag to version 2025.8.5 * remove unused code --------- Co-authored-by: Nils Eberhardt <nils.eberhardt@d-fine.com>
* update trudag to version 2025.8.5 * remove unused code * rework partial graph plotting Previously, the changes to the documentation were written to TSF/docs/trustable_graph.rst. This was not part of the trudag artifact, so removed for documentation generation. As a fix, it is now moved to TSF/docs/generated, which is stored in the artifact. --------- Co-authored-by: Nils Eberhardt <nils.eberhardt@d-fine.com>
* fix naming issue The names of the partial graph did coincide with the names of the historical plots of the trustable score for the items. * add even more unique naming * remove accidental duplication * remove another accidental duplication --------- Co-authored-by: Nils Eberhardt <nils.eberhardt@d-fine.com>
* fix paths in the hyperlinks of the items in the partial graphs --------- Co-authored-by: Nils Eberhardt <nils.eberhardt@d-fine.com>
* generate list of issues with label containing 'bug' * check if repo reachable * add title and subtitles * expand file description * fix grammar error
* fix feedback point 1 * fix concept page * fix typos * fix typos * add table descriptions in report * undo test changes * udpate JLS-04 * fix introduction * fix abbreviations * verbose file * add import
* Change JLEX into links * reorder documentation * rework plotting * adapt documentation generator to argument * change link of top-top-layer node * add more verbose intro for trustable graph * change order * Changes to address nlohmann#73 * reformulate AOU-23 and AOU-24 as requirements * split AOU-25 in behaviours and misbehaviours of C++-stdlib * reformulate AOU-27 as requirement * add which statements are supported by these assumptions of use * add actual graph * remove automatic change of trustable graph documentation * clean up graph * add version for nlohmann/json to start page of documentation * addressing nlohmann#73 renaming entry "Eclipse" to "Eclipse S-CORE Home Page" in documentation * tweak references * add description to function references * remove empty bullet-point from JSONTestsuiteReference * adapt FunctionReferences * add descriptions * formulate AOU as requirements * formulate AOU as requirement * add combined AOU * combine AOUs * combine similar AOU-10, AOU-11, AOU-12 and AOU-13 into one singular AOU-10_COMBINED * remove obsolete AOU * adapt graph * add descriptions to function_references * fix typo * Change overview * add test-list compilator * tweak collection of List_of_all_tests.md * add List_of_all_tests.md * adapt compile_list_of_tests.py as script instead of expecting console inputs * rework list of tests as custom reference * add list of test as reference * add documentation * add test-environments to list of tests * change classmethods to static methods * add tests * add some tests * Fix reintroduced errors in README * re-add commas * re-fix version * remove outcommentation --------- Co-authored-by: Nils Eberhardt <nils.eberhardt@d-fine.com>
* fix critical issue with inputs to workflow * fix trudag version in comment * add workflow testing trudag publish * add test_publication to parent-workflow * fix naming issue * add test for fetching of upstream open issues * rename test step * actually add the fail-safe * add documentation * change storage policy for test-data * capture execution time * remove update change again * add capturing of time of execution * add rolling storage * fix potentially dangerous error * fix bracket * fix erroneous SQL statement
* add tests for custom scripts * add file-existence-checker * assert that unit-tests are executed daily * assert that historical scores are collected * assert that test-results are captured * remove un-necessary existence check * fix faulty configuration for evidence * fix file_exists validator * put f-string instead of string * remove possible division by zero * clarify place-holder ABBR
* adapt report-names * fix indentation style * add more memory-efficient test-data capturer * add a bit of documentation * adapt references to use new test-report * adapt ubuntu workflow * adapt test to changed reference * rename non-existing column "skipped assertions" to correct name "failed assertions" * identify tests uniquely * fix typo in comments * update reference using the persistent data storage * Merge origin/main into rework_data_storage
* fix indentation style * fix typo in comments * Remove un-necessary primary key * primary key in table test_results fails if update happens * most recent results still identifiably using table workflow_info * Fix find_most_recent_results * order of argument in SQL-query was wrong * Necessity to update was detected erroneously * add heuristic size-check * document heuristic size-check * fix typo
* add sha-checker * add expected sha of json.hpp * add validator checking if actual and expected sha coincide * remove TODO-note * refer to announcement of Niels Lohmann containing SHA-value * clarify "without throwing an exception" it does not mean that precision is guaranteed. * add comments to known open issues * collect comments on known open issues in TSF/docs/nlohmann_misbehaviours_comments.md * print comments into collection of known issues. * describe issue 4901 * refer to nlohmann docu for from_ubjson * adapt file to reworked data storage * adapt statement to better fitting one * first draft of update process * indicate that no known issue applies to Eclipse S-CORE * add further comments * add recommended procedure * more tweaks to the process * amend recommended procedure * minor tweaks * add branch protection rules * adapt check_test_results * replace "if not XXX" by more appropriate "if XXX is None" * remove evidence of non-leaf item NJF-06.4 * remove evidence from non-leaf item NJF-06.5 * implement test-checker * clean up graph's tabular presentation * clean table from not rendered style * fix path * adapt README * remove update process for further investigation * adapt reference * comment issue 4946 * add AOU that bugs are regularly checked on impact * adapt table of known open misbehaviours * add misbehaviour validator * add .dotstop.dot containing AOU-28 * reorder workflow * auto-update JLS-14 * validate PJD-04 * adapt to review_round_2 * fix brackets and method-name * fix wrong list * fix wrong method
* library version * AOU-03 shall * AOU-25 'used' standard library * fix AOU-26 * add context diagram * fix introduction * Review round 2 jk (nlohmann#93) * Add reference to nodes * add custom reference ItemReference * document ItemReference * add minor tests for ItemReference * add table for scoring rationale to documentation * add ItemReferences For each item referring also to references of other nodes, add the corresponding ItemReferences * change ItemReference Since each reference's content was calculated, performance was quite bad. Therefore, the change of the content is now indirectly detected, only. * fix orphan-nodes * PJD-04 already covered by NPFs -> removed PJD-04 * linked TA-UPDATES and AOU-27 * remove unused code * re-formulate documentation for clarification * adapt formulation to be precise * remove unused pydot * change import of LocalFileReference to suppress warnings * add clarification of scope * improve function-reference * correct section counting * fix typo SCORE -> S-CORE * Review round 2 jk (nlohmann#96) * fix function-reference * add support for multiline function declarations * add test for multiline function declaration * fix error-messages * Review round 2 jk (nlohmann#101) * remove reference ListOfTestCases * add folder artifacts to gitignore * add generator for the list of test environments * generate list of test environments * add validator for list of test environments * document generator * implement evidence * remove obsolete tests * add tests for ListOfTestsGenerator * repair pytest execution --------- Signed-off-by: Erik Hu <135733975+Erikhu1@users.noreply.github.com> Signed-off-by: Jonas-Kirchhoff <jonas.kirchhoff@d-fine.com> Co-authored-by: Erik Hu <erik.hu@d-fine.com> Co-authored-by: Erik Hu <135733975+Erikhu1@users.noreply.github.com> * add root to syspath * remove @classmethods from init * clean up * clean up * explain generate_list_of_tests.py --------- Signed-off-by: Erik Hu <135733975+Erikhu1@users.noreply.github.com> Signed-off-by: Jonas-Kirchhoff <jonas.kirchhoff@d-fine.com> Co-authored-by: Jonas-Kirchhoff <jonas.kirchhoff@d-fine.com>
* add documentation on how to fork * change branch name pattern * fix fnmatch pattern * change master to main * correct forking docs * implement feedback
* fix check_issues For some reason, the global from datetime import datetime does not work. Instead, import datetime within validator check_issues. Additionally, the return in an erroneous case was wrong, since the error was not put into an array. * fix name of validator
* update forking instructions * add release management guide * add codeowners
* move listing of potential misbehaviours * printing misbehaviours with generate_list_of_misbehaviours.py * replacing bash script in publish_documentation.yml * fix url * auto-update JLS-11 * add reference and validators for numbers of failed workflows * implement validators and reference * document validators * document reference * add as_markdown * add utterly important quotation marks * add quotation marks * fix as_markdown * delete unused items * add test * add whitespace tests * add checklists * add update-helper * add references * pretty printing * increase indent * do constraints * pretty printing * reference for pretty printing * minor tweaks * even more minor tweak * add update description * minor tweaks for nlohmann update * fix git command * remove trailing whitespace * Fix url and branch. * add combinator * add coveralls_statement * add JLS-27 * tweak formulation of JLS-27 * pretty printing * adapt tests for gcc-15 * gcc-15 complains with some tests of release 3.12.0 * solution: remove semicolon in unit-regression2 and add noexcept in unit-user_defined_input * solution copied from commit 6b91993 on nlohmann/json * pretty printing * amend JLS-05 * add monitoring AOU * reformulate checklist * adapt README * fix wrong validator name * fix return value for validators * add documentation for combinator * fix script path error * fix f string error * escape outer quotation marks * fix typo * undo JLS-05 change * rename checklist files * label position agnostic script and fix typos * Update .dotstop_extensions/README.md Co-authored-by: Luca Füger <luca.fueger@d-fine.com> Signed-off-by: Erik Hu <erik.hu@d-fine.com> * Update .dotstop_extensions/README.md Co-authored-by: Luca Füger <luca.fueger@d-fine.com> Signed-off-by: Erik Hu <erik.hu@d-fine.com> * fix verb * rename NumberOfFailures to workflow_failures * clarify overload nth occurence * update JLS-26 * update JLS-27 * clarify combinator * add reference test for ListOfTestCases * remove comma * add function description and close connection * add function desc * remove is_branch_protected validator * add try catch for did_workflows_fail * update AOU-29 * update SME scores description * remove automatic --------- Signed-off-by: Erik Hu <erik.hu@d-fine.com> Co-authored-by: Erik Hu <erik.hu@d-fine.com> Co-authored-by: Luca Füger <luca.fueger@d-fine.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Merge TSF documentation into main