twister: Add support for Cpputest #74372

vChavezB · 2024-06-16T15:36:10Z

Similar to gTest, CppuTest is a CPP framework for unit tests. This commit adds support to detect Cpputest console output when verbose mode is enabled (-v).

I am open for any feedback. My main use case was some unit tests that were written with Cpputest that I needed to port to Zephyr and integrate with twister.

MaureenHelm · 2024-08-08T15:20:22Z

@vChavezB please take a look at the failed checks

vChavezB · 2024-08-08T21:03:07Z

Thanks for the feedback, I must have missed it.

hakehuang · 2024-08-09T05:20:47Z

would be possible to a test application for this?

PerMac · 2024-08-09T07:50:07Z

doc/develop/test/twister.rst

Why the need for "-v"? I don't see it in the code. Also, it shouldn't be the case. Level of output verbosity mustn't affect a test result.

The verbose argument must be applied to your CPPUtest application. Correct me if I am wrong but if you do not add the verbose option, you do not get information about which test cases have passed. Instead you will only get a dot for each test that has passed (e.g. ....) and at the end something such as OK (2 tests, 2 ran, 94 checks, 0 ignored, 0 filtered out, 2 ms).

Without verbose

.. OK (2 tests, 2 ran, 94 checks, 0 ignored, 0 filtered out, 2 ms)

With verbose

TEST(MyGroup, test1) TEST(MyGroup, test2) OK (2 tests, 2 ran, 94 checks, 0 ignored, 0 filtered out, 2 ms)

vChavezB · 2024-08-09T09:26:08Z

would be possible to a test application for this?

I made a sample here

https://github.com/vChavezB/zephyr_cpputest_sample

git clone https://github.com/vChavezB/zephyr_cpputest_sample
wes init -l zephyr_cpputest_sample
west update -o=--depth=1 -n
./zephyr/scripts/twister -vvv -T zephyr_cpputest_sample

hakehuang · 2024-08-12T03:35:45Z

would be possible to a test application for this?

I made a sample here

https://github.com/vChavezB/zephyr_cpputest_sample
git clone https://github.com/vChavezB/zephyr_cpputest_sample
wes init -l zephyr_cpputest_sample
west update -o=--depth=1 -n
./zephyr/scripts/twister -vvv -T zephyr_cpputest_sample

I would support you to move this test into tests/cpputest

vChavezB · 2025-03-04T17:14:44Z

Rebased and fixed according to #81176 (comment)

tests/cpputest/base/testcase.yml

scripts/tests/twister/test_harness.py

hakehuang · 2025-03-21T08:16:21Z

tests/cpputest/base/CMakeLists.txt

+include(FetchContent)
+FetchContent_Declare(
+    CppUTest
+    GIT_REPOSITORY https://github.com/cpputest/cpputest.git


is it possible to move cpputest project into zephyr umbrella? further, ztest has many configs which would be good to aligned with cpputest as well.

By moving, do you mean declaring a west manifest under tests/cpputest/base/west.yml with cpputest or something such as creating a repository under the github url zephyproject-rtos/cpputest ?

about the configs you mean creating an interoperability layer to make the KConfigs from ZTest compatible when using cpputest such as

https://docs.zephyrproject.org/latest/develop/test/ztest.html#repeating-tests

By moving, do you mean declaring a west manifest under tests/cpputest/base/west.yml with cpputest or something such as creating a repository under the github url zephyproject-rtos/cpputest ?

yes

about the configs you mean creating an interoperability layer to make the KConfigs from ZTest compatible when using cpputest such as

https://docs.zephyrproject.org/latest/develop/test/ztest.html#repeating-tests

check this file,
https://github.com/zephyrproject-rtos/zephyr/blob/main/subsys/testsuite/ztest/Kconfig

By moving, do you mean declaring a west manifest under tests/cpputest/base/west.yml with cpputest or something such as creating a repository under the github url zephyproject-rtos/cpputest ?

yes

Do you mean yes...declaring a west manifest or yes creating a repository? If you mean declaring a west manifest, do you mean adding cpputest to the root of the zephyr project repo, such as is the case for bsim, see

zephyr/west.yml

Line 36 in 961593d

- name: babblesim_base

check this file,
https://github.com/zephyrproject-rtos/zephyr/blob/main/subsys/testsuite/ztest/Kconfig

Are you proposing to add a repository under /subsys/testsuite/cpputest and replicate the Kconfigs from ztest for cpputest?

sorry for the specific questions but its not that clear for me as I havent used ztest.

no actually. I will raise this problem in testing working group this week. Maybe we can enhance in following PR, but would this possible that you create a similar Kconfig for cpputest first.

per TWG meeting, we agreed that Kconfig is no need to aligned with ztest.

thanks for the info. So what would be required to continue with the PR.
Kind regards

@vChavezB can you contact @nashif on whether cpputest can move into zephyr project.

Is it enough to tag him here? @nashif , as per @hakehuang , there is a question regarding adding cpputest to the zephyr project.

From my perspective unless, someone will mantain cpputest for the zephyr project it is a good idea to add it. If not I would suggest just adding a west manifest to tests/cpputest/base/west.yml if using the CMake FetchContent_Declare is not preferred by the maintainers.

github-actions · 2025-06-12T00:39:27Z

This pull request has been marked as stale because it has been open (more than) 60 days with no activity. Remove the stale label or add a comment saying that you would like to have the label removed otherwise this pull request will automatically be closed in 14 days. Note, that you can always re-open a closed pull request at any time.

vChavezB · 2025-06-15T13:03:16Z

rebased as there was a conflict in the docs with the addition of harness "power". Will leave this PR for any further discussion on what to do with cpputest as mentioned here #74372 (comment)

Similar to gTest, CppuTest is a CPP framework for unit tests. This commit adds support based on the console output of a cpputest test suite application. Signed-off-by: Victor Chavez <[email protected]>

sonarqubecloud · 2025-06-15T14:46:03Z

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

github-actions · 2025-09-20T00:34:57Z

This pull request has been marked as stale because it has been open (more than) 60 days with no activity. Remove the stale label or add a comment saying that you would like to have the label removed otherwise this pull request will automatically be closed in 14 days. Note, that you can always re-open a closed pull request at any time.

epc-ake · 2025-10-30T10:19:58Z

Are there still plans to merge this?
I would appreciate cpputest support in zephyr since a lot of our existing code bases test using cpputest.

zephyrbot added area: Twister Twister area: Documentation labels Jun 16, 2024

zephyrbot requested review from KamilxPaszkiet, LukaszMrugala, PerMac, carlescufi, gchwier, golowanow, gopiotr, hakehuang, kartben and nashif June 16, 2024 15:36

zephyrbot assigned nashif Jun 16, 2024

vChavezB force-pushed the twister_cpputest branch 2 times, most recently from f471155 to 1284fbd Compare June 16, 2024 19:26

nashif added this to the v4.0.0 milestone Jun 18, 2024

vChavezB force-pushed the twister_cpputest branch from 1284fbd to bd0a57f Compare August 8, 2024 21:12

zephyrbot added the area: Testsuite Testsuite label Aug 8, 2024

zephyrbot requested review from aaronemassey, asemjonovs, jeremybettis and yperess August 8, 2024 21:12

vChavezB force-pushed the twister_cpputest branch 2 times, most recently from d526801 to 0ddcc40 Compare August 8, 2024 21:42

PerMac reviewed Aug 9, 2024

View reviewed changes

vChavezB force-pushed the twister_cpputest branch 3 times, most recently from d4ecb01 to 647d718 Compare March 4, 2025 12:25

nashif reviewed Mar 15, 2025

View reviewed changes

tests/cpputest/base/testcase.yml Show resolved Hide resolved

vChavezB force-pushed the twister_cpputest branch from 647d718 to 6dad12c Compare March 15, 2025 19:39

yperess requested changes Mar 16, 2025

View reviewed changes

scripts/tests/twister/test_harness.py Show resolved Hide resolved

yperess previously approved these changes Mar 21, 2025

View reviewed changes

hakehuang reviewed Mar 21, 2025

View reviewed changes

github-actions bot added the Stale label Jun 12, 2025

vChavezB closed this Jun 15, 2025

vChavezB force-pushed the twister_cpputest branch from 6dad12c to ea29907 Compare June 15, 2025 12:32

vChavezB reopened this Jun 15, 2025

vChavezB dismissed yperess’s stale review via 36f8d6a June 15, 2025 12:59

vChavezB force-pushed the twister_cpputest branch 5 times, most recently from 16fe82e to 5b75d67 Compare June 15, 2025 14:35

twister: Add support for Cpputest

925cd69

Similar to gTest, CppuTest is a CPP framework for unit tests. This commit adds support based on the console output of a cpputest test suite application. Signed-off-by: Victor Chavez <[email protected]>

vChavezB force-pushed the twister_cpputest branch from 5b75d67 to 925cd69 Compare June 15, 2025 14:41

github-actions bot removed the Stale label Jun 16, 2025

danieldegrasse removed this from the v4.2.0 milestone Jul 21, 2025

github-actions bot added the Stale label Sep 20, 2025

github-actions bot closed this Oct 5, 2025

twister: Add support for Cpputest #74372

twister: Add support for Cpputest #74372

Uh oh!

Conversation

vChavezB commented Jun 16, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

MaureenHelm commented Aug 8, 2024

Uh oh!

vChavezB commented Aug 8, 2024

Uh oh!

hakehuang commented Aug 9, 2024

Uh oh!

Choose a reason for hiding this comment

Uh oh!

vChavezB Aug 9, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Without verbose

With verbose

Uh oh!

vChavezB commented Aug 9, 2024

Uh oh!

hakehuang commented Aug 12, 2024

Uh oh!

vChavezB commented Mar 4, 2025

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

vChavezB Mar 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Jun 12, 2025

Uh oh!

vChavezB commented Jun 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sonarqubecloud bot commented Jun 15, 2025

Quality Gate passed

Uh oh!

github-actions bot commented Sep 20, 2025

Uh oh!

epc-ake commented Oct 30, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

11 participants

vChavezB commented Jun 16, 2024 •

edited

Loading

vChavezB Aug 9, 2024 •

edited

Loading

vChavezB Mar 21, 2025 •

edited

Loading

vChavezB commented Jun 15, 2025 •

edited

Loading