Skip to content

Commit 8ae9efd

Browse files
Now load_tests() returns a named list, where the names corresponds to the test titles
1 parent 72e86a4 commit 8ae9efd

14 files changed

+412
-398
lines changed

CONTRIBUTING.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11

22
# Contributing to the 'future.tests' package
33

4-
This Git repository uses the [Git Flow](https://nvie.com/posts/a-successful-git-branching-model/) branching model (the [`git flow`](https://github.com/petervanderdoes/gitflow-avh) extension is useful for this). The [`develop`](https://github.com/HenrikBengtsson/future.tests/tree/develop) branch contains the latest contributions and other code that will appear in the next release, and the [`master`](https://github.com/HenrikBengtsson/future.tests) branch contains the code of the latest release, which is exactly what is currently on [CRAN](https://cran.r-project.org/package=future.tests).
4+
This Git repository uses the [Git Flow](https://nvie.com/posts/a-successful-git-branching-model/) branching model (the [`git flow`](https://github.com/petervanderdoes/gitflow-avh) extension is useful for this). The [`develop`](https://github.com/futureverse/future.tests/tree/develop) branch contains the latest contributions and other code that will appear in the next release, and the [`master`](https://github.com/futureverse/future.tests) branch contains the code of the latest release, which is exactly what is currently on [CRAN](https://cran.r-project.org/package=future.tests).
55

6-
Contributing to this package is easy. Just send a [pull request](https://help.github.com/articles/using-pull-requests/). When you send your PR, make sure `develop` is the destination branch on the [future.tests repository](https://github.com/HenrikBengtsson/future.tests). Your PR should pass `R CMD check --as-cran`, which will also be checked by <a href="https://github.com/HenrikBengtsson/future.tests/actions?query=workflow%3AR-CMD-check">GitHub Actions</a> and when the PR is submitted.
6+
Contributing to this package is easy. Just send a [pull request](https://help.github.com/articles/using-pull-requests/). When you send your PR, make sure `develop` is the destination branch on the [future.tests repository](https://github.com/futureverse/future.tests). Your PR should pass `R CMD check --as-cran`, which will also be checked by <a href="https://github.com/futureverse/future.tests/actions?query=workflow%3AR-CMD-check">GitHub Actions</a> and when the PR is submitted.
77

88
We abide to the [Code of Conduct](https://www.contributor-covenant.org/version/2/0/code_of_conduct/) of Contributor Covenant.

DESCRIPTION

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
Package: future.tests
22
Title: Test Suite for 'Future API' Backends
3-
Version: 0.7.0-9001
3+
Version: 0.7.0-9002
44
Authors@R: c(
55
person("Henrik", "Bengtsson", role = c("aut", "cre", "cph"), email = "[email protected]"),
66
person(family = "The R Consortium", comment = "Project was awared an Infrastructure Steering Committee (ISC) grant in 2017", role = "fnd"))

NEWS.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,9 @@
11
# Version (development version)
22

3-
* ...
3+
## New Features
4+
5+
* Now `load_tests()` returns a named list, where the names
6+
corresponds to the test titles.
47

58

69
# Version 0.7.0 [2023-05-20]

R/test_db.R

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,9 @@ test_db <- local({
2828
}
2929
if (!skip) {
3030
# message(sprintf("Registering %s: %s", class(test)[1], sQuote(test$title)))
31-
db <<- c(db, list(test))
31+
entry <- list(test)
32+
names(entry) <- test$title
33+
db <<- c(db, entry)
3234
}
3335
}
3436

backend_results/future,cluster.out

Lines changed: 58 additions & 58 deletions
Original file line numberDiff line numberDiff line change
@@ -1,70 +1,70 @@
11
── Settings ────────────────────────────────────────────────────────────────────
2-
- future.tests version : 0.6.0.9007
2+
- future.tests version : 0.7.0.9001
33
- R_FUTURE_TESTS_ROOT :
44
- Option 'future.tests.root': NULL
5-
- Default test set folder : /home/henrik/R/x86_64-pc-linux-gnu-library/4.3-CBI-gcc11/future.tests/test-db
5+
- Default test set folder : /home/henrik/R/ubuntu22_04-x86_64-pc-linux-gnu-library/4.4-CBI-gcc11/future.tests/test-db
66
- Max number of workers : 2
77
- Timeout : N/A
88

99
── Running 54 test sets with plan(future::cluster) ─────────────────────────────
10-
ℹ Backend package: future 1.32.0
11-
✔ 1. future() - conditions (1 test) (101ms)
12-
✔ 2. %<-% - conditions (1 test) (287ms)
13-
✔ 3. future() - muffle conditions (1 test) (229ms)
14-
✔ 4. Argument '...' (1 test) (224ms)
15-
✔ 5. Argument '...' from parent function (1 test) (265ms)
16-
✔ 6. Argument '...' - non existing (1 test) (263ms)
17-
✔ 7. Argument '...' - exception (1 test) (267ms)
18-
✔ 8. Early signaling of errors (4 tests) (943ms)
19-
✔ 9. Early signaling of warnings (4 tests) (1s)
20-
✔ 10. Early signaling of messages (4 tests) (1s)
21-
✔ 11. %<-% - local evaluation (2 tests) (494ms)
22-
✔ 12. %<-% - local evaluation & global variable (2 tests) (535ms)
23-
✔ 13. %<-% - errors (2 tests) (423ms)
24-
✔ 14. %<-% - errors and listenv (2 tests) (673ms)
25-
✔ 15. %<-% & %->% (2 tests) (553ms)
26-
✔ 16. %<-% - nested (1 test) (286ms)
27-
✔ 17. futureAssign() - lazy evaluation (2 tests) (528ms)
28-
✔ 18. futureAssign() - potential task name clashes (1 test) (325ms)
29-
✔ 19. futureAssign() - global variables with and without lazy evaluation (2 tests) (655ms)
30-
✔ 20. futureAssign() - lazy evaluation via disposable option (2 tests) (526ms)
31-
✔ 21. futureCall() (4 tests) (3.1s)
32-
✔ 22. futureCall() - globals = list(a = 3) (2 tests) (1.6s)
33-
✔ 23. futureCall() - globals = "a" (2 tests) (1.6s)
34-
✔ 24. future() - rm() a global variable (2 tests) (531ms)
35-
✔ 25. future() - non-exported package objects (1 test) (387ms)
36-
✔ 26. future() - NSE '...' (1 test) (345ms)
37-
✔ 27. resolved() on lazy futures (1 test) (306ms)
38-
✔ 28. demo("mandelbrot", package = "future") (2 tests) (1.6s)
39-
✔ 29. nbrOfWorkers() (1 test) (4ms)
40-
✔ 30. future() - preserve R options (data.table) (1 test) (927ms)
41-
✔ 31. future() - 'data.table' inject (1 test) (548ms)
42-
✔ 32. future() - can load 'ff' package (1 test) (290ms)
43-
✔ 33. future() - can attach 'ff' package (1 test) (255ms)
44-
✔ 34. future() - preserve R options (ff) (1 test) (746ms)
45-
✔ 35. plan() (1 test) (1ms)
46-
✔ 36. plan() - workers=<numeric> (1 test) (396ms)
47-
✔ 37. plan() - workers=<function> (1 test) (1.5s)
48-
✔ 38. plan() - workers=<invalid> (1 test) (2ms)
49-
✔ 39. resolve() (8 tests) (6s)
50-
✔ 40. resolve() - run-time exception (8 tests) (2.1s)
51-
✔ 41. resolve(<list of futures and values>) (2 tests) (534ms)
52-
✔ 42. resolve(<list of futures>) (2 tests) (527ms)
53-
✔ 43. resolve(<named matrix list of futures and values>) - time ordering (1 test) (772ms)
54-
✔ 44. resolved() - assert non-blocking while launching lazy futures (1 test) (4.4s)
55-
✔ 45. Random Number Generation (RNG) - seeds and preserving RNGkind (1 test) (197ms)
56-
✔ 46. Random Number Generation (RNG) - future (2 tests) (894ms)
57-
✔ 47. Random Number Generation (RNG) - %<-% (2 tests) (957ms)
58-
✔ 48. Orchestration Stability - future() does not update RNG state (1 test) (307ms)
59-
✔ 49. Orchestration Stability - run() does not update RNG state (1 test) (288ms)
60-
✔ 50. Orchestration Stability - result() does not update RNG state (1 test) (255ms)
61-
✔ 51. Orchestration Stability - value() does not update RNG state (1 test) (252ms)
62-
✔ 52. future() - standard output (2 tests) (548ms)
63-
✔ 53. %<-% - standard output (2 tests) (484ms)
64-
✔ 54. value() - visibility (1 test) (273ms)
10+
ℹ Backend package: future 1.34.0.9109
11+
✔ 1. future() - conditions (1 test) (104ms)
12+
✔ 2. %<-% - conditions (1 test) (387ms)
13+
✔ 3. future() - muffle conditions (1 test) (415ms)
14+
✔ 4. Argument '...' (1 test) (362ms)
15+
✔ 5. Argument '...' from parent function (1 test) (377ms)
16+
✔ 6. Argument '...' - non existing (1 test) (339ms)
17+
✔ 7. Argument '...' - exception (1 test) (349ms)
18+
✔ 8. Early signaling of errors (4 tests) (1.4s)
19+
✔ 9. Early signaling of warnings (4 tests) (1.3s)
20+
✔ 10. Early signaling of messages (4 tests) (1.3s)
21+
✔ 11. %<-% - local evaluation (2 tests) (696ms)
22+
✔ 12. %<-% - local evaluation & global variable (2 tests) (696ms)
23+
✔ 13. %<-% - errors (2 tests) (703ms)
24+
✔ 14. %<-% - errors and listenv (2 tests) (923ms)
25+
✔ 15. %<-% & %->% (2 tests) (808ms)
26+
✔ 16. %<-% - nested (1 test) (482ms)
27+
✔ 17. futureAssign() - lazy evaluation (2 tests) (738ms)
28+
✔ 18. futureAssign() - potential task name clashes (1 test) (424ms)
29+
✔ 19. futureAssign() - global variables with and without lazy evaluation (2 tests) (935ms)
30+
✔ 20. futureAssign() - lazy evaluation via disposable option (2 tests) (1.1s)
31+
✔ 21. futureCall() (4 tests) (7.2s)
32+
✔ 22. futureCall() - globals = list(a = 3) (2 tests) (4s)
33+
✔ 23. futureCall() - globals = "a" (2 tests) (4.8s)
34+
✔ 24. future() - rm() a global variable (2 tests) (1.7s)
35+
✔ 25. future() - non-exported package objects (1 test) (855ms)
36+
✔ 26. future() - NSE '...' (1 test) (875ms)
37+
✔ 27. resolved() on lazy futures (1 test) (698ms)
38+
✔ 28. demo("mandelbrot", package = "future") (2 tests) (2s)
39+
✔ 29. nbrOfWorkers() (1 test) (18ms)
40+
✔ 30. future() - preserve R options (data.table) (1 test) (918ms)
41+
✔ 31. future() - 'data.table' inject (1 test) (768ms)
42+
✔ 32. future() - can load 'ff' package (1 test) (747ms)
43+
✔ 33. future() - can attach 'ff' package (1 test) (670ms)
44+
✔ 34. future() - preserve R options (ff) (1 test) (1.4s)
45+
✔ 35. plan() (1 test) (2ms)
46+
✔ 36. plan() - workers=<numeric> (1 test) (961ms)
47+
✔ 37. plan() - workers=<function> (1 test) (1.1s)
48+
✔ 38. plan() - workers=<invalid> (1 test) (5ms)
49+
✔ 39. resolve() (8 tests) (8.8s)
50+
✔ 40. resolve() - run-time exception (8 tests) (4.8s)
51+
✔ 41. resolve(<list of futures and values>) (2 tests) (1.6s)
52+
✔ 42. resolve(<list of futures>) (2 tests) (1.5s)
53+
✔ 43. resolve(<named matrix list of futures and values>) - time ordering (1 test) (1.2s)
54+
✔ 44. resolved() - assert non-blocking while launching lazy futures (1 test) (4.5s)
55+
✔ 45. Random Number Generation (RNG) - seeds and preserving RNGkind (1 test) (311ms)
56+
✔ 46. Random Number Generation (RNG) - future (2 tests) (1.9s)
57+
✔ 47. Random Number Generation (RNG) - %<-% (2 tests) (1.8s)
58+
✔ 48. Orchestration Stability - future() does not update RNG state (1 test) (510ms)
59+
✔ 49. Orchestration Stability - run() does not update RNG state (1 test) (625ms)
60+
✔ 50. Orchestration Stability - result() does not update RNG state (1 test) (672ms)
61+
✔ 51. Orchestration Stability - value() does not update RNG state (1 test) (618ms)
62+
✔ 52. future() - standard output (2 tests) (1.2s)
63+
✔ 53. %<-% - standard output (2 tests) (1.1s)
64+
✔ 54. value() - visibility (1 test) (689ms)
6565

6666
Number of tests: 54
6767
Number of test steps: 98
68-
Duration: 43.4s
68+
Duration: 1m 16.4s
6969
Results: 98 ok ✔ | 0 skips ★ | 0 errors ✖ | 0 timeouts T
7070

0 commit comments

Comments
 (0)