[Bug]:Snapshot failures found during R CMD Check

[Andrew-Acker125]

What happened?

Hello, We've been running R CMD check for packages for our package registry manager PRISM (Home | PRISM) and noticed that teal.widgets is failing during tests. We found the root cause to be newer versions of shiny, as the snapshot test passes when using shiny 1.11.0 an older version.
The full error output:

checking tests Running testthat.R
  Running the tests in tests/testthat.R failed.
  Last 13 lines of output:
    + <button class="btn btn-default action-button teal-widgets-busy-disable button"
    +   id="STH-button" type="button">
    +   <span class="action-label">STH2</span>
    + </button>
    Snapshots
    To review and process snapshots locally:
    * Locate check directory.
    * Copy 'tests/testthat/_snaps' to local package.
    * Run `testthat::snapshot_accept()` to accept all changes.
    * Run `testthat::snapshot_review()` to review all changes.
    [ FAIL 1 | WARN 0 | SKIP 27 | PASS 253 ]
    Error: ! Test failures.
    Execution halted

Here is the failing test:

rtestthat::test_that("snapshot test for verbatim_popup_ui", {
  testthat::skip_if_not_installed("withr")
  withr::local_seed(1)
  testthat::expect_snapshot(verbatim_popup_ui("STH", "STH2"))
})

Expected Snapshot:

html<button class="btn btn-default action-button teal-widgets-busy-disable button"
  id="STH-button" type="button">STH2</button>

Snapshot when tested:

html<button class="btn btn-default action-button teal-widgets-busy-disable button"
  id="STH-button" type="button">
  <span class="action-label">STH2</span>
</button>

Happy to provide any more details or clarity if needed.

sessionInfo()

Relevant log output

Code of Conduct

• I agree to follow this project's Code of Conduct.

Contribution Guidelines

• I agree to follow this project's Contribution Guidelines.

Security Policy

• I agree to follow this project's Security Policy.

[llrs-roche]

I can reproduce the expected snapshot locally but only on interactive session (not devtools::test()). Thanks for reporting it.

[llrs-roche]

I manually changed the tests but when testing again the package the test failed:

> devtools:::test_active_file()
[ FAIL 1 | WARN 0 | SKIP 0 | PASS 10 ]

── Failure (test-verbatim_popup_ui.R:156:3): snapshot test for verbatim_popup_ui ─────────────────────────────────────────────────────────────────────
Snapshot of code has changed:
old vs new
  Code
    verbatim_popup_ui("STH", "STH2")
  Output
-   <button class="btn btn-default action-button teal-widgets-busy-disable button" id="STH-button" type="button">STH2</button>
+   <button class="btn btn-default action-button teal-widgets-busy-disable button" id="STH-button" type="button">
+     <span class="action-label">STH2</span>
+   </button>
* Run testthat::snapshot_accept("verbatim_popup_ui") to accept the change.
* Run testthat::snapshot_review("verbatim_popup_ui") to review the change.
[ FAIL 1 | WARN 0 | SKIP 0 | PASS 10 ]
> packageVersion("shiny")
[1] '1.12.1'

I'm not sure what is going on now, but I'll make the test conditional to a minimal shiny version

[Andrew-Acker125]

appreciate it @llrs-roche !

[donyunardi]

I don't see the same behavior and can't reproduce the error:

> devtools:::test_active_file()

══ Testing test-verbatim_popup_ui.R ════════════════════════════════════════════════════════════════════════════
[ FAIL 0 | WARN 0 | SKIP 0 | PASS 11 ] Done!
> 
> packageVersion("shiny")
[1] ‘1.12.1’
>

SessionInfo

> sessionInfo()
R version 4.5.2 (2025-10-31)
Platform: aarch64-apple-darwin20
Running under: macOS Sequoia 15.7.3

Matrix products: default
BLAS:   /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib 
LAPACK: /Library/Frameworks/R.framework/Versions/4.5-arm64/Resources/lib/libRlapack.dylib;  LAPACK version 3.12.1

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

time zone: America/Los_Angeles
tzcode source: internal

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] teal.widgets_0.6.0 testthat_3.3.1    

loaded via a namespace (and not attached):
 [1] gtable_0.3.6           bslib_0.9.0            ggplot2_4.0.0          shinyjs_2.1.0         
 [5] htmlwidgets_1.6.4      formatters_0.5.12.9002 devtools_2.4.5         remotes_2.5.0.9000    
 [9] websocket_1.4.4        processx_3.8.6         callr_3.7.6            vctrs_0.6.5           
[13] tools_4.5.2            ps_1.9.1               generics_0.1.4         tibble_3.3.0          
[17] R.oo_1.27.1            pkgconfig_2.0.3        checkmate_2.3.2        RColorBrewer_1.1-3    
[21] S7_0.2.1               desc_1.4.3             gt_1.3.0               R.cache_0.17.0        
[25] lifecycle_1.0.4        compiler_4.5.2         farver_2.1.2           brio_1.1.5            
[29] chromote_0.5.1         codetools_0.2-20       httpuv_1.6.16          shinyWidgets_0.9.0    
[33] htmltools_0.5.9        usethis_3.2.1          sass_0.4.10            later_1.4.4           
[37] pillar_1.11.1          jquerylib_0.1.4        urlchecker_1.0.1       R.utils_2.13.0        
[41] ellipsis_0.3.2         cachem_1.1.0           rtables_0.6.15.9003    sessioninfo_1.2.3     
[45] mime_0.13              styler_1.10.3          tidyselect_1.2.1       rvest_1.0.4           
[49] digest_0.6.39          stringi_1.8.7          gtsummary_2.5.0        dplyr_1.1.4           
[53] purrr_1.0.4            rprojroot_2.1.1        fastmap_1.2.0          grid_4.5.2            
[57] cli_3.6.5              magrittr_2.0.4         pkgbuild_1.4.8         withr_3.0.2           
[61] waldo_0.6.2            scales_1.4.0           promises_1.5.0         backports_1.5.0       
[65] httr_1.4.7             globals_0.18.0         otel_0.2.0             R.methodsS3_1.8.2     
[69] evaluate_1.0.5         memoise_2.0.1          shiny_1.12.1           miniUI_0.1.2          
[73] profvis_0.4.0          rlang_1.1.6            Rcpp_1.1.0             xtable_1.8-4          
[77] glue_1.8.0             xml2_1.3.8             pkgload_1.4.0          rstudioapi_0.17.1     
[81] jsonlite_2.0.0         shinytest2_0.4.1       R6_2.6.1               fs_1.6.6              
>

R CMD Check also passed in our scheduled CI.

@Andrew-Acker125 Is there a session info from your end that we can use for comparison?
@llrs-roche Can you share your session info too?