Fix ConfigurationVO load exception after schema change #10485

abh1sar · 2025-02-28T18:11:40Z

Description

This PR fixes #10480

The configuration table schema was changed in PR #10300
But it causes problem if the ConfigurationVO class structure was cached with the old fields.

Types of changes

Breaking change (fix or feature that would cause existing functionality to change)
New feature (non-breaking change which adds functionality)
Bug fix (non-breaking change which fixes an issue)
Enhancement (improves an existing feature and functionality)
Cleanup (Code refactoring and cleanup, that may add test cases)
build/CI
test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

Major
Minor

Bug Severity

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

codecov · 2025-02-28T18:19:48Z

Codecov Report

❌ Patch coverage is 0% with 14 lines in your changes missing coverage. Please review.
✅ Project coverage is 16.57%. Comparing base (8e4fe1c) to head (04dbc7e).
⚠️ Report is 181 commits behind head on main.

Files with missing lines	Patch %	Lines
...ain/java/com/cloud/utils/db/TransactionLegacy.java	0.00%	6 Missing ⚠️
...src/main/java/com/cloud/upgrade/dao/DbUpgrade.java	0.00%	3 Missing ⚠️
...ava/com/cloud/upgrade/dao/Upgrade42010to42100.java	0.00%	3 Missing ⚠️
...java/com/cloud/upgrade/DatabaseUpgradeChecker.java	0.00%	2 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main   #10485      +/-   ##
============================================
- Coverage     16.57%   16.57%   -0.01%     
  Complexity    13988    13988              
============================================
  Files          5745     5746       +1     
  Lines        510847   510862      +15     
  Branches      62140    62142       +2     
============================================
- Hits          84696    84695       -1     
- Misses       416677   416692      +15     
- Partials       9474     9475       +1

Flag	Coverage Δ
uitests	`3.91% <ø> (ø)`
unittests	`17.47% <0.00%> (-0.01%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

abh1sar · 2025-03-03T08:30:02Z

@blueorangutan package

blueorangutan · 2025-03-03T08:32:04Z

@abh1sar a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2025-03-03T08:33:34Z

Packaging result [SF]: ✖️ el8 ✖️ el9 ✖️ debian ✖️ suse15. SL-JID 12634

abh1sar · 2025-03-03T11:28:17Z

@blueorangutan package

blueorangutan · 2025-03-03T11:30:04Z

@abh1sar a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2025-03-03T12:31:53Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 12636

abh1sar · 2025-03-03T12:52:05Z

@blueorangutan test

blueorangutan · 2025-03-03T12:54:04Z

@abh1sar a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

blueorangutan · 2025-03-03T13:50:24Z

[SF] Trillian Build Failed (tid-12539)

rohityadavcloud · 2025-03-04T06:09:08Z

@blueorangutan test

blueorangutan · 2025-03-04T06:10:03Z

@rohityadavcloud a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

blueorangutan · 2025-03-04T07:12:28Z

[SF] Trillian Build Failed (tid-12546)

abh1sar · 2025-03-04T08:22:36Z

@blueorangutan package

blueorangutan · 2025-03-04T08:24:03Z

@abh1sar a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2025-03-04T08:24:05Z

[SF] Trillian Build Failed (tid-12553)

blueorangutan · 2025-03-04T09:27:00Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 12648

blueorangutan · 2025-03-04T10:29:47Z

[SF] Trillian Build Failed (tid-12555)

JoaoJandre · 2025-03-04T15:05:24Z

Instead of changing how we get the value, shouldn't we normalize the database data so that it works with the current way of getting the values?

Otherwise, if someone in the future creates a method to get the value the old way and only tests on a new install, it might introduce a bug for people running old installs.

Signed-off-by: Abhishek Kumar <[email protected]>

…StringValueInternal()

into upgrade-config

abh1sar · 2025-03-11T13:15:24Z

@JoaoJandre We identified the issue with how BackupDaoImpl class caches the columns of the table. Even though both configurations table and ConfigurationVO code has the new schema, the ConfigurationsDao._allColumns field still had the older schema from before upgrade. That's why after management server restart ConfigurationsDaoImpl_allColumns was getting regenerated with the correct fields.
I have reverted the older commit and added the commit to regenerate ConfigurationsDaoImpl._allColumns when the Configurations table schema is changed.

abh1sar · 2025-05-21T04:01:26Z

@blueorangutan package

blueorangutan · 2025-05-21T04:02:03Z

@abh1sar a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

blueorangutan · 2025-05-21T05:22:40Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 13470

abh1sar · 2025-05-21T12:50:59Z

@blueorangutan test

blueorangutan · 2025-05-21T12:52:05Z

@abh1sar a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

blueorangutan · 2025-05-22T03:09:43Z

[SF] Trillian test result (tid-13371)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 48522 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10485-t13371-kvm-ol8.zip
Smoke tests completed. 133 look OK, 1 have errors, 7 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
ContextSuite context=TestIpv6Vpc>:setup	`Error`	0.00	test_vpc_ipv6.py
all_test_vpc_redundant	`Skipped`	---	test_vpc_redundant.py
all_test_vpc_router_nics	`Skipped`	---	test_vpc_router_nics.py
all_test_vpc_vpn	`Skipped`	---	test_vpc_vpn.py
all_test_webhook_delivery	`Skipped`	---	test_webhook_delivery.py
all_test_webhook_lifecycle	`Skipped`	---	test_webhook_lifecycle.py
all_test_host_maintenance	`Skipped`	---	test_host_maintenance.py
all_test_hostha_kvm	`Skipped`	---	test_hostha_kvm.py

shwstppr · 2025-07-09T07:29:01Z

@abh1sar @sureshanaparti I think we should try to get this in 4.21

@blueorangutan package

blueorangutan · 2025-07-09T07:30:03Z

@shwstppr a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

DaanHoogland

clgtm

blueorangutan · 2025-07-09T09:36:33Z

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 14115

DaanHoogland · 2025-07-09T10:13:34Z

@blueorangutan test

blueorangutan · 2025-07-09T10:14:04Z

@DaanHoogland a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

blueorangutan · 2025-07-10T03:33:41Z

[SF] Trillian test result (tid-13737)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 59320 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10485-t13737-kvm-ol8.zip
Smoke tests completed. 141 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File

DaanHoogland · 2025-07-10T07:47:54Z

@abh1sar et al, please advice on testing. It seems to me an upgrade test is needed at least.

abh1sar · 2025-07-10T07:55:30Z

@DaanHoogland
The exceptions are seen every time the management server is started after running the cloudstack-setup-database command. So, the fix can be verified that way.
Both HikariCP and Apache DBCP should be tested.

Upgrade should also be tested for any regressions, and logs reviewed after the upgrade to check that the exceptions are not there.

sureshanaparti

clgtm

rosi-shapeblue

LGTM - CloudStack Configuration Loading Fix Verified

Test Cases Executed

TC1: Database Recreation Test - Fresh database setup after cloudstack-setup-databases
- Status: Pass
TC2: Management Server Startup - Monitor for configuration loading errors during startup
- Status: Pass
TC3: Configuration Access Verification - Verify configuration values are accessible
- Status: Pass
TC4: Service Restart Behavior - Verify clean restart without configuration errors
- Status: Pass
TC5: Error Pattern Detection - Confirm absence of "Cannot determine value type" errors
- Status: Pass

Test Execution Sequence

Step 1: Environment Preparation

# Create backup directory
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 ~]# mkdir -p /root/test-backup-$(date +%Y%m%d-%H%M%S)
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 ~]# cd test-backup-20250811-150656/

# Backup database
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# mysqldump -u root -p cloud > cloud_backup.sql
Enter password: 
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# ls -la cloud_backup.sql
-rw-r--r--. 1 root root 2847913 Aug 11 15:07 cloud_backup.sql

# Backup configuration files
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# cp -r /etc/cloudstack cloudstack_config_backup

# Backup current logs for comparison
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# cp /var/log/cloudstack/management/management-server.log management-server.log.backup

# Save backup location for potential restore
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# pwd > /tmp/backup_location.txt
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# echo "Backup created in: $(pwd)"
Backup created in: /root/test-backup-20250811-150656

# Verify backup contents
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# ls -la
total 2784
drwxr-xr-x.  3 root root      85 Aug 11 15:07 .
dr-xr-x---. 18 root root    4096 Aug 11 15:06 ..
-rw-r--r--.  1 root root 2847913 Aug 11 15:07 cloud_backup.sql
drwxr-xr-x.  4 root root      33 Aug 11 15:07 cloudstack_config_backup
-rw-r--r--.  1 root root   10234 Aug 11 15:07 management-server.log.backup

Step 2: Stop Management Server

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# systemctl stop cloudstack-management
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# systemctl status cloudstack-management
● cloudstack-management.service - CloudStack Management Server
   Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; enabled; vendor preset: disabled)
   Active: failed (Result: exit-code) since Mon 2025-08-11 15:11:24 UTC; 2s ago

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# echo "Management server stopped at: $(date)"
Management server stopped at: Mon Aug 11 15:11:32 UTC 2025

Step 3: Add Test Marker

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# echo "=== TEST START MARKER - $(date) ===" >> /var/log/cloudstack/management/management-server.log

Step 4: Database Recreation

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# cloudstack-setup-databases cloud:cloud@localhost --deploy-as=root:P@ssword123
Mysql user name:cloud                                                           [ OK ]
Mysql user password:******                                                      [ OK ]
Mysql server ip:localhost                                                       [ OK ]
Mysql server port:3306                                                          [ OK ]
Mysql root user name:root                                                       [ OK ]
Mysql root user password:******                                                 [ OK ]
Checking Cloud database files ...                                               [ OK ]
Checking local machine hostname ...                                             [ OK ]
Checking SELinux setup ...                                                      [ OK ]
Detected local IP address as 10.0.33.190, will use as cluster management server node IP[ OK ]
Preparing /etc/cloudstack/management/db.properties                              [ OK ]
Applying /usr/share/cloudstack-management/setup/create-database.sql             [ OK ]
Applying /usr/share/cloudstack-management/setup/create-schema.sql               [ OK ]
Applying /usr/share/cloudstack-management/setup/create-database-premium.sql     [ OK ]
Applying /usr/share/cloudstack-management/setup/create-schema-premium.sql       [ OK ]
Applying /usr/share/cloudstack-management/setup/server-setup.sql                [ OK ]
Applying /usr/share/cloudstack-management/setup/templates.sql                   [ OK ]
Processing encryption ...                                                       [ OK ]
Finalizing setup ...                                                            [ OK ]

CloudStack has successfully initialized database, you can check your database configuration in /etc/cloudstack/management/db.properties

Step 5: Start Management Server

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# systemctl start cloudstack-management
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# systemctl status cloudstack-management
● cloudstack-management.service - CloudStack Management Server
   Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2025-08-11 15:12:50 UTC; 11s ago

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# echo "Management server started at: $(date)"
Management server started at: Mon Aug 11 15:13:05 UTC 2025

Monitoring Results

NO ERRORS DETECTED - logs monitoring showed no configuration loading errors during startup.

Step 6: Restart Test (Verifying Fix Behavior)

Result: Restart completed successfully with no configuration errors.

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# echo "=== RESTART TEST - $(date) ===" >> /var/log/cloudstack/management/management-server.log
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# systemctl restart cloudstack-management
[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# systemctl status cloudstack-management
● cloudstack-management.service - CloudStack Management Server
   Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2025-08-11 15:17:33 UTC; 1s ago

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# echo "Management server restarted at: $(date)"
Management server restarted at: Mon Aug 11 15:17:42 UTC 2025

Verification Tests

Error Count Verification

Result: Zero configuration loading errors found.

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# grep -c "Cannot determine value type from string" /var/log/cloudstack/management/management-server.log
0

Configuration Access Test

Result: Configuration values accessible and correct.

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 ~]# mysql -u root -p -e "USE cloud; SELECT name, value FROM configuration WHERE name IN ('drs.plan.expire.interval', 'job.cancel.threshold.minutes');"
Enter password: 
+------------------------------+-------+
| name                         | value |
+------------------------------+-------+
| drs.plan.expire.interval     | 30    |
| job.cancel.threshold.minutes | 60    |
+------------------------------+-------+

Final Pass/Fail Test

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# [ $(grep -c "Cannot determine value type from string" /var/log/cloudstack/management/management-server.log) -eq 0 ] && echo "FINAL RESULT: TEST PASSED" || echo "FINAL RESULT: TEST FAILED"

FINAL RESULT: TEST PASSED

Service Status Verification

Result: Management server running and listening on all expected ports.

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 ~]# systemctl status cloudstack-management
● cloudstack-management.service - CloudStack Management Server
   Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2025-08-11 15:17:33 UTC; 5min ago

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 ~]# ss -tulpn | grep java
tcp   LISTEN 0      50                        *:8080             *:*    users:(("java",pid=25213,fd=36))                          
tcp   LISTEN 0      50                        *:8250             *:*    users:(("java",pid=25213,fd=33))                          
tcp   LISTEN 0      50     [::ffff:10.0.33.190]:9090             *:*    users:(("java",pid=25213,fd=34))

API Response Verification

Result: API responding correctly with CloudStack 4.21.0.0-SNAPSHOT. HTTP 401 is expected without authentication.

[root@ref-trl-9216-k-Mol8-rositsa-kyuchukova-mgmt1 test-backup-20250811-150656]# curl -v http://localhost:8080/client/api?command=listCapabilities
*   Trying ::1...
* TCP_NODELAY set
* Connected to localhost (::1) port 8080 (#0)
> GET /client/api?command=listCapabilities HTTP/1.1
> Host: localhost:8080
> User-Agent: curl/7.61.1
> Accept: */*
> 
< HTTP/1.1 401 Unauthorized
< Content-Type: text/xml;charset=utf-8
< X-Content-Type-Options: nosniff
< X-XSS-Protection: 1;mode=block
< content-security-policy: 1
< content-security-policy: default-src=none
< content-security-policy: script-src=self
< content-security-policy: connect-src=self
< content-security-policy: img-src=self
< content-security-policy: style-src=self
< Content-Length: 238
< 
* Connection #0 to host localhost left intact
<?xml version="1.0" encoding="UTF-8"?><listcapabilitiesresponse cloud-stack-version="4.21.0.0-SNAPSHOT"><errorcode>401</errorcode><errortext>unable to verify user credentials and/or request signature</errortext></listcapabilitiesresponse>

Look up only selected fields in getConfigStringValueInternal()

af6d9f1

boring-cyborg bot added the component:vpc label Feb 28, 2025

abh1sar changed the title ~~Fix ConfigurationVO load exception on fresh install~~ Fix ConfigurationVO load exception after schema change Feb 28, 2025

DaanHoogland added this to the 4.21.0 milestone Mar 3, 2025

Merge branch 'main' into upgrade-config

8ab6142

shwstppr and others added 3 commits March 11, 2025 18:29

fix column cache issue

adf411a

Signed-off-by: Abhishek Kumar <[email protected]>

Revert commit for af6d9f1 : Look up only selected fields in getConfig…

b6873ea

…StringValueInternal()

Merge branch 'upgrade-config' of https://github.com/shapeblue/cloudstack

e56109a

into upgrade-config

boring-cyborg bot added the component:database label Mar 11, 2025

abh1sar self-assigned this Mar 11, 2025

sureshanaparti added this to Apache CloudStack 4.21.0 Jun 5, 2025

sureshanaparti moved this to In Progress in Apache CloudStack 4.21.0 Jun 5, 2025

Merge branch 'main' into upgrade-config

04dbc7e

DaanHoogland approved these changes Jul 9, 2025

View reviewed changes

DaanHoogland added the status:needs-testing label Jul 10, 2025

shwstppr requested a review from sureshanaparti July 28, 2025 08:29

sureshanaparti approved these changes Jul 28, 2025

View reviewed changes

rosi-shapeblue assigned rosi-shapeblue and unassigned harikrishna-patnala and vladimirpetrov Aug 11, 2025

rosi-shapeblue approved these changes Aug 11, 2025

View reviewed changes

sureshanaparti merged commit 9fd2b90 into apache:main Aug 11, 2025
25 of 26 checks passed

sureshanaparti deleted the upgrade-config branch August 11, 2025 15:50

github-project-automation bot moved this from In Progress to Done in Apache CloudStack 4.21.0 Aug 11, 2025

sureshanaparti mentioned this pull request Aug 11, 2025

[DB] Exceptions logged on fresh management server start #10480

Closed

dhslove pushed a commit to ablecloud-team/ablestack-cloud that referenced this pull request Sep 4, 2025

Fix ConfigurationVO load exception after schema change (apache#10485)

d0956d7

Fix ConfigurationVO load exception after schema change #10485

Fix ConfigurationVO load exception after schema change #10485

Uh oh!

Conversation

abh1sar commented Feb 28, 2025

Description

Types of changes

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

Bug Severity

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

Uh oh!

codecov bot commented Feb 28, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

abh1sar commented Mar 3, 2025

Uh oh!

blueorangutan commented Mar 3, 2025

Uh oh!

blueorangutan commented Mar 3, 2025

Uh oh!

abh1sar commented Mar 3, 2025

Uh oh!

blueorangutan commented Mar 3, 2025

Uh oh!

blueorangutan commented Mar 3, 2025

Uh oh!

abh1sar commented Mar 3, 2025

Uh oh!

blueorangutan commented Mar 3, 2025

Uh oh!

blueorangutan commented Mar 3, 2025

Uh oh!

rohityadavcloud commented Mar 4, 2025

Uh oh!

blueorangutan commented Mar 4, 2025

Uh oh!

blueorangutan commented Mar 4, 2025

Uh oh!

abh1sar commented Mar 4, 2025

Uh oh!

blueorangutan commented Mar 4, 2025

Uh oh!

blueorangutan commented Mar 4, 2025

Uh oh!

blueorangutan commented Mar 4, 2025

Uh oh!

blueorangutan commented Mar 4, 2025

Uh oh!

JoaoJandre commented Mar 4, 2025

Uh oh!

abh1sar commented Mar 11, 2025

Uh oh!

abh1sar commented May 21, 2025

Uh oh!

blueorangutan commented May 21, 2025

Uh oh!

blueorangutan commented May 21, 2025

Uh oh!

abh1sar commented May 21, 2025

Uh oh!

blueorangutan commented May 21, 2025

Uh oh!

blueorangutan commented May 22, 2025

Uh oh!

shwstppr commented Jul 9, 2025

Uh oh!

blueorangutan commented Jul 9, 2025

Uh oh!

DaanHoogland left a comment

Choose a reason for hiding this comment

Uh oh!

blueorangutan commented Jul 9, 2025

Uh oh!

DaanHoogland commented Jul 9, 2025

Uh oh!

blueorangutan commented Jul 9, 2025

codecov bot commented Feb 28, 2025 •

edited

Loading