Pioreactor not showing up as assigned in all parts of ui

[clock-matt]

My pioreactors are not showing up as assigned in all of the UI:

but it does show up as assigned in some places:

This is of particular issue because it is preventing me from starting any activities, since the UI doesn't think any pioreactors are assigned, and from running any calibrations, again because it doesn't think any pioreactors are assigned. Here is the log file from when I tried to run a calibration for the media pump:
pio calibrations run --device media_pump
2025-06-16T13:16:33-0700 INFO [pump_calibration] Starting pump calibration.
Traceback (most recent call last):
File "/usr/local/bin/pio", line 8, in
sys.exit(pio())
^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1157, in call
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/decorators.py", line 33, in new_func
return f(get_current_context(), *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/cli/calibrations.py", line 127, in run_calibration
calibration_struct = assistant().run(
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/calibrations/init.py", line 80, in run
return run_pump_calibration(target_device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/calibrations/pump_calibration.py", line 391, in run_pump_calibration
with managed_lifecycle(unit, experiment, "pump_calibration"):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/utils/init.py", line 161, in init
if not ignore_is_active_state and not whoami.is_active(unit):
^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/whoami.py", line 95, in is_active
raise e
File "/usr/local/lib/python3.11/dist-packages/pioreactor/whoami.py", line 88, in is_active
result.raise_for_status()
File "/usr/local/lib/python3.11/dist-packages/pioreactor/mureq.py", line 229, in raise_for_status
raise HTTPErrorStatus(self.status_code)
pioreactor.mureq.HTTPErrorStatus: HTTP response returned error code 500

And here is a log file for when I tried to run the calibration for the stirrer:
pio calibrations run --device stirring
Traceback (most recent call last):
File "/usr/local/bin/pio", line 8, in
sys.exit(pio())
^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1157, in call
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/click/decorators.py", line 33, in new_func
return f(get_current_context(), *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/cli/calibrations.py", line 127, in run_calibration
calibration_struct = assistant().run(
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/calibrations/init.py", line 92, in run
return run_stirring_calibration(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/calibrations/stirring_calibration.py", line 41, in run_stirring_calibration
experiment = get_testing_experiment_name()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/whoami.py", line 28, in get_testing_experiment_name
exp = get_assigned_experiment_name(get_unit_name())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/whoami.py", line 35, in get_assigned_experiment_name
return _get_assigned_experiment_name(unit_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pioreactor/whoami.py", line 73, in _get_assigned_experiment_name
raise ConnectionError(
ConnectionError: Not able to access experiments in UI. Check http://127.0.0.1/api/experiments.

For now I'm going to roll back on the updates and see if that fixes the problem. I'll update on how that goes.

[clock-matt]

The pioreactors are also not showing up in my inventory, and gave this odd error when I tried to add them:

[clock-matt]

It is however in my leader inventory:

[clock-matt]

Of note, only one of my pioreactors seems to be having this issue. They have the same set up, so I'm not sure what's causing the issue. But I'll see if I can find any differences in their configurations to diagnose the issue.

[clock-matt]

Well, it looks like when I most recently ran the update on the working pioreactor it didnt update all the way to 25.6.3 (it's on 25.4.11) so that may be the issue.

[CamDavidsonPilon]

Hi @clock-matt
It's possible there is a mistmatch in the app version vs the ui version. When you visit the Updates page, and however over "Version installed on leader" near the top, what version do you see?

The other things I'm thinking is that the worker table didn't get updated correctly to handle model name and model version (to support the pioreactor 40ml). To check this:

1. SSH into your leader
2. run pio db. This opens up a shell to your database.
3. enter

   PRAGMA table_info(workers);
   

4. Check if you see model_name and model_version in the list?

[CamDavidsonPilon]

Also, @clock-matt, who is your leader, and have they always been your leader?

[clock-matt]

It says the version installed on leader is 25.6.3 on the not working pioreactor (02 for future nomenclature) and is 25.4.11 on pioreactor01. I'm not really sure which is the leader, I believe they are set up independent from one another, but of course I did set up pioreactor01 first. When I'm on the inventory page of pioreactor01, pioreactor02 does not show up, so I don't think piorector01 is configured as the leader of pioreactor02. Currently I cannot see anything in the inventory of pioreactor02, but when I go to assign pioreactors I do have the option to assign both pioreactor. I haven't tried assining pioreactor01 on pioreactor02's page yet so I'll try that as well as the pio db thing.

[clock-matt]

When i enter the pio db command I do not see a model_name or model_version:

[clock-matt]

I tried assigning pioreactor01 in pioreactor02's GUI and I wasn't able to do so. Going to try a rollback now.

[clock-matt]

I wasn't able to figure out how to do a rollback, I tried downloading the old zip file and using that to update on the UI but that doesn't seem to have done anything. I then tried to see if re-updating to 25.6.3 from the zip file would help but it also doesn't seem to have done anything.

[CamDavidsonPilon]

I believe the issue is the workers table doesn't have the right columns. On the Pioreactor you think is the leader (only should have 1 leader), run the following:

1. Run pio db
2. copy and paste the following in that shell

ALTER TABLE workers ADD COLUMN model_version TEXT;
ALTER TABLE workers ADD COLUMN model_name TEXT;

3. Exit with .q

Now try the inventory page again. Does that work? If so, you will need to click on the dropdown beside "Model" for each Pioreactor and select the version.

---

Alternatively, you can reflash your cluster, but you'll lose data & calibrations.