Containers pending/missing post update to 2.3.70

[bretthanus]

after updating with soup, so-aptcacherng will not advance beyond pending, and so-playbook and so-soctopus are missing:

so-status

Checking Docker status

    Docker ----------------------------------------------------------------------------------------------------------------------------------------- [ OK ]

Checking container statuses

    so-aptcacherng ---------------------------------------------------------------------------------------------------------------------------- [ PENDING ]
    so-cortex -------------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-dockerregistry ------------------------------------------------------------------------------------------------------------------------------ [ OK ]
    so-elastalert ---------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-elasticsearch ------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-filebeat ------------------------------------------------------------------------------------------------------------------------------------ [ OK ]
    so-fleet --------------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-grafana ------------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-idstools ------------------------------------------------------------------------------------------------------------------------------------ [ OK ]
    so-influxdb ------------------------------------------------------------------------------------------------------------------------------------ [ OK ]
    so-kibana -------------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-kratos -------------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-logstash ------------------------------------------------------------------------------------------------------------------------------------ [ OK ]
    so-mysql --------------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-nginx --------------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-playbook ------------------------------------------------------------------------------------------------------------------------------- [ MISSING ]
    so-redis --------------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-sensoroni ----------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-soc ----------------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-soctopus ------------------------------------------------------------------------------------------------------------------------------- [ MISSING ]
    so-telegraf ------------------------------------------------------------------------------------------------------------------------------------ [ OK ]
    so-thehive ------------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-thehive-es ---------------------------------------------------------------------------------------------------------------------------------- [ OK ]
    so-wazuh --------------------------------------------------------------------------------------------------------------------------------------- [ OK ]

salt-call state.highstate seems to complete successfully:

Summary for local
--------------
Succeeded: 636 (changed=25)
Failed:      0
--------------
Total states run:     636
Total run time:    78.507 s

so-start playbook returns:

Summary for local
-------------
Succeeded: 19 (changed=4)
Failed:     0
-------------
Total states run:     19
Total run time:    4.703 s

but then so-status shows playbook as 'error'
so-playbook --------------------------------------------------------------------------------------------------------------------------------- [ ERROR ]
repeating same for soctopus returns:
`Summary for local

Succeeded: 8 (changed=1)
Failed: 0

Total states run: 8
Total run time: 2.144 s
while the so-status also shows the 'missing' become 'error' so-soctopus --------------------------------------------------------------------------------------------------------------------------------- [ ERROR ]
`

[dougburks]

Have you tried running sudo so-docker-refresh?

[bretthanus]

i did last week, and it made no difference- but today i am back on track - Thanks Doug.

[bretthanus]

I had to also run the so-start for playbook and soctopus, but after the docker refresh, aptcacherng was 'ok' status, and starting the two missing services was successful.