Deploying the inference-benchmarker on an OpenShift 4.18 cluster fails with [OSError: PermissionError](libpython3.11.so.1.0: cannot open shared object file: No such file or directory).
I am using the helm chart with the following extra/k8s/inference-benchmarker/values.yaml:
...
model_id: "mistralai/Mistral-7B-Instruct-v0.3"
server: tgi
....
tgi:
enabled: true
I enabled my HF token to access the gated model 'mistralai/Mistral-7B-Instruct-v0.3'.
$ helm install inference-benchmarker ./extra/k8s/inference-benchmarker
NAME: inference-benchmarker
LAST DEPLOYED: Mon Jul 7 10:42:47 2025
NAMESPACE: blue
STATUS: deployed
REVISION: 1
TEST SUITE: None
This is the output of the OpenShift Pod "inference-benchmarker-799b8587-hdbfz" CrashLoopBackOff
unable to refresh ld cache, not a big deal in most cases
text-generation-launcher: error while loading shared libraries: libpython3.11.so.1.0: cannot open shared object file: No such file or directory