v2.9/Researcher/cli-reference/runai-submit/

[giscus[bot]]

v2.9/Researcher/cli-reference/runai-submit/

| Description | | Synopsis | | Examples | | Options | Aliases and Shortcuts. Container Related. Resource Allocation. Storage. Network. Job Lifecycle. Access Control. Scheduling. Global Flags. | Output | | See Also |

https://docs.run.ai/v2.9/Researcher/cli-reference/runai-submit/

[nitzanfarhi]

Hello,

I am receiving the following error when running runai submit:

Internal error occurred: failed calling webhook "workload-controller.runai.svc": failed to call webhook: Post "https://workload-controller.runai.svc:443/validate-run-ai-v2alpha1-interactiveworkload?timeout=10s": context deadline exceeded

What can I do to submit the job?
The full command : runai submit --pvc=storage:/storage --interactive --attach -g 1 -i my_user/my_repo

[yarongol]

The error usually happens when there are connectivity problems between nodes. But may I suggest that you open a support ticket so that we can review the problem together? https://runai.my.salesforce-sites.com/casesupport/CreateCaseForm
Thanks

[doronkg]

Hi, we faced the same issue and resolved it by enlarging the default timeout in both interactive/training validating webhook configurations, using the following command:

kubectl patch validatingwebhookconfigurations.admissionregistration.k8s.io/runai-interactive-workload-validation -p '[{"op": "replace", "path": "/webhooks/0/timeoutSeconds", "value": 20}]' --type=json