Health check

Health check

Overview

Health check for the models is added. It works with llama.cpp server or other servers, which supports endpoint/health REST service. When the health check is enabled, the current state of the selected model is visible in the environment view. The health check is done every 30 seconds (could be changed from setting Health_check_interval_s). It could be triggered also manually by the user by clicking the appropriate button in the environment view (after the selected model name).

How to use it

1. Enable health check in settings for the appropriate model (e.g. for completion Health_check_compl_enabled)
2. Open environment view and select the completion model (for example)
3. The health check will be monitored periodically and the status will be displayed in the environment view
4. Optionally, the health check can be triggered manually by clicking the appropriate button

Settings:

• Health_check_interval_s: The interval in seconds for the health check
• Health_check_compl_enabled: Enable/disable health check for completion model
• Health_check_chat_enabled: Enable/disable health check for chat model
• Health_check_embs_enabled: Enable/disable health check for embedding model
• Health_check_tools_enabled: Enable/disable health check for tools model