FEATURE: configure a default LLM model for all features

[keegangeorge]

🔍 Overview

This update adds a setting to the configure a default LLM model to be used for all features (unless overridden) and removes the custom: prefix when defining LLM models

➕ More information

For all features, the feature's assigned AI Persona's default_llm_id will be used, however, if it doesn't exist, the SiteSetting.ai_default_llm_model will be used instead.

This update also adds a few migrations which migrates the old model settings for Helper and Summarization into their respective personas. That is:

• SiteSetting.ai_helper_model's existing value on sites will be copied into:

  AiPersona.where(id: [-18, -19, -20, -21, -22, -23, -24, -25, -26]).default_llm_id

• SiteSetting.ai_summarization_model's existing value on sites will be copied into

  AiPersona.where(id: [-11, -12]).default_llm_id

Eventually, we will follow-up in a separate commit to remove the following settings:

SiteSetting.ai_helper_model
SiteSetting.ai_helper_image_caption_model
SiteSetting.ai_summarization_model
SiteSetting.ai_embeddings_semantic_search_hyde_model

By default SiteSetting.ai_default_llm_model will have default: "" in it's yaml file, however, this update also adds a migration which will ensure that the last created LLM model is used to fill the setting.

📸 Screenshots

[romanrizzi]

Should we do ai_translation_model too?

[romanrizzi]

Need to check if the persona has an LLM set

[keegangeorge]

which one 😅

  ai_translation_locale_detector_persona:
    default: "-27"
    type: enum
    enum: "DiscourseAi::Configuration::PersonaEnumerator"
    area: "ai-features/translation"
  ai_translation_post_raw_translator_persona:
    default: "-28"
    type: enum
    enum: "DiscourseAi::Configuration::PersonaEnumerator"
    area: "ai-features/translation"
  ai_translation_topic_title_translator_persona:
    default: "-29"
    type: enum
    enum: "DiscourseAi::Configuration::PersonaEnumerator"
    area: "ai-features/translation"
  ai_translation_short_text_translator_persona:
    default: "-30"
    type: enum
    enum: "DiscourseAi::Configuration::PersonaEnumerator"
    area: "ai-features/translation"

I suppose all of them must have a default_llm_id OR SiteSetting.ai_default_llm_model needs to be present?

[davidtaylorhq]

Plugin moving to core. This will need to be re-opened against discourse/discourse. Sorry @keegangeorge