Artifacts Not Working with gptPlugins or agents Endpoint

[ogipogi]

What happened?

We are experiencing an issue where artifacts are not functioning when using the gptPlugins endpoint. The same configuration works correctly with the azureOpenAI endpoint. We have custom plugins that users need to choose, and we would like to add artifacts support for the gptPlugins endpoint.

Steps to Reproduce

Configuration that work:
librechat.yaml

  gptPlugins:
    titleConvo: true
    titleModel: "gpt-4o"
    plugins: true
    tools: ["CustomXY", "dalle"]
    groups:
      - group: "XY"
        apiKey: "XY"
        instanceName: "XY"
        models:
          gpt-4o:
            deploymentName: "XY"
            version: "2024-02-15-preview"
  azureOpenAI:
    titleConvo: true
    titleModel: "gpt-4o"
    plugins: true
    groups:
      - group: "XY"
        apiKey: "XY"
        instanceName: "XY"
        models:
          gpt-4o:
            deploymentName: "XY"
            version: "2024-02-15-preview"
modelSpecs:
  enforce: false
  prioritize: true
  list:
    - name: "adc-default-specs"
      label: "GPT-4o"
      description: "XY"
      iconURL: "XY"
      preset:
        default: false
        endpoint: "azureOpenAI" # Artifacts works with this endpoint
        #endpoint: "gptPlugins" # Artifacts don't work with this endpoint
        plugins: true
        model: "gpt-4o"

Configuration that don't work:
librechat.yaml

  gptPlugins:
    titleConvo: true
    titleModel: "gpt-4o"
    plugins: true
    tools: ["CustomXY", "dalle"]
    groups:
      - group: "XY"
        apiKey: "XY"
        instanceName: "XY"
        models:
          gpt-4o:
            deploymentName: "XY"
            version: "2024-02-15-preview"
  azureOpenAI:
    titleConvo: true
    titleModel: "gpt-4o"
    plugins: true
    groups:
      - group: "XY"
        apiKey: "XY"
        instanceName: "XY"
        models:
          gpt-4o:
            deploymentName: "XY"
            version: "2024-02-15-preview"
modelSpecs:
  enforce: false
  prioritize: true
  list:
    - name: "adc-default-specs"
      label: "GPT-4o"
      description: "XY"
      iconURL: "XY"
      preset:
        default: false
        #endpoint: "azureOpenAI" # Artifacts works with this endpoint
        endpoint: "gptPlugins" # Artifacts don't work with this endpoint
        plugins: true
        model: "gpt-4o"

What browsers are you seeing the problem on?

Chrome

Relevant log output

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

Thanks for your report. It won't be supported. Plugins are deprecated soon in favor of a better system, which will also incorporate artifacts: #3607

[ogipogi]

Ok, i think i figured it out - with using agent_id in the preset.

[ogipogi]

The Artifacts feature is not yet working with the new Agent System. @danny-avila, can you confirm this? Or am I doing something wrong?

[ogipogi]

I updated the title by adding also the agents endpoint.

[danny-avila]

Agents are not officially released yet, I've marked the current usage as experimental.

[ogipogi]

Thanks for your response @danny-avila . We have switched to the agent's system because we need to use our custom plugins, as the plugin system will be soon deprecated.