[Question]: Unbale to connect to Portkey

[s-sajid-ali]

What is your question?

Using the same configuration as mentioned in both the LibreChat/Portkey docs, we're unable to see PortKey as a provider in librechat.

The Librechat-API container logs show:

2024-11-13 21:16:21 info: Connected to MongoDB
2024-11-13 21:16:21 info: Custom config file loaded:
2024-11-13 21:16:21 info: {
  "version": "1.1.7",
  "cache": true,
  "endpoints": {
    "custom": [
      {
        "name": "Portkey",
        "apikey": "dummy",
        "baseURL": "https://api.portkey.ai/v1",
        "headers": {
          "x-portkey-api-key": "...",
          "x-portkey-virtual-key": "..."
        },
        "models": {
          "default": [
            "gemini-1.5-pro"
          ],
          "fetch": true
        },
        "titleConvo": true,
        "titleModel": "current_model",
        "summarize": false,
        "summaryModel": "current_model",
        "forcePrompt": false,
        "modelDisplayLabel": "Portkey:OpenAI"
      }
    ]
  }
}
2024-11-13 21:16:21 info: [deleteNullOrEmptyConversations] Deleted 0 conversations and 0 messages
2024-11-13 21:16:21 info: RAG API is running and reachable at http://rag_api:8000.
2024-11-13 21:16:21 info: No changes needed for 'USER' role permissions
2024-11-13 21:16:21 info: No changes needed for 'ADMIN' role permissions

More Details

The command used to start the deployment is:

sudo /usr/local/bin/docker-compose -f ./deploy-compose.yml -f ./deploy-compose.override.yml up -d

The contents of deploy-compose.override.yml are as follows:

ss19980_nyu_edu@librechatdemo ~/LibreChat (main)> bat deploy-compose.override.yml
───────┬────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
       │ File: deploy-compose.override.yml
───────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
   1   │ services:
   2   │   api:
   3   │     volumes:
   4   │     - type: bind
   5   │       source: ./librechat.yaml
   6   │       target: /app/librechat.yaml
   7   │ 
───────┴────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
ss19980_nyu_edu@librechatdemo ~/LibreChat (main)> 

The contents of librechat.yaml are as follows:

ss19980_nyu_edu@librechatdemo ~/LibreChat (main)> bat librechat.yaml
───────┬────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
       │ File: librechat.yaml
───────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
   1   │ version: 1.1.7
   2   │ cache: false
   3   │ endpoints:
   4   │   custom:
   5   │     - name: "Portkey"
   6   │       apikey: "dummy"
   7   │       baseURL: https://api.portkey.ai/v1
   8   │       headers:
   9   │         x-portkey-api-key: "..."
  10   │         x-portkey-virtual-key: "..."
  11   │       models:
  12   │         default: ["gemini-1.5-pro"]
  13   │         fetch: true
  14   │       titleConvo: true
  15   │       titleModel: "current_model"
  16   │       summarize: false
  17   │       summaryModel: "current_model"
  18   │       forcePrompt: false
  19   │       modelDisplayLabel: "Portkey:OpenAI"
  20   │ 
───────┴────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
ss19980_nyu_edu@librechatdemo ~/LibreChat (main)> 

What is the main subject of your question?

Endpoints

Screenshots

List of providers on LibreChat:

Code of Conduct

• I agree to follow this project's Code of Conduct

[s-sajid-ali]

Will be by LibreChat-AI/librechat.ai#167