Skip to content

[Bug] fail to choose model for custom providerΒ #905

@grapemix

Description

@grapemix

Describe the bug
It is a follow up ticket for #891. After using git's main branch, I can insert log() in openai_compatible_providers_load_cache() where I can confirm openai_client() can load and add models thru featherless's API. However, I still cannot see featherless nor custom provider in model's page and custom model's page.

Checks

  • [Y] I've read the troubleshooting guide
  • [n/a] I've tried to reproduce the problem using another model, and confirmed it's not an issue specific to the model I've chosen.
  • [Y] I've searched the docs for a solution
  • [Y] I've searched for existing Github issues/discussions

To Reproduce
Steps to reproduce the behavior:

  1. Go to http://localhost:8757/models
  2. Can't see featherless nor custom provider nor openai_compatible_providers in provider dropbox
  3. filter by GLM
  4. Can't see featherless nor custom provider nor openai_compatible_providers in any model cards
  5. Go to http://localhost:8757/settings/providers/add_models
  6. Click on Add Model btn
  7. Scroll down to Model Provider dropbox
  8. Only see empty list in dropbox
    Screenshots
Image

Error Logs
Please include the logs if the issue shows an error. State that no error is shown if there is no error.

https://app.gitbook.com/o/63UPvNXRQ4QyV9E5eioW/s/EJ4b8A4QiEQlOGbYkXDX/docs/troubleshooting-and-logs

System Information:

  • OS: ubuntu 22.04
  • Browser brave
  • Kiln app Version git's main branch (de9855d)

Additional context
In https://github.com/Kiln-AI/Kiln/blob/main/app/desktop/studio_server/provider_api.py#L243, key_providers and models are empty, but in https://github.com/Kiln-AI/Kiln/blob/main/app/desktop/studio_server/provider_api.py#L307, I can see models are being loaded by openai_compatible_providers() by logger there.

We can use open AI's cred to test openai_compatible_providers flow even if dev doesn't have featherless's cred, right?

I don't mind to add custom model manually if that's too much trouble, but I cannot even select my custom provider in add custom model page.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions