-
Notifications
You must be signed in to change notification settings - Fork 334
Description
Describe the bug
It is a follow up ticket for #891. After using git's main branch, I can insert log() in openai_compatible_providers_load_cache() where I can confirm openai_client() can load and add models thru featherless's API. However, I still cannot see featherless nor custom provider in model's page and custom model's page.
Checks
- [Y] I've read the troubleshooting guide
- [n/a] I've tried to reproduce the problem using another model, and confirmed it's not an issue specific to the model I've chosen.
- [Y] I've searched the docs for a solution
- [Y] I've searched for existing Github issues/discussions
To Reproduce
Steps to reproduce the behavior:
- Go to http://localhost:8757/models
- Can't see featherless nor custom provider nor openai_compatible_providers in provider dropbox
- filter by GLM
- Can't see featherless nor custom provider nor openai_compatible_providers in any model cards
- Go to http://localhost:8757/settings/providers/add_models
- Click on Add Model btn
- Scroll down to Model Provider dropbox
- Only see empty list in dropbox
Screenshots
Error Logs
Please include the logs if the issue shows an error. State that no error is shown if there is no error.
https://app.gitbook.com/o/63UPvNXRQ4QyV9E5eioW/s/EJ4b8A4QiEQlOGbYkXDX/docs/troubleshooting-and-logs
System Information:
- OS: ubuntu 22.04
- Browser brave
- Kiln app Version git's main branch (de9855d)
Additional context
In https://github.com/Kiln-AI/Kiln/blob/main/app/desktop/studio_server/provider_api.py#L243, key_providers and models are empty, but in https://github.com/Kiln-AI/Kiln/blob/main/app/desktop/studio_server/provider_api.py#L307, I can see models are being loaded by openai_compatible_providers() by logger there.
We can use open AI's cred to test openai_compatible_providers flow even if dev doesn't have featherless's cred, right?
I don't mind to add custom model manually if that's too much trouble, but I cannot even select my custom provider in add custom model page.