Using a non-public Azure model

[stefanlundchristensen]

Hi team,

I have access to a private Azure instance where there is a nice model. Would it be possible to drop this into this plug-in and if so - how?

Cheers,
Stefan

[logancyang]

Hi @stefanlundchristensen, you can use your Azure credentials in Copilot settings, make sure your credentials are correct and test it using curl first

Test with something like (the exact format might be different)

curl https://<your-instance>.openai.azure.com/openai/deployments/<your-deployment>/completions\?api-version\=<your-api-version>\
  -H "Content-Type: application/json" \
  -H "api-key: <your-api-key>" \
  -d "{
  \"prompt\": \"Once upon a time\",
  \"max_tokens\": 5
}"

I did not get the parameters right on the first try and asked for Azure support, they are quite responsive and helpful.

[stefanlundchristensen]

Perfect thanks! I have something that is working now. Do get an error like below but seems to be working anyway

LangChain error: TypeError: Cannot read properties of undefined (reading 'text')

[logancyang]

@stefanlundchristensen try putting some random string in OpenAI API key? This should be a known issue and will be fixed soon, sorry about that