Skip to content

Commit 6fde8ec

Browse files
committed
fix: openai need streaming
1 parent 081fcab commit 6fde8ec

File tree

1 file changed

+1
-0
lines changed
  • apps/setting/models_provider/impl/openai_model_provider/model

1 file changed

+1
-0
lines changed

apps/setting/models_provider/impl/openai_model_provider/model/llm.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,7 @@ def new_instance(model_type, model_name, model_credential: Dict[str, object], **
3535
openai_api_base=model_credential.get('api_base'),
3636
openai_api_key=model_credential.get('api_key'),
3737
**optional_params,
38+
streaming=True,
3839
custom_get_token_ids=custom_get_token_ids
3940
)
4041
return azure_chat_open_ai

0 commit comments

Comments
 (0)