Skip to content
This repository was archived by the owner on Sep 10, 2025. It is now read-only.

Commit 78aa666

Browse files
authored
Use SingleGPUGenerator instead of Generator in openai_api.py
1 parent 2e08c8f commit 78aa666

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

torchchat/usages/openai_api.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -267,7 +267,7 @@ class CompletionResponseChunk:
267267
usage: Optional[UsageStats] = None
268268

269269

270-
class OpenAiApiGenerator(Generator):
270+
class OpenAiApiGenerator(SingleGPUGenerator):
271271
"""A wrapper over the Generator class to interface with the OpenAI API.
272272
273273
Implements endpoints for completion requests, both chunked and non-chunked using the dataclasses

0 commit comments

Comments
 (0)