We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent ed13e4d commit 12bc21eCopy full SHA for 12bc21e
clients/python/llmengine/data_types.py
@@ -24,6 +24,7 @@ class LLMSource(str, Enum):
24
25
class Quantization(str, Enum):
26
BITSANDBYTES = "bitsandbytes"
27
+ AWQ = "awq"
28
29
30
class GpuType(str, Enum):
0 commit comments