Skip to content

Commit 6304ecf

Browse files
kylesayrsdsikka
andauthored
[Transform] Fix QuIP targets (#1770)
## Purpose ## * Fix QuIP transform targets ## Testing ## * Used `test_correctness.py` test and validated that previously, the loss was zero, but now that the targets are correct, the loss matches what was previously measured * https://huggingface.co/nm-testing/Llama-3.1-8B-Instruct-quip-w4a16/tree/main/ * TODO: will do basic lm_eval, but good to land now Signed-off-by: Kyle Sayers <[email protected]> Co-authored-by: Dipika Sikka <[email protected]>
1 parent d497b5a commit 6304ecf

File tree

1 file changed

+1
-1
lines changed
  • src/llmcompressor/modifiers/transform/quip

1 file changed

+1
-1
lines changed

src/llmcompressor/modifiers/transform/quip/base.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,7 @@ class QuIPModifier(Modifier):
6161
transform_type: Literal["hadamard", "random-hadamard", "random-matrix"] = Field(
6262
default="random-hadamard"
6363
)
64-
targets: Union[List[str], str] = Field(default="str")
64+
targets: Union[List[str], str] = Field(default="Linear")
6565
randomize: bool = Field(default=False)
6666
learnable: bool = Field(default=False)
6767
precision: TorchDtype = Field(default=torch.float64)

0 commit comments

Comments
 (0)