Update example to not fail hessian inversion (#904)

* update

Signed-off-by: Dipika <[email protected]>

* quality

---------

Signed-off-by: Dipika <[email protected]>
Co-authored-by: Rahul Tuli <[email protected]>

Author: dsikka

examples/big_models_with_accelerate/multi_gpu_int8.py

@@ -59,7 +59,9 @@ def tokenize(sample):
 #   * quantize the weights to int8 with GPTQ (static per channel)
 #   * quantize the activations to int8 (dynamic per token)
 recipe = [
-    GPTQModifier(targets="Linear", scheme="W8A8", ignore=["lm_head"]),
+    GPTQModifier(
+        targets="Linear", scheme="W8A8", ignore=["lm_head"], dampening_frac=0.1
+    ),
 ]
 
 # 4) Apply algorithms and save in `compressed-tensors` format.