fix quant (#1573)

Author: Jintao-Huang

docs/source/LLM/命令行参数.md

@@ -392,15 +392,15 @@ app-ui参数继承了infer参数, 除此之外增加了以下参数:
 
 deploy参数继承了infer参数, 除此之外增加了以下参数:
 
-- `--host`: 默认为`'127.0.0.1`.
+- `--host`: 默认为`'127.0.0.1`. 要使其在非本机上可访问, 可设置为'0.0.0.0'.
 - `--port`: 默认为`8000`.
 - `--api_key`: 默认为`None`, 即不对请求进行api_key验证.
 - `--ssl_keyfile`: 默认为`None`.
 - `--ssl_certfile`: 默认为`None`.
 
 ## web-ui 参数
 
-- `--host`: 默认为`'127.0.0.1'`.
+- `--host`: 默认为`'127.0.0.1'`. 要使其在非本机上可访问, 可设置为'0.0.0.0'.
 - `--port`: 默认为`None`.
 - `--lang`: 默认为`'zh'`.
 - `--share`: 默认为`False`.

docs/source_en/LLM/Command-line-parameters.md

@@ -393,15 +393,15 @@ app-ui parameters inherit from infer parameters, with the following added parame
 
 deploy parameters inherit from infer parameters, with the following added parameters:
 
-- `--host`: Default is `'127.0.0.1`.
+- `--host`: Default is `'127.0.0.1`. To make it accessible on the local network, you can set it to '0.0.0.0'.
 - `--port`: Default is `8000`.
 - `--api_key`: The default is `None`, meaning that the request will not be subjected to api_key verification.
 - `--ssl_keyfile`: Default is `None`.
 - `--ssl_certfile`: Default is `None`.
 
 ## web-ui Parameters
 
-- `--host`: Default `'127.0.0.1'`.
+- `--host`: Default `'127.0.0.1'`. To make it accessible on the local network, you can set it to '0.0.0.0'.
 - `--port`: Default `None`.
 - `--lang`: Default `'zh'`.
 - `--share`: Default `False`.

swift/llm/export.py

@@ -119,6 +119,7 @@ def _module_forward(self, x: torch.Tensor, module: torch.nn.Module, module_kwarg
 
         return module_output
 
+    import awq
     from awq.quantize import quantizer
     from transformers import AwqConfig
     if version.parse(awq.__version__) >= version.parse('0.2.6'):