Skip to content

Commit 240eac1

Browse files
committed
polish: install instruction in example; import paths;
Signed-off-by: h-guo18 <[email protected]>
1 parent 3ca0ed7 commit 240eac1

File tree

2 files changed

+2
-5
lines changed

2 files changed

+2
-5
lines changed

examples/speculative_decoding/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ This example focuses on training with Hugging Face. To train with Megatron‑LM,
2828
Install Modelopt with `hf` dependencies and other requirements for this example:
2929

3030
```bash
31-
pip install nvidia-modelopt[hf]
31+
pip install -e ...
3232
pip install -r requirements.txt
3333
```
3434

modelopt/torch/export/unified_export_hf.py

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -27,10 +27,6 @@
2727
import torch
2828
import torch.nn as nn
2929

30-
from modelopt.torch.export.plugins import (
31-
rename_and_prune_if_spec_decoding,
32-
set_config_if_spec_decoding,
33-
)
3430
from modelopt.torch.quantization import set_quantizer_by_cfg_context
3531
from modelopt.torch.quantization.nn import SequentialQuantizer, TensorQuantizer
3632
from modelopt.torch.quantization.qtensor import NVFP4QTensor
@@ -57,6 +53,7 @@
5753
QUANTIZATION_W4A8_AWQ,
5854
QUANTIZATION_W4A8_NVFP4_FP8,
5955
)
56+
from .plugins import rename_and_prune_if_spec_decoding, set_config_if_spec_decoding
6057
from .quant_utils import (
6158
fuse_prequant_layernorm,
6259
get_activation_scaling_factor,

0 commit comments

Comments
 (0)