[Bug]: Inference tensors do not track version counter

[wenhuach21]

Problem Description

python3 -m auto_round /models/opt-125m --group_size 32 --data_type mx_fp4 --act_data_type mx_fp4 --format fake --tasks lambada_openai --iters 0  --disable_opt_rtn

File "/home/wenhuach/miniforge3/envs/autoround/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "/home/wenhuach/miniforge3/envs/autoround/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl
return forward_call(*args, **kwargs)
File "/home/wenhuach/miniforge3/envs/autoround/lib/python3.13/site-packages/transformers/models/opt/modeling_opt.py", line 150, in forward
query_states = self.q_proj(hidden_states) * self.scaling
~~~~~~~~~~~^^^^^^^^^^^^^^^
File "/home/wenhuach/miniforge3/envs/autoround/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1776, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "/home/wenhuach/miniforge3/envs/autoround/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1787, in _call_impl
return forward_call(*args, **kwargs)
File "/home/wenhuach/auto-round/auto_round/wrapper.py", line 528, in forward
return self.orig_layer.forward(x)
~~~~~~~~~~~~~~~~~~~~~~~^^^
File "/home/wenhuach/miniforge3/envs/autoround/lib/python3.13/site-packages/torch/nn/modules/linear.py", line 134, in forward
return F.linear(input, self.weight, self.bias)
~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: Inference tensors do not track version counter.

Reproduction Steps

~

Environment Information

~

Error Logs

Additional Context

No response

[wenhuach21]

#1622