We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent aba59b2 commit f2a9815Copy full SHA for f2a9815
onnx_diagnostic/helpers/rt_helper.py
@@ -182,7 +182,10 @@ def onnx_generate(
182
:param input_ids: input tokens
183
:param eos_token_ids: token representing the end of an answer
184
:param max_new_tokens: stops after this number of generated tokens
185
- :param
+ :param return_session: returns the instance of class
186
+ :class:`InferenceSessionForTorch
187
+ <onnx_diagnostic.helpers.ort_session.InferenceSessionForTorch>`
188
+ created if necessary
189
:return: input tokens concatenated with new tokens
190
"""
191
if not isinstance(model_or_path, InferenceSessionForTorch):
0 commit comments