Skip to content

Commit 6803d1e

Browse files
aleksandr-mokrovmvafin
authored andcommitted
[OpenVINO] Handle deprecation of forced_decoder_ids in transformers generation_config (#1402)
* Handle deprecation of forced_decoder_ids * Fix typo * Fix formatting * Fix formatting * Handle the case where the generation config was saved with a forced_decoder_ids * Remove deleting forced_decoder_ids for transfromers >= 4.53.0
1 parent f870a3e commit 6803d1e

File tree

1 file changed

+10
-5
lines changed

1 file changed

+10
-5
lines changed

optimum/intel/openvino/modeling_seq2seq.py

Lines changed: 10 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1463,11 +1463,16 @@ def prepare_inputs_for_generation(
14631463
}
14641464

14651465
def _get_logits_processor(self, generation_config: GenerationConfig, *args, **kwargs):
1466-
forced_decoder_ids = generation_config.forced_decoder_ids
14671466
# Whisper uses forced_decoder_ids for default task and language specification, while original _get_logits_processor does not allow it
14681467
# see for details https://github.com/huggingface/transformers/issues/37172
1469-
if is_transformers_version(">=", "4.50.0"):
1470-
generation_config.forced_decoder_ids = None
1471-
logits_processor = super()._get_logits_processor(generation_config, *args, **kwargs)
1472-
generation_config.forced_decoder_ids = forced_decoder_ids
1468+
if not hasattr(generation_config, "forced_decoder_ids") or is_transformers_version(">=", "4.53.0"):
1469+
# since transformers 4.53.0, forced_decoder_ids is deprecated: https://github.com/huggingface/transformers/pull/38232
1470+
logits_processor = super()._get_logits_processor(generation_config, *args, **kwargs)
1471+
else:
1472+
forced_decoder_ids = generation_config.forced_decoder_ids
1473+
1474+
if is_transformers_version(">=", "4.50.0"):
1475+
generation_config.forced_decoder_ids = None
1476+
logits_processor = super()._get_logits_processor(generation_config, *args, **kwargs)
1477+
generation_config.forced_decoder_ids = forced_decoder_ids
14731478
return logits_processor

0 commit comments

Comments
 (0)