fine tuning whisper for translation task

[sutungpo]

huggingface has already fine tuning about whisper[https://huggingface.co/blog/fine-tune-whisper], but it's transcription task, anyone knows how to fine tune the translation task?

[Devansh-Shah11]

Replace task='transcribe' to task='translate'
As it only translates to English, we can remove the language parameter as well!

Hope it helps :)

[sutungpo]

no, I think it will not work, at least the evaluation metrics should be changed, anyone has the good experience for fine tuning translation task?

[Devansh-Shah11]

Yes correct,
also change the evaluation metrics to BLEU score
Reference: https://huggingface.co/spaces/evaluate-metric/bleu