You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add optional use_effective_order parameter to BLEU score (#1862)
The original BLEU score fails for answers shorter than four tokens
because the number of 4-grams is zero. Adding the use_effective_order
parameter allows users to obtain scores by considering only n-grams up
to the number of tokens in the answer when ( N < 4 ). This feature is
already implemented in sacreBLEU, so we only need to add the parameter
to the BLEU object in ragas. The default is set to False to maintain
previous behavior.
---------
Co-authored-by: Shahules786 <[email protected]>
0 commit comments