See my comments at https://github.com/JuliaAI/CatBoost.jl/pull/42 Possibly the fix should be at MLJTestInterface.jl