add test for parralelism #1432
Description
add short test on fix data that parallelism yield the same loss in with all of our parralelism techniques
{{ message }}
add short test on fix data that parallelism yield the same loss in with all of our parralelism techniques