Better downgrade CI #520

Job	Run time
test (1.10, macos-latest, adjoint)	4m 20s
test (1, ubuntu-latest, alloc_check)	9m 53s
test (1, ubuntu-latest, adjoint)	13m 45s
test (1.10, macos-latest, alloc_check)	3m 13s
test (1.10, ubuntu-latest, adjoint)	5m 44s
test (1.10, ubuntu-latest, core)	15m 4s
test (1, macos-latest, alloc_check)	7m 17s
test (1, macos-latest, core)	16m 27s
test (1, ubuntu-latest, core)	19m 57s
test (1.10, ubuntu-latest, alloc_check)	2m 32s
test (1.10, macos-latest, core)	11m 31s
test (1, macos-latest, adjoint)	8m 33s
	1h 58m 16s

Provide feedback