Backport PR #61933 on branch 2.3.x (unpin scipy since statsmodels was… #50072

Job	Run time
Test install requirements-dev.txt	1m 53s
Build Docker Dev Environment	2m 44s
ASV Benchmarks	20m 23s
Docstring validation, typing, and other manual pre-commit hooks	28m 35s
	53m 35s

Provide feedback