Clean up scipy specific things #36

Job	Run time
Build sdist	58s
Repackage licenses in sdist for binary distribution	11s
Build wheels on ubuntu-24.04-arm for aarch64	7m 48s
Build wheels on windows-11-arm for ARM64	12m 6s
Build wheels on windows-latest for AMD64	16m 54s
Build wheels on ubuntu-latest for x86_64	24m 30s
Build wheels on macos-15-intel for x86_64	20m 9s
Build wheels on macos-14 for arm64	8m 44s
Publish release to TestPyPI	0s
Publish release to PyPI	0s
Ensure commit is tag before upload to PyPi	0s
	1h 31m 20s

Provide feedback