PERF: fix performance regression from #62542 #52667

Job	Run time
Build sdist	-1s
Build wheel for ${{ matrix.python[0] }}-${{ matrix.buildplat[1] }}	0s
publish	0s
	-1s

Provide feedback