performance: Use push_unchecked when building indices for element take in fixedsizedlist take #23161

Job	Run time
Python (wheel build)	2m 28s
Rust (docs)	3m 8s
lint-toml	9s
Python (lint)	1m 27s
License Check and Audit Check (advisories)	51s
Rust build (all-features)	6m 39s
Rust tests (linux-arm64)	4m 10s
wasm-integration	2m 48s
Check generated source files are up to date	3m 40s
Rust tests (coverage) (tests)	6m 8s
Java	3m 28s
Python (test)	3m 27s
Rust build (default features)	6m 41s
Rust (semver checks)	6m 2s
Rust (lint)	3m 32s
Benchmark with Codspeed (Shard #3)	3m 55s
Rust build (with tokio dispatcher)	2m 17s
License Check and Audit Check (bans licenses sources)	51s
Rust build (wasm32 with default features)	3m 1s
Benchmark with Codspeed (Shard #6)	2m 22s
Rust tests (miri)	3m 30s
Rust tests (sanitizer)	3m 5s
Benchmark with Codspeed (Shard #4)	1m 58s
Rust tests (windows-x64)	9m 1s
Benchmark with Codspeed (Shard #7)	1m 43s
Rust (lint, no default)	3m 36s
CUDA tests	3m 26s
Benchmark with Codspeed (Shard #2)	4m 53s
Benchmark with Codspeed (Shard #1)	1m 4s
C++ build	4m 13s
Benchmark with Codspeed (Shard #5)	3m 15s
Benchmark with Codspeed (Shard #8)	1m 56s
validate-workflow-yaml	6s
Check build with minimal dependencies	2m 42s
	1h 51m 32s

Provide feedback