Ruff is running in many CI jobs

[mfisher87]

We run Ruff in pre-commit.ci, but also it turns out in many other CI jobs :)

I removed one extra run of Ruff in our CI last week or so: #567

But now reviewing #580 I see Ruff is running in our unit tests and integration tests. Ruff is relatively cheap and fast to run; are we using it to short-circuit running expensive tests?