Fix querier panics (#4790) (#4901)

* fix forIngesterRings

Signed-off-by: Joe Elliott <number101010@gmail.com>

* fix generators

Signed-off-by: Joe Elliott <number101010@gmail.com>

* refactor to pass the funcs in directly

Signed-off-by: Joe Elliott <number101010@gmail.com>

* fix breaks

Signed-off-by: Joe Elliott <number101010@gmail.com>

* improve error

Signed-off-by: Joe Elliott <number101010@gmail.com>

* got rid of metrics collector

Signed-off-by: Joe Elliott <number101010@gmail.com>

* chagnelog

Signed-off-by: Joe Elliott <number101010@gmail.com>

* fix found behavior

Signed-off-by: Joe Elliott <number101010@gmail.com>

---------

Signed-off-by: Joe Elliott <number101010@gmail.com>
(cherry picked from commit 6d70705)

Author: joe-elliott