@eightysteele @sritchie @mhuebert
Here is an issue for the topic we discussed today, regarding developing a short-term util to be able to run https://github.com/probcomp/b3d/blob/gen3d/src/b3d/chisight/gen3d/run_ycbv_evaluation.py in parallel across the cloud, with some way to parallelize across scene_id and OBJECT_INDEX, as well as launching different runs with different hyperparameters.
This script is currently used to compute metrics from the folder of inferred poses output by the previously linked evaluation script.