Missing Prior Model File and Transfer Learning Setup in REINVENT4

[bishalbudha]

When running transfer learning in REINVENT4 on Google Colab, the process fails with:

RuntimeError: model file /content/REINVENT4/priors/reinvent.prior is not accessible

It seems that the repository does not include the required reinvent.prior file, but the provided TOML configuration still points to it under priors/. Could you clarify where this prior model file should be obtained, or whether an officially provided checkpoint is available?

Additionally, what edits should be made in the default transfer learning TOML/config setup to make it run successfully if the prior is not bundled? For example, should we replace input_model_file = "priors/reinvent.prior" with another pretrained checkpoint or path? Guidance on how to adapt the configuration for a working run would be very helpful.

[halx]

You will need to adjust the path to the actual location of the prior file. The file is in the repository.

[bishalbudha]

Priors aren't in the repository. In the announcement of the latest edition, you have mentioned moving it to Zenodo. I get confused whether we should download it from there or should there be any ideas or links to get access directly?

[halx]

I do not know how to upload data to Colab. That is really not a REINVENT question.

The priors are still in the repository because a git repository is designed such that it keeps all the history (it requires special tools to really delete data).

[bishalbudha]

I couldn't find where it used to be. Also further, I searched for whole of Repo and couldn't find it. Please help me sir.

[halx]

You would need to check out a revision where the file was still in the working tree. You may be able to do that directly in your Colab notebook. E.g.

git checkout b441244 priors/reinvent.prior

[bishalbudha]

Thanks a lot @halx — the ideas you suggested are working 🙏.

As an alternative, we also noticed the prior can be retrieved directly from Zenodo into the priors/ folder, e.g.:

! ZENODO_URL="https://zenodo.org/records/15641297/files/reinvent.prior?download=1"
! wget -O /content/REINVENT4/priors/reinvent. Prior "$ZENODO_URL"

Would the checkpoint obtained from Zenodo be identical to the one we recover from the repository history (e.g. commit b441244), or are there any differences in training or compatibility between the two sources?

[halx]

Yes, they are the same.