Eval custom open_clip architecture – Add model config

[samirchar]

What should be the appropriate way of adding a new model architecture without having to clone the repo? With open_clip we can write the model config json and add it using use add_model_config from open_clip.factory. However, doing this before runing the clip_benchmark cli has no effect, since this opens a new process that doesn't see the new architecture added.

Simlarly, what is the correct way of passing my architecture and my pretrained weights to the cli?