Support loading a model in a non-init-weights context#1105

bryant1410 wants to merge 5 commits intomlfoundations:mainmlfoundations/open_clip:mainfrom

bryant1410:patch-1bryant1410/open_clip:patch-1Copy head branch name to clipboard