Loading the model that is downloaded locally on my PC in the run_localGPT_API.py

[Loves4]

i want to use the downloaded model that i have downloaded from huggingface instead of it downloading when i run the run_localGPT_API.py, i request the community for help

[bondocai]

I was able to use a downloaded model on Windows11 by placing the model in this location and adjusting the card name:
"C:\Users\yourusername.cache\huggingface\hub\models--TheBloke--Llama-2-7b-Chat-GPTQ"
Note the naming conventions uses double dashes vs space or slashes. You will also find other models as well in the \hub folder- however, you will have to download the models and replace missing files as needed.

[bondocai]

for some reason the backslash dissapears before .cache...

[abcnow]

how about if you are doing this on Mac? Any idea?

[bondocai]

believe this is the location:
~/.cache/huggingface/hub

[bondocai]

also found this site quite useful on how to install huggingface on a Mac:
https://github.com/domschl/HuggingFaceGuidedTourForMac