How to use specific folder for manually downloaded model

[Eng-AliKazemi]

Is it possible to use specific folder for models?

[Eng-AliKazemi]

By editing the code I could copy the huggingface folder to another folder and use it, but I like to use downloaded model bin files directly

if ".ggml" in model_basename:
    logging.info("Using Llamacpp for GGML quantized models")
    # Download the model to the my_models folder
    model_path = hf_hub_download(repo_id=model_id, filename=model_basename, cache_dir="./my_models")
    max_ctx_size = 2048
    kwargs = {
        "model_path": model_path,
        "n_ctx": max_ctx_size,
        "max_tokens": max_ctx_size,
    }