How to use rerank modes with Docker?

[shenhai-ran]

Hello, I have downloaded the cross-encoder model with Web UI, and I was trying to use it based on the doc.

here is the command:

curl -X 'POST' \
  'http://localhost:8080/v1/rerank' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "documents": [
   "Eco-friendly kitchenware for modern homes",
   "Biodegradable cleaning supplies for eco-conscious consumers",
   "Organic cotton baby clothes for sensitive skin",
   "Natural organic skincare range for sensitive skin",
   "Tech gadgets for smart homes: 2024 edition",
   "Sustainable gardening tools and compost solutions",
   "Sensitive skin-friendly facial cleansers and toners",
   "Organic food wraps and storage solutions",
   "All-natural pet food for dogs with allergies",
   "Yoga mats made from recycled materials"
  ],
  "model": "cross-encoder",
  "query": "Organic skincare products for sensitive skin",
  "top_n": 3
}'

And then I get error as :

{
  "error": {
    "code": 500,
    "message": "failed to load model with internal loader: could not load model (no success): Unexpected err=OSError(\"Incorrect path_or_model_id: ''. Please provide either the path to a local folder or the repo_id of a model on the Hub.\"), type(err)=<class 'OSError'>",
    "type": ""
  }
}

I am using Docker Image localai/localai:latest-gpu-nvidia-cuda-12

Thanks for your help