Skip to content
Open
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 13 additions & 1 deletion docs/docker-model-runner.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,14 +18,26 @@ This page describes how to run OpenChat Playground (OCP) with [Docker Model Runn

## Run on local machine

1. Make sure the Docker Model Runner is up and running with the following command.
1. Make sure the Docker Model Runner is up and ready to accept requests with the following command.

```bash
docker model status
```

It should say `Docker Model Runner is running`.

```bash
curl http://localhost:12434
```

```powershell
Invoke-WebRequest http://localhost:12434
```

It should say `The Service is running`

> If it says `Connection refused`, turn on "Enable host-side TCP support" option in Docker Desktop Settings.

1. Download the model. The default model OCP uses is [ai/smollm2](https://hub.docker.com/r/ai/smollm2).

```bash
Expand Down