You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-foundry/foundry-local/how-to/how-to-chat-application-with-open-web-ui.md
+12-13Lines changed: 12 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -31,28 +31,27 @@ Before you start this tutorial, you need:
31
31
32
32
1.**Install Open Web UI** by following the instructions from the [Open Web UI GitHub repository](https://github.com/open-webui/open-webui).
33
33
34
-
2.**Launch Open Web UI** with this command in your terminal:
34
+
1.**Launch Open Web UI** with this command in your terminal:
35
35
36
36
```bash
37
37
open-webui serve
38
38
```
39
39
40
-
3. Open your web browser and go to [http://localhost:8080](http://localhost:8080).
40
+
1. Open your web browser and go to [http://localhost:8080](http://localhost:8080).
41
41
42
-
4.**Connect Open Web UI to Foundry Local**:
42
+
1.**Connect Open Web UI to Foundry Local**:
43
43
44
44
1. Select **Settings** in the navigation menu
45
-
2. Select **Connections**
46
-
3. Select **Manage Direct Connections**
47
-
4. Select the **+** icon to add a connection
48
-
5. For the **URL**, enter `http://localhost:PORT/v1` where `PORT` is replaced with the port of the Foundry Local endpoint, which you can find using the CLI command `foundry service status`. Note, that Foundry Local dynamically assigns a port, so it's not always the same.
49
-
6. Type any value (like `test`) for the API Key, since it can't be empty.
50
-
7. Save your connection
51
-
52
-
5.**Start chatting with your model**:
45
+
1. Select **External Tools** or **Connections** (depending on your Open WebUI version).
46
+
1. Select **+** by **Manage Tool Servers**.
47
+
1. For the **Base URL (or URL)**, enter `http://localhost:PORT/v1` where `PORT` is the Foundry Local endpoint port (use the CLI command `foundry service status` to find it). Note that Foundry Local dynamically assigns a port, so it isn't always the same.
48
+
1. Enter any non-empty value for the **API key** (for example, `test`)
49
+
1. Select **Save**
50
+
51
+
1.**Start chatting with your model**:
53
52
1. Your loaded models appear in the dropdown at the top
54
-
2. Select any model from the list
55
-
3. Type your message in the input box at the bottom
53
+
1. Select any model from the list
54
+
1. Type your message in the input box at the bottom
56
55
57
56
That's it! You're now chatting with an AI model running entirely on your local device.
0 commit comments