Skip to content

Commit 4211c78

Browse files
committed
Update supported models
1 parent 9d186e3 commit 4211c78

File tree

3 files changed

+330
-79
lines changed

3 files changed

+330
-79
lines changed

README.md

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -58,9 +58,12 @@ const tools = [
5858
```
5959

6060
Sample of using tool calls with Web LLM.
61-
Now sample supports only Qwen2.5-* LLM models
61+
Now it works with next model:
62+
- Hermes-2-Pro-Llama-3-8B
63+
- Hermes-3-Llama-3.1-8B
64+
- Llama-3.1-8B-Instruct
65+
- Qwen2.5-7B-Instruct
6266

63-
Main testing was with `Qwen2.5-3B-Instruct-q4f16_1-MLC` https://huggingface.co/mlc-ai/Qwen2.5-3B-Instruct-q4f16_1-MLC
67+
Best results is with `Hermes-2-Pro-Llama-3-8B`
6468

65-
Use model `Qwen2.5-7B-Instruct-q4f32_1-MLC` for working with SPARQL queries.
6669

src/index.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,8 @@
2020
<div id="chat-box" class="chat-box"></div>
2121
<div style="display:flex; width:100%; min-height:40px; margin-top:10px">
2222
<span id="user-input" class="textarea" role="textbox" contenteditable placeholder="Type a message..."></span>
23-
<button id="send" style="width:100px; height:40px" disabled>Send</button>
23+
<button id="send" style="width:100px; height:40px; margin-right:5px" disabled>Send</button>
24+
<button id="stop" style="width:100px; height:40px" disabled>Stop</button>
2425
</div>
2526
<div id="chat-stats" class="chat-stats hidden"></div>
2627
</div>

0 commit comments

Comments
 (0)