Skip to content

Commit 8291573

Browse files
Update README.md
1 parent a495196 commit 8291573

File tree

1 file changed

+5
-6
lines changed

1 file changed

+5
-6
lines changed

examples/simple-function-call/README.md

Lines changed: 5 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -52,8 +52,6 @@ The LLM has access to a single tool:
5252

5353
### Examples
5454

55-
56-
# List files in current directory
5755
```
5856
./simple-function-call -m llama-3.2-1b.gguf -p "list all files in this directory" # I've had success even with this small model but I think it has trouble solving complex tasks it can still generate proper JSON for execution
5957
@@ -127,7 +125,7 @@ Aborted (core dumped)
127125
# Check system information
128126

129127
```
130-
./simple-function-call -m llama-2-7b.gguf -p "check the current time" # might produce some JSON
128+
./simple-function-call -m llama-3.2-1b.gguf -p "check the current time" # might produce some JSON
131129
{
132130
"type": "function",
133131
"function": {
@@ -172,11 +170,12 @@ Response:
172170
},
173171
"parameters": { # Pay attention here
174172
"command": "date && echo Current date and time: $(date +'%Y-%m-%d %H:%M:%S')"
175-
} # The command in tried to use was probably too complex for the actual tool
176-
}
173+
} # The command it tried to use was probably too complex for the actual tool
174+
} # A better parser or an LLM would've done a better job
175+
177176
main: decoded 134 tokens in 5.85 s, speed: 22.89 t/s # A better parser bigger model should produce better results
178177
```
179-
# You'll have less of these types of problems with bigger models but you can't still nudge the smaller ones, if you have some knowledge you can always tell it to run commands directly but it defeats the purpose of it a bit, it would be good with some Speech to Text system where you wouldn't have to type but just say what you want the computer to do
178+
### You'll have less of these types of problems with bigger models but you can't still nudge the smaller ones, if you have some knowledge you can always tell it to run commands directly but it defeats the purpose of it a bit, it would be good with some Speech to Text system where you wouldn't have to type but just say what you want the computer to do
180179
```
181180
./simple-function-call -m llama-3.2-1b-instruct.gguf -p "Check the current date" # And it will run the date command
182181

0 commit comments

Comments
 (0)