Commit 4c093b5
committed
Add support for fine-tuned models in encoding_for_model
Identify models that can be fine-tuned in encoding_for_model.
- See https://platform.openai.com/docs/models/model-endpoint-compatibility
- See https://github.com/openai/openai-cookbook/blob/main/examples/How_to_count_tokens_with_tiktoken.ipynb1 parent 095924e commit 4c093b5
1 file changed
+5
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
11 | 16 | | |
12 | 17 | | |
13 | 18 | | |
| |||
0 commit comments