Skip to content

Commit e96e22a

Browse files
committed
Updated README for latest tiktoken
1 parent fabf8b6 commit e96e22a

File tree

1 file changed

+8
-1
lines changed

1 file changed

+8
-1
lines changed

README.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -128,6 +128,13 @@ cog.out("\n".join(output))
128128
]]] -->
129129
- `gpt-4` (`cl100k_base`)
130130
- `gpt-3.5-turbo` (`cl100k_base`)
131+
- `gpt-3.5` (`cl100k_base`)
132+
- `gpt-35-turbo` (`cl100k_base`)
133+
- `davinci-002` (`cl100k_base`)
134+
- `babbage-002` (`cl100k_base`)
135+
- `text-embedding-ada-002` (`cl100k_base`)
136+
- `text-embedding-3-small` (`cl100k_base`)
137+
- `text-embedding-3-large` (`cl100k_base`)
131138
- `text-davinci-003` (`p50k_base`)
132139
- `text-davinci-002` (`p50k_base`)
133140
- `text-davinci-001` (`r50k_base`)
@@ -146,7 +153,6 @@ cog.out("\n".join(output))
146153
- `cushman-codex` (`p50k_base`)
147154
- `text-davinci-edit-001` (`p50k_edit`)
148155
- `code-davinci-edit-001` (`p50k_edit`)
149-
- `text-embedding-ada-002` (`cl100k_base`)
150156
- `text-similarity-davinci-001` (`r50k_base`)
151157
- `text-similarity-curie-001` (`r50k_base`)
152158
- `text-similarity-babbage-001` (`r50k_base`)
@@ -158,6 +164,7 @@ cog.out("\n".join(output))
158164
- `code-search-babbage-code-001` (`r50k_base`)
159165
- `code-search-ada-code-001` (`r50k_base`)
160166
- `gpt2` (`gpt2`)
167+
- `gpt-2` (`gpt2`)
161168
<!-- [[[end]]] -->
162169

163170
## ttok --help

0 commit comments

Comments
 (0)