Truncating TI embeddings #6849
guaneec
started this conversation in
Show and tell
Truncating TI embeddings
#6849
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I had a hypothesis that with wide TI embeddings, only a small part of it recognized by the model. To test this, I made modified copies of an embedding I made that imitates Twitter user kaamin's art style. Here,
kmn-xis an embedding the only keeps the firstxtokens of the original 16-wide embedding. Here are some results:Beta Was this translation helpful? Give feedback.
All reactions