A bit confused about limits of the context window #7912
Unanswered
jchudzynski
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I have a txt file with dates and events. It's rather longer, 6,717 tokens to be exact long.
Since it's a bit bigger file I decided to add it to a vector database to better deal with the context limits. In the example below I load it from just a variable, but I was getting the same results reading it from a txt or a json file
This request results in a following error:
I am bit confused why. I thought the vector databased prevent this issue.
Should I chunk the data differently? Use a different prompt?
Thank you for help :)
Beta Was this translation helpful? Give feedback.
All reactions