Add token count to --list-chats #314
Remowylliams
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi I've run into a few situations where I'm using chatGPT-3.5 and I'd get a failure and it appears that it's because I've exceeded the 4k context size.
When I changed to using the chatGPT-3.5-16k
The problem went away and that is how I came to believe it was just sending too much session data.
Would it be difficult to add a token count to each session in the --list-chats output and does it make sense to do so?
If I'm wrong about the reason I can try to provide more debug info.
I'm using this on a 22.04 Linux system.
Thanks for making this tool. It's been great when I need a quick lookup with some intelligence behind it.
Beta Was this translation helpful? Give feedback.
All reactions