Reset kvCacheLength on #clearKVCache (#85)

DustinBrett · web-flow · commit a0b808bd3091 · 2023-05-06T11:21:22.000-04:00
After `asyncOnReset` I was getting an error when trying to start a new conversation. After some trial and error I've found that `kvCacheLength` being reset to `0` fixed the issue. Based on the discussion in #83 I have created this PR to upstream the fix that worked for me.
diff --git a/web/llm_chat.js b/web/llm_chat.js
@@ -178,6 +178,7 @@ class LLMChatPipeline {
 
   #clearKVCache() {
     this.fclearKVCaches(this.kvCache);
+    this.kvCacheLength = 0;
   }
 
   #forward(inputs, curPos) {

Original file line number	Diff line number	Diff line change
`@@ -178,6 +178,7 @@ class LLMChatPipeline {`
`178`	`178`
`179`	`179`	`#clearKVCache() {`
`180`	`180`	`this.fclearKVCaches(this.kvCache);`
	`181`	`+ this.kvCacheLength = 0;`
`181`	`182`	`}`
`182`	`183`
`183`	`184`	`#forward(inputs, curPos) {`