Skip to content

Commit 988d2a5

Browse files
vMaroonliu-cong
andauthored
Apply suggestion from @liu-cong
Co-authored-by: Cong Liu <[email protected]>
1 parent 60ffd6f commit 988d2a5

File tree

1 file changed

+1
-1
lines changed
  • pkg/epp/scheduling/framework/plugins/multi/prefix

1 file changed

+1
-1
lines changed

pkg/epp/scheduling/framework/plugins/multi/prefix/plugin.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -269,7 +269,7 @@ func hashPrompt(ctx context.Context, request *types.LLMRequest, cacheBlockSize i
269269
loggerDebug.Info("Truncating input", "size", len(userInput), "max prefix blocks", maxPrefixBlocks, "block size", cacheBlockSize)
270270
userInput = userInput[:maxPrefixBlocks*cacheBlockSize]
271271
}
272-
// Split the body into blocks of size cacheBlockSize. The +1 is to account for the model.
272+
// Split the body into blocks of size cacheBlockSize.
273273
// If the last block is smaller than cacheBlockSize, it will be ignored.
274274
res := make([]BlockHash, 0, 1+len(userInput)/cacheBlockSize)
275275
// Add the model to the first block hash so that different models have different hashes even with the same body.

0 commit comments

Comments
 (0)