Skip to content

0.2.2

Choose a tag to compare

@BYK BYK released this 24 Feb 22:37
· 113 commits to main since this release
0.2.2
6af2b88

Fixes

  • Uncalibrated overflow: on first turn (no calibration data from a prior API response), tryFit now applies a 1.5x safety multiplier to its estimated token count before accepting a layer. chars/4 estimates can undercount by up to 1.8x on sessions with large tool outputs — the window appears to fit but actually overflows. The multiplier causes the gradient to escalate to the next (more aggressive) layer until the adjusted estimate fits within maxInput. Calibrated turns (where exact API token counts are available) are unaffected.

  • Trailing assistant message prefill error: removed the break on tool parts from the trailing-message drop loop. The break left trailing assistant messages with tool parts at the end of the compressed window, causing 'This model does not support assistant message prefill. The conversation must end with a user message.' errors. Trailing non-user messages are now always dropped regardless of whether they contain tool parts.