Skip to content

Sweep(slow): count tokens on the server side #17

@CNSeniorious000

Description

@CNSeniorious000

Details

在 src/pages/api/generate.ts 中加上和 src/components/Generator.tsx 中一样的裁剪 messages 的逻辑:
但是注意:服务端用不了 tiktoken 库,只能用 tiktoken-js 库,他们应该有类似的 interface

Checklist
  • Create src/utils/tiktoken-server.ts09d7244
  • Running GitHub Actions for src/utils/tiktoken-server.ts
  • Modify src/pages/api/generate.ts30a5ea4
  • Running GitHub Actions for src/pages/api/generate.ts

Flowchart

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions