Skip to content

Account for cases where payload to openai has to be chunked #23

@eonist

Description

@eonist

problem:
payload is too large for openai to translate in one prompt session.

solution:
figure out max size openai can receive for selected model. then split payload into multiple packets. and send them one by one. Then recompile the returned values into one result.

Note
Use AI copilot to figure out logistics, do some research around best practices here

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions