Skip to content

EfficiencyΒ #5

@HermannSamimi

Description

@HermannSamimi

Hello,
I tried it for multiple json docs, but i did not find it efficient.
i used https://pypi.org/project/token-count/ as token counter.

sample 1:

Raw data size: 11245
Token count JSON : 3715
Token count toon: 3826

sample 2:

Raw data size: 4278
Token count JSON : 2217
Token count toon: 2096

sample 3:

Raw data size: 34151
Token count JSON : 11223
Token count toon: 11570   

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions