Skip to content

Add option to extend the vocabulary when fine-tuning a model #115

@mcollardanuy

Description

@mcollardanuy

Context: how do we deal with missing vocabulary when fine-tuning a model? This is particularly an issue with ngram/word tokenization (the characters_v001.vocab solves it in part models using char tokenization).

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions