Skip to content

_process_colbert_vecs function includes eos token #1490

@minholee-29cm

Description

@minholee-29cm

Hi, it seems like current _process_colbert_vecs function includes eos token.

return colbert_vecs[:tokens_num - 1] # we don't use the embedding of cls, so select tokens_num-1

I wonder if this is intended.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions