Skip to content

Does word2vec.jl use the skip-gram with negative sampling (SGNS) method? #24

@tobefreeman

Description

@tobefreeman

Maybe I am missing something, but I figure that word2vec.jl has not implemented the skip-gram with negative sampling (SGNS) variant of word2vec? Most people might have moved on from word2vec, but it is vastly more data efficient than the transformer framework. I am making custom embeddings, and want to port my code to Julia. But no SGNS is a showstopper. Any chance of an implementation?

The AdaGram.jl package, which does, is no longer actively supported.
https://github.com/sbos/AdaGram.jl

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions