Skip to content

Ability to Incorporate Open Source Embeddings for Router to Remove OpenAI dependency #62

@madison-evans

Description

@madison-evans

As the title suggests, I want to be able to utilize an open source embedding model from huggingface such that I don't require openAI or any other api driven embedding model for the actual routing done in mf routing. I'm able to dig into the source code in the routellm package and accomplish this by modifying the matrix_factorization.model.py file as well as controller.py and routers.py, but it would be great if this option was already available

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions