Skip to content

Huggingface integrationΒ #1136

@constantinpape

Description

@constantinpape

We should add a huggingface integration to publish micro-sam and related models. See also computational-cell-analytics/medico-sam#86.

I have started with the first steps for it by:

For the next steps we need to decide how to best represent the model in HuggingFace. This is a bit more complex, because our models consist of the SAM model (prompt encoder, image encoder, mask decoder) + a custom UNETR decoder. So I am not sure if we can use the PyTorchModelHubMixin or should rather opt for a custom upload solution. See https://huggingface.co/docs/hub/models-uploading for details.

Once we have figured this out:

  • Implement code for the integration so that we can easily upload different models.
  • Upload the MedicoSAM model.
  • Implement a demo for https://huggingface.co/spaces
  • Upload other models and associated demos.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions