Skip to content

Create Float16 Versions of models in known sizes. #15

@DennisSmolek

Description

@DennisSmolek

One if the reasons we dont use pre-loaded models is the unknown size of inputs as well as the variety of properties to create the model.

However, with Tiling, the size of the model is standard. So it would be easy to create standard models at standard sizes, starting with the default tile of 256 X 256.

Doing a 256_cAux and 256 model in float16 would be significantly faster than the float32 that we use in the browser and wouldn't require the loading of weights at runtime.
It also makes models 50% the size and sometimes operate 4X faster.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions