Skip to content

[Question]: Is the Server Only GPU memory usage included in the gpu usage for the specific models? #955

@SDJustus

Description

@SDJustus

Hi guys,

first of all, awesome project!
I am wondering, if the gpu usage of the server is included in those of the model.
E.g. If my model has 3000MB max gpu usage and the server only metric yields 1000MB for the server, does the model take up 2000MB or 3000MB?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions