Skip to content

Interactive sessions are saving checkpoints to the clearml file serverΒ #925

@mshannon-sil

Description

@mshannon-sil

When tasks involving the train step are run in an interactive session, the checkpoints are being saved to the file server, which is not intended and causes the file server to fill up quickly. This also might be happening for any tasks that are being tracked by clearml but not executed remotely.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingmlopsDevOps, GPUs, ClearML

    Type

    No type

    Projects

    Status

    πŸ†• New

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions