Skip to content

Incorrect memory assign when use withLable #5844

@JiangyanYu

Description

@JiangyanYu

Dear nextflow team,

I try to define the cpus, memory and time in the base.config file by using process lables (see below). This is a process using GPUs in a docker container. From the report file I notice the container indeed used 64 cpus, however only 6G memory, which is the default setting in my base.config. I used similar setting for other processes (only involved CPUS), which worked fine. All these CPU needed processed used the correct cpus and memory.

withLabel:process_gpu_long {
        cpus   = { check_max( 64    * task.attempt, 'cpus'     ) }
        memory = { check_max( 512.GB * task.attempt, 'memory'  ) }
        time   = { check_max( 24.h  * task.attempt, 'time'   ) }
    }

In the end, I defined the process itself to increase memory (see below). This could solve the problem. But I don't know why. Could you please give more information for this bug? Thanks a lot!

    withName:DEEPVARIANT {
        cpus   = { check_max( 64    * task.attempt, 'cpus'     ) }
        memory = { check_max( 512.GB * task.attempt, 'memory'  ) }
    }

Best,
Jiangyan

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions