Many Completed Pod

[Zruto]

I am using nextflow, and the working engine is k8s. A large number of Completed pods have not been recycled in the cluster. What is the reason?

[bentsherman]

That is unexpected, Nextflow should delete successful pods as defined here:

nextflow/modules/nextflow/src/main/groovy/nextflow/k8s/K8sTaskHandler.groovy

Line 419 in 1a68049

deletePodIfSuccessful(task)

[Zruto]

There is another question. Is this error caused by insufficient resources on the master node?

[Task monitor] ERROR nextflow.processor.TaskProcessor - Execution aborted due to an unexpected error
java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached

[bentsherman]

Yes, likely the head node where Nextflow is running doesn't have enough memory. A few GB is usually enough