How to run private images from Docker Hub?

[bounlu]

As the title says, how can I run private images from Docker Hub inside Nextflow pipeline to fix the below error?

Where to provide credentials or docker login command? Does containerOptions support this?

process {
	withName: 'XXX' {
		container	= 'personal/privateimage:latest'
	}
}

Caused by:
  Task failed to start - CannotPullContainerError: Error response from daemon: pull access denied for personal/privateimage:latest, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

[abhi18av]

Hi @bounlu

Could you please share more context with us, such as .nextflow.log file would be really helpful.

Beyond this, are you trying to run this locally or in cloud?

[bounlu]

Hi @abhi18av

Unfortunately I don't have the .nextflow.log file anymore but I believe this is a general issue.

I am running it on the cloud via awsbatch.

[bounlu]

Any suggestions on this?

[pditommaso]

Nextflow currently does not provide direct support for private container repositories. However, the use of private containers depending the capability of the target compute platform.

For example this post describes how to authenticate docker when using AWS batch https://aws.amazon.com/blogs/compute/how-to-authenticate-private-container-registries-using-aws-batch/

[bounlu]

@pditommaso

Great! Following your link I could manage to set it up. Basically the idea is to place DockerHub credentials inside the AMI on AWS which will be used for authentication when pulling private images, as explained here.

Thanks a lot.