Could Nextflow be adapted for Aliyun? Or otherwise, how can I develop Executors on cloud my self?

[wangshun1121]

I am a bioinformatics engineer in China, and I tried to deploy my nextflow pipeline to local cloud such as Aliyun, Huawei Cloud, Tencent Cloud... I wander if Nextflow can be adapted for these clouds like AWS etc...

Or otherwise, is there any templates for Nextflow Executors development? For example, google cloud, so that I can try to develop Executors for local cloud myself.

[pditommaso]

That's very welcome. If I remember correctly Alibaba Cloud Batch service has a very similar API to the Azure one. You may want to have a look at the nf-azure plugin to get started with it

[wangshun1121]

I'll try

[bentsherman]

Hi @wangshun1121 , another option is to setup a Kubernetes cluster on one of these clouds and use Nextflow's k8s executor. That way you don't have to develop a new nextflow executor, but you also don't get the benefit of auto-scaling that most cloud batch executors provide, unless one of these cloud providers have a managed Kubernetes service that support node auto-scaling (like Google GKE for example).

[denny-zhao]

Hi @wangshun1121 , we are contributing a new nextflow plugin which provides cloud integration automation. Alicloud is fully supported. You can reference to this disuccsion: nextflow-io/plugins#12