How to perform parallel run in multiple nodes/machine in Jenkins

[bilarallen]

Hi! I hope someone can give an idea how we can perform parallel execution in multiple node/machine in Jenkins pipeline. I followed the instruction here https://github.com/cypress-io/cypress-example-kitchensink/blob/master/Jenkinsfile for setting up Jenkins parallel execution. But it seems that it only execute in one machine.

Whenever I check the logs I see that every stages are being run in parallel but only in one machine

My JenkinsPipeline is declarative and here is the setup

pipeline {
    agent {
        docker {
            label 'default'
            image 'cypress/base:14.16.0'
        
        }
    }
    stages {
        stage('Install Dependencies') { 
            steps {
                echo "Running build ${env.BUILD_ID} on ${env.JENKINS_URL}"
                sh 'npm ci'
                sh 'npm run cy:verify'
            }
        }
        
        stage('CBS UI Test') { 
            environment {
                CYPRESS_RECORD_KEY = credentials('cypress-record-key')
                CYPRESS_trashAssetsBeforeRuns = 'false'
            }

            parallel {
                stage('Tester A') {
                    steps {
                        echo "Running build ${env.BUILD_ID} on Tester A"
                        sh "NO_COLOR=1 xvfb-run -a npx cypress-cloud run --parallel --record --key ${env.CYPRESS_RECORD_KEY}"
                    }
                }

                stage('Tester B') {
                    steps {
                        echo "Running build ${env.BUILD_ID} on Tester B"
                       sh "NO_COLOR=1 xvfb-run -a npx cypress-cloud run --parallel --record --key ${env.CYPRESS_RECORD_KEY}"
                    }
                }

                stage('Tester C') {
                    steps {
                        echo "Running build ${env.BUILD_ID} on Tester C"
                       sh "NO_COLOR=1 xvfb-run -a npx cypress-cloud run --parallel --record --key ${env.CYPRESS_RECORD_KEY}"
                    }
                }

            }
           
        }
    }
}

Our built-in node has 6 executors and this is only the node where we can run our test as we specify by its label

Our goal is to run it in parallel either in multiple nodes (where we will set up different machines) or in multiple executors using the same node.

Please take note that our Jenkins is dockerized that's why in my Jenkins pipeline I need to use the docker cypress base image.

One thing to add is that even though our test is in parallel right now running our test in locally is bit faster compared when running it in CI using Cypress parallelization

Using Cypress parallel execution it took 16 mins. to finish the whole test.

Hoping someone can help or give us a code snippet to follow based on our setup. Thanks!

[3mrfouad]

Hello @bilarallen did you get a breakthrough here? I have same issue trying to get Jenkins running multiple agents with Cypress Cloud.

[bilarallen]

Hey @3mrfouad yep I was able to resolve this issue. Basically, you need different nodes/agents to achieve parallel run in different machines. We are using AWS ec2 instance as VMS a.k.a ec2-fleet then you need to specify the agent label. Here's the code snippet I have for my jenkins file:

pipeline {
    agent none
    stages {
        stage('CBS UI Test') { 
            environment {
                CYPRESS_RECORD_KEY = credentials('cypress-record-key')
                CYPRESS_trashAssetsBeforeRuns = 'false'
            }

            parallel {
                stage('Tester A') {
                   agent {
                        docker {
                        label 'ec2-fleet-cypress'
                        image 'cypress/base:14.16.0'
                        }
                    }
                    steps {
                        echo "Running build ${env.BUILD_ID} on Tester A"
                        sh "NO_COLOR=1 xvfb-run -a npx cypress-cloud run --parallel --record --key ${env.CYPRESS_RECORD_KEY}"
                    }
                }

                stage('Tester B') {
                    agent {
                        docker {
                        label 'ec2-fleet-cypress'
                        image 'cypress/base:14.16.0'
                        }
                    }
                    steps {
                        echo "Running build ${env.BUILD_ID} on Tester B"
                       sh "NO_COLOR=1 xvfb-run -a npx cypress-cloud run --parallel --record --key ${env.CYPRESS_RECORD_KEY}"
                    }
                }

                stage('Tester C') {
                    agent {
                        docker {
                        label 'ec2-fleet-cypress'
                        image 'cypress/base:14.16.0'
                        }
                    }
                    steps {
                        echo "Running build ${env.BUILD_ID} on Tester C"
                       sh "NO_COLOR=1 xvfb-run -a npx cypress-cloud run --parallel --record --key ${env.CYPRESS_RECORD_KEY}"
                    }
                }

            }
           }
        }
    }
}