You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Debugging test failures often involves identifying the root cause, fixing the issue, and rerunning tests to validate the fix. However, in large test suites with hundreds or thousands of tests, rerunning the entire job consumes significant time and resources.
38
+
:::info BETA
39
+
The feature is currently in **BETA**.
40
+
:::
41
+
42
+
Debugging test failures often involves **identifying the root cause, fixing the issue, and rerunning tests to validate the fix**. However, in large test suites with hundreds or thousands of tests, rerunning the entire job consumes significant time and resources.
43
+
44
+
To address this, HyperExecute supports Rerun Job functionality, a feature that allows you to rerun only the failed scenarios or all the scenarios directly from the dashboard, drastically reducing your feedback loop and helping you validate the fixes faster.
45
+
46
+
## Prerequisites
47
+
To rerun a job, the following requirements must be fulfilled.
48
+
49
+
- Your test suite should be available on **Git** (Github and Bitbucket are supported) and linked to a [Project](/support/docs/hyperexecute-projects). This is required because each time a job is rerun, HyperExecute needs access to your test suite.
50
+
- Make sure you are using **YAML version 0.1** with auto-split mode and discovery mode as local only.
40
51
41
-
To address this, HyperExecute introduces Rerun Failed Tests, a feature that allows you to rerun only the failed tests or scenarios from a previous job, drastically reducing your feedback loop and helping you validate fixes faster.
52
+
> Support for YAML version 0.2 and other modes will be added soon.
42
53
43
-
## Why Use Rerun Failed Tests?
44
-
Consider a scenario where you’ve executed 1000 tests in a single HyperExecute job, and 50 tests failed due to a bug, either in your test code, infrastructure, or application under test. Previously, you’d need to rerun the entire job to verify the fix. With **Rerun Failed Tests**, you can now:
45
-
- Quickly identify failed tests via RCA (Root Cause Analysis).
46
-
- Apply your fix (in code or application).
47
-
- Rerun only failed tests from the same job, instead of re-running the entire suite.
54
+
:::note
55
+
You can use the rerun feature for jobs started from your **local machine as long as Git info is available** (i.e., you’re running tests from a cloned Git repo).
56
+
- Make sure the project details are set in your job’s YAML, and the project is linked to the same Git repo you’re running from.
57
+
- If your local repo has uncommitted changes (a “dirty” working tree), rerun will not work. Commit or stash your changes before running the job.
58
+
:::
48
59
49
-
This shortens your CI/CD cycle, saves compute time, and accelerates feedback.
50
-
<!--
51
-
## Types of Rerun
60
+
## Why Use Rerun Feature?
61
+
Consider a scenario where you’ve executed 1000 tests in a single HyperExecute job, and 50 tests failed due to a bug, either in your test code, infrastructure, or application under test. Previously, you were bound to run the complete job again which would have taken a lot more time (as you would have run the passed tests too) to check if the previously failed tests are passing or not. With **Rerun Job Feature**, your whole process is streamlined as given below:
52
62
53
-
| Rerun Type | Description | Use Case |
54
-
| ---------- | ----------- | -------- |
55
-
| **Rerun Complete Job** | Reruns the entire workflow from scratch | Useful when the fix impacts multiple parts of the codebase or environment |
56
-
| **Rerun Failed Scenarios Only** | Reruns only the failed test cases or scenarios from the selected job | Ideal for quick validation of specific fixes | -->
63
+
**View failed scenarios -> Identify the fix via AI RCA -> Apply your fix and deploy -> Rerun only failed scenarios of the job**
57
64
58
-
## How to Rerun Failed Tests
65
+
### Benefits
66
+
-**Faster feedback loop:** Rerun only what matters (failed scenarios), so you confirm fixes quickly instead of re-running the full suite.
67
+
-**Reproducible results:** Reruns always use the same YAML as the original job, even when you choose the latest commit, ensuring consistent environment settings.
68
+
-**Better flaky test diagnosis:** By rerunning only the failed scenarios on the same configuration, it’s much easier to distinguish genuine regressions from flaky tests.
69
+
## Rerun Configuration Options
70
+
HyperExecute provides you flexibility to select different parameters while rerunning the job.
71
+
-**Failed or All Scenarios:** You can rerun only the failed scenarios or all scenarios of that job.
72
+
-**Using Same or Latest Commit:** You can reuse the same commit as the original job or the latest commit from your repository. This lets you rerun after fixing your test suite or application under test.
73
+
-**Adjusting Concurrency:** The **YAML remains the same** for the rerun and the original job to maintain the same environment, but you can change the concurrency on which the rerun job will run.
59
74
60
-
**Step 1 :** Go to the Jobs section in the HyperExecute Dashboard.
75
+
> If there are multiple test cases under a failed scenario, all those test cases will be rerun if the scenario is marked as failed.
61
76
62
-
**Step 2 :** Open the job you want to rerun. Click on the **Rerun** button
77
+
## How to Rerun a Job
78
+
**Step 1 :** Go to the **Jobs** section in the HyperExecute dashboard. <br />
79
+
**Step 2 :** Open the job you want to rerun and click the **Rerun** button in the top bar. <br />
**Step 3 :** Select the **Commit** whether you want to rerun with the same commit or with the latest one and select the Concurrency as well. Click on the **Rerun** button.
84
+
**Step 3 :** In the Rerun dialog:
85
+
- Select the **commit** you want to use (same commit as the original job or the latest commit from the repo).
86
+
- Optionally adjust the **concurrency** for the rerun.
HyperExecute will automatically trigger a new job referencing the same commit or sourcePayload.
71
91
72
-
## Benefits
73
-
-**Reduce feedback loop time :** no need to rerun full test suites.
74
-
-**Save resources :** run only what failed.
75
-
-**Simplify debugging :** rerun failed scenarios directly after applying fixes.
76
-
-**Integrates seamlessly :** works across Dashboard, CLI, and APIs.
77
-
- Supports same or latest commit reruns.
92
+
> If you do not satisfy the mentioned conditions but still want to use the rerun job feature, please reach out to us at [[email protected]](mailto:[email protected]). We will be constantly evolving this feature and are looking forward to your feedback to make it better.
0 commit comments