Skip to content

Commit 8d2cedc

Browse files
amanchopra1905surishubham
authored andcommitted
Merge pull request #2248 from amanchopra1905/stage
updated the images and docs
1 parent 3bc234a commit 8d2cedc

File tree

3 files changed

+43
-28
lines changed

3 files changed

+43
-28
lines changed
-827 Bytes
Loading
-6.26 KB
Loading

docs/hyperexecute-rerun-failed-tests.md

Lines changed: 43 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -3,16 +3,15 @@ id: hyperexecute-rerun-failed-tests
33
title: Rerun Failed Tests on HyperExecute
44
hide_title: false
55
sidebar_label: Rerun Failed Tests
6-
description: Optimize your workspace with HyperExecute job archiving to boost productivity. Keep only relevant jobs. Learn more!
6+
description: Speed up debugging by rerunning only failed tests or entire jobs on HyperExecute using the rerun job feature.
77
keywords:
88
- LambdaTest Hyperexecute
99
- LambdaTest Hyperexecute help
1010
- LambdaTest Hyperexecute documentation
1111
url: https://www.lambdatest.com/support/docs/hyperexecute-rerun-failed-tests/
1212
site_name: LambdaTest
13-
slug: hyperexecute-rerun-failed-tests/
13+
slug: hyperexecute-rerun-failed-tests/
1414
---
15-
1615
<script type="application/ld+json"
1716
dangerouslySetInnerHTML={{ __html: JSON.stringify({
1817
"@context": "https://schema.org",
@@ -36,42 +35,58 @@ slug: hyperexecute-rerun-failed-tests/
3635
})
3736
}}
3837
></script>
39-
Debugging test failures often involves identifying the root cause, fixing the issue, and rerunning tests to validate the fix. However, in large test suites with hundreds or thousands of tests, rerunning the entire job consumes significant time and resources.
38+
:::info BETA
39+
The feature is currently in **BETA**.
40+
:::
41+
42+
Debugging test failures often involves **identifying the root cause, fixing the issue, and rerunning tests to validate the fix**. However, in large test suites with hundreds or thousands of tests, rerunning the entire job consumes significant time and resources.
43+
44+
To address this, HyperExecute supports Rerun Job functionality, a feature that allows you to rerun only the failed scenarios or all the scenarios directly from the dashboard, drastically reducing your feedback loop and helping you validate the fixes faster.
45+
46+
## Prerequisites
47+
To rerun a job, the following requirements must be fulfilled.
48+
49+
- Your test suite should be available on **Git** (Github and Bitbucket are supported) and linked to a [Project](/support/docs/hyperexecute-projects). This is required because each time a job is rerun, HyperExecute needs access to your test suite.
50+
- Make sure you are using **YAML version 0.1** with auto-split mode and discovery mode as local only.
4051

41-
To address this, HyperExecute introduces Rerun Failed Tests, a feature that allows you to rerun only the failed tests or scenarios from a previous job, drastically reducing your feedback loop and helping you validate fixes faster.
52+
> Support for YAML version 0.2 and other modes will be added soon.
4253
43-
## Why Use Rerun Failed Tests?
44-
Consider a scenario where you’ve executed 1000 tests in a single HyperExecute job, and 50 tests failed due to a bug, either in your test code, infrastructure, or application under test. Previously, you’d need to rerun the entire job to verify the fix. With **Rerun Failed Tests**, you can now:
45-
- Quickly identify failed tests via RCA (Root Cause Analysis).
46-
- Apply your fix (in code or application).
47-
- Rerun only failed tests from the same job, instead of re-running the entire suite.
54+
:::note
55+
You can use the rerun feature for jobs started from your **local machine as long as Git info is available** (i.e., you’re running tests from a cloned Git repo).
56+
- Make sure the project details are set in your job’s YAML, and the project is linked to the same Git repo you’re running from.
57+
- If your local repo has uncommitted changes (a “dirty” working tree), rerun will not work. Commit or stash your changes before running the job.
58+
:::
4859

49-
This shortens your CI/CD cycle, saves compute time, and accelerates feedback.
50-
<!--
51-
## Types of Rerun
60+
## Why Use Rerun Feature?
61+
Consider a scenario where you’ve executed 1000 tests in a single HyperExecute job, and 50 tests failed due to a bug, either in your test code, infrastructure, or application under test. Previously, you were bound to run the complete job again which would have taken a lot more time (as you would have run the passed tests too) to check if the previously failed tests are passing or not. With **Rerun Job Feature**, your whole process is streamlined as given below:
5262

53-
| Rerun Type | Description | Use Case |
54-
| ---------- | ----------- | -------- |
55-
| **Rerun Complete Job** | Reruns the entire workflow from scratch | Useful when the fix impacts multiple parts of the codebase or environment |
56-
| **Rerun Failed Scenarios Only** | Reruns only the failed test cases or scenarios from the selected job | Ideal for quick validation of specific fixes | -->
63+
**View failed scenarios -> Identify the fix via AI RCA -> Apply your fix and deploy -> Rerun only failed scenarios of the job**
5764

58-
## How to Rerun Failed Tests
65+
### Benefits
66+
- **Faster feedback loop:** Rerun only what matters (failed scenarios), so you confirm fixes quickly instead of re-running the full suite.
67+
- **Reproducible results:** Reruns always use the same YAML as the original job, even when you choose the latest commit, ensuring consistent environment settings.
68+
- **Better flaky test diagnosis:** By rerunning only the failed scenarios on the same configuration, it’s much easier to distinguish genuine regressions from flaky tests.
69+
## Rerun Configuration Options
70+
HyperExecute provides you flexibility to select different parameters while rerunning the job.
71+
- **Failed or All Scenarios:** You can rerun only the failed scenarios or all scenarios of that job.
72+
- **Using Same or Latest Commit:** You can reuse the same commit as the original job or the latest commit from your repository. This lets you rerun after fixing your test suite or application under test.
73+
- **Adjusting Concurrency:** The **YAML remains the same** for the rerun and the original job to maintain the same environment, but you can change the concurrency on which the rerun job will run.
5974

60-
**Step 1 :** Go to the Jobs section in the HyperExecute Dashboard.
75+
> If there are multiple test cases under a failed scenario, all those test cases will be rerun if the scenario is marked as failed.
6176
62-
**Step 2 :** Open the job you want to rerun. Click on the **Rerun** button
77+
## How to Rerun a Job
78+
**Step 1 :** Go to the **Jobs** section in the HyperExecute dashboard. <br />
79+
**Step 2 :** Open the job you want to rerun and click the **Rerun** button in the top bar. <br />
6380

6481
<img loading="lazy" src={require('../assets/images/hyperexecute/features/rerun/1.png').default} alt="Image" className="doc_img"/>
82+
<br /><br />
6583

66-
**Step 3 :** Select the **Commit** whether you want to rerun with the same commit or with the latest one and select the Concurrency as well. Click on the **Rerun** button.
84+
**Step 3 :** In the Rerun dialog:
85+
- Select the **commit** you want to use (same commit as the original job or the latest commit from the repo).
86+
- Optionally adjust the **concurrency** for the rerun.
87+
Then click **Rerun** to start the new job.
6788

6889
<img loading="lazy" src={require('../assets/images/hyperexecute/features/rerun/2.png').default} alt="Image" className="doc_img"/>
6990

70-
HyperExecute will automatically trigger a new job referencing the same commit or sourcePayload.
7191

72-
## Benefits
73-
- **Reduce feedback loop time :** no need to rerun full test suites.
74-
- **Save resources :** run only what failed.
75-
- **Simplify debugging :** rerun failed scenarios directly after applying fixes.
76-
- **Integrates seamlessly :** works across Dashboard, CLI, and APIs.
77-
- Supports same or latest commit reruns.
92+
> If you do not satisfy the mentioned conditions but still want to use the rerun job feature, please reach out to us at [[email protected]](mailto:[email protected]). We will be constantly evolving this feature and are looking forward to your feedback to make it better.

0 commit comments

Comments
 (0)