Skip to content

Commit 985d13b

Browse files
Ishavyas9Ishavyas9
authored
Merge pull request #1074 from Aman1905/stage
artifacts and reports for HYP espresso xcui test
2 parents c7099d6 + 8e2b187 commit 985d13b

5 files changed

+69
-25
lines changed

‎docs/hyperexecute-cli-run-tests-on-hyperexecute-grid.md‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -125,7 +125,6 @@ This flag allows you to download all the test related results that are generated
125125
</div>
126126

127127
:::note
128-
- This functionality is not available with **XCUI** tests.
129128
- For Espresso with private devices HyperExecute can download user generated artefacts.
130129
:::
131130

‎docs/hyperexecute-espresso-testing.md‎

Lines changed: 24 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -167,13 +167,16 @@ runson: android
167167

168168
autosplit: true
169169

170+
report: true #to generate reports
171+
170172
framework:
171173
name: "android/espresso"
172174
args:
173175
buildName: "Espresso"
174176
video: true
175177
deviceLog: true
176-
178+
artifacts: true #to generate artifacts
179+
177180
# You can use either the appId (lt://APP1234567) or provide the path of the application using appPath. Both examples are given below.
178181
appPath: proverbial_android.apk
179182
testSuitePath: proverbial_android_expressotest.apk
@@ -209,12 +212,16 @@ runson: android
209212
210213
autosplit: false
211214
215+
report: true #to generate reports
216+
212217
framework:
213218
name: android/espresso
214219
args:
215220
buildName: Espresso
216221
video: true
217222
deviceLog: true
223+
artifacts: true #to generate artifacts
224+
218225
# highlight-next-line
219226
appPath: proverbial_android.apk
220227
# highlight-next-line
@@ -264,21 +271,34 @@ preservedDevice: true
264271
```
265272
:::
266273

267-
## Step 6: Execute your Test Suite
274+
## Step 6: Generate Reports and Artifacts
275+
To generate artifacts for your Espresso tests, add the `artifacts: true` flag in your YAML file:
276+
277+
```yaml
278+
report: true
279+
framework:
280+
name: "android/espresso"
281+
args:
282+
artifacts: true
283+
...//
284+
```
285+
286+
To download these artifacts in your local machine, you can pass the `--download-artifacts` and `--download-report` flag with the CLI command to execute the tests as shown in the next step.
287+
## Step 7: Execute your Test Suite
268288

269289
> **NOTE :** In case of MacOS, if you get a permission denied warning while executing CLI, simply run **`chmod u+x ./hyperexecute`** to allow permission. In case you get a security popup, allow it from your **System Preferences** → **Security & Privacy** → **General tab**.
270290

271291
Run the below command in your terminal at the root folder of the project:
272292

273293
```bash
274-
./hyperexecute --config RELATIVE_PATH_OF_YOUR_YAML_FILE
294+
./hyperexecute --config RELATIVE_PATH_OF_YOUR_YAML_FILE --download-artifacts --download-report
275295
```
276296

277297
OR use this command if you have not exported your username and access key in the step 2.
278298

279299
<div className="lambdatest__codeblock">
280300
<CodeBlock className="language-bash">
281-
{`./hyperexecute --user ${ YOUR_LAMBDATEST_USERNAME()} --key ${ YOUR_LAMBDATEST_ACCESS_KEY()} --config RELATIVE_PATH_OF_YOUR_YAML_FILE `}
301+
{`./hyperexecute --user ${ YOUR_LAMBDATEST_USERNAME()} --key ${ YOUR_LAMBDATEST_ACCESS_KEY()} --config RELATIVE_PATH_OF_YOUR_YAML_FILE --download-artifacts --download-report`}
282302
</CodeBlock>
283303
</div>
284304

‎docs/hyperexecute-xcui-testing.md‎

Lines changed: 18 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -224,6 +224,7 @@ framework:
224224
values: ["LambdaUiKitIOSUITests/testverifyAppLaunch"]
225225
deviceSelectionStrategy: any
226226
devices: [".*"]
227+
artifacts: true
227228

228229
shards:
229230
mappings:
@@ -258,25 +259,38 @@ If you are using the `deviceSelectionStrategy: any`, then in that case all the m
258259

259260
:::
260261

261-
## Step 5: Execute your Test Suite
262+
## Step 5: Generate Artifacts
263+
To generate artifacts for your XCUI tests, add the `artifacts: true` flag in your YAML file:
264+
265+
```yaml
266+
framework:
267+
name: "ios/xcui"
268+
args:
269+
artifacts: true
270+
...//
271+
```
272+
273+
To download these artifacts in your local machine, you can pass the `--download-artifacts` flag with the CLI command to execute the tests as shown in the next step.
274+
275+
## Step 6: Execute your Test Suite
262276

263277
> **NOTE :** In case of macOS, if you get a permission denied warning while executing CLI, simply run **`chmod u+x ./hyperexecute`** to allow permission. In case you get a security popup, allow it from your **System Preferences** → **Security & Privacy** → **General tab**.
264278

265279
Run the below command in your terminal at the root folder of the project:
266280

267281
```bash
268-
./hyperexecute --config RELATIVE_PATH_OF_YOUR_YAML_FILE
282+
./hyperexecute --config RELATIVE_PATH_OF_YOUR_YAML_FILE --download-artifacts
269283
```
270284

271285
OR use this command if you have not exported your username and access key in the step 2.
272286

273287
<div className="lambdatest__codeblock">
274288
<CodeBlock className="language-bash">
275-
{`./hyperexecute --user ${ YOUR_LAMBDATEST_USERNAME()} --key ${ YOUR_LAMBDATEST_ACCESS_KEY()} --config RELATIVE_PATH_OF_YOUR_YAML_FILE `}
289+
{`./hyperexecute --user ${ YOUR_LAMBDATEST_USERNAME()} --key ${ YOUR_LAMBDATEST_ACCESS_KEY()} --config RELATIVE_PATH_OF_YOUR_YAML_FILE --download-artifacts`}
276290
</CodeBlock>
277291
</div>
278292

279-
## Step 6: Monitor the Test Execution
293+
## Step 7: Monitor the Test Execution
280294

281295
Visit the [HyperExecute Dashboard](https://hyperexecute.lambdatest.com/hyperexecute) and check your Job status.
282296

‎docs/hyperexecute-yaml-version0.2.md‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -64,6 +64,7 @@ The ```framework``` field in Hyperexecute YAML Version 0.2 allows you to configu
6464
| [workingDirectory](#workingDirectory) | String | No | Specifies the working directory where all discovery and execution commands will be executed.|
6565
| [defaultReports](#defaultReports) | Boolean | No | Specifies whether to create default reports for the specified framework.|
6666
| [region](#region) | String | No | Specifies in which region you want to spin your appium tests.|
67+
| [artifacts](#artifacts) | Boolean | No | Specifies whether to generate artifacts or not |
6768

6869
### `name`
6970
Specifies the testing framework used in your repository.
@@ -167,6 +168,16 @@ framework:
167168
region: us
168169
```
169170

171+
### `artifacts`
172+
173+
To generate artifacts for your Espresso tests, add the `artifacts: true` flag in your YAML file:
174+
175+
```yaml
176+
framework:
177+
args:
178+
artifacts: true
179+
```
180+
170181
> 📕 Learn [how to perform group-based test discovery in TestNG](/support/docs/hyperexecute-how-to-perform-group-based-test-discovery-in-testng)
171182

172183
## Sample Yaml Version 0.2

‎docs/supported-appium-versions-on-emulator-simulator.md‎

Lines changed: 16 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -81,27 +81,27 @@ The following table lists the iOS versions supported for app testing, along with
8181
| 17 | ['2.2.1', '2.3.0'] |
8282
| 18 | ['2.2.1', '2.3.0'] |
8383

84-
## 2. Web Testing on Android and iOS
85-
For mobile web testing, LambdaTest supports various Android and iOS device versions, ensuring that your web applications are responsive and compatible with different browsers and devices. Below are the supported versions for web testing.
84+
## 2. Web Testing on Android <!-- and iOS -->
85+
For mobile web testing, LambdaTest supports various Android <!--and iOS device--> versions, ensuring that your web applications are responsive and compatible with different browsers and devices. Below are the supported versions for web testing.
8686

87-
### 2.1 Supported Android Versions for Web Testing
87+
<!-- ### 2.1 Supported Android Versions for Web Testing -->
8888
The following table lists the Android versions supported for web testing, along with the corresponding Appium versions.
8989

9090
| Android Versions | Appium Versions (Android) |
9191
|------------------|-----------------------------------------|
92-
| 7 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
93-
| 7.1 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
94-
| 8 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
95-
| 8.1 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
96-
| 9 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
97-
| 10 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
98-
| 11 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
99-
| 12 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
100-
| 13 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
101-
| 14 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
102-
| 15 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
92+
| 7 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
93+
| 7.1 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
94+
| 8 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
95+
| 8.1 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
96+
| 9 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
97+
| 10 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
98+
| 11 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
99+
| 12 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**, `2.0.1`, `2.1.0`, `2.1.1`, `2.1.2`, `2.1.3`, `2.2.0`, `2.2.1`, `2.2.2`, `2.2.3`, `2.3.0`, `2.4.0`, `2.4.1`, `2.5.0`, `2.5.1`, `2.5.2`, `2.5.3`, `2.5.4`, `2.6.0`] |
100+
| 13 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3`, `2.0.1`, `2.1.0`, `2.1.1`, `2.1.2`, `2.1.3`, `2.2.0`, `2.2.1`, `2.2.2`, `2.2.3`, `2.3.0`, `2.4.0`, `2.4.1`, `2.5.0`, `2.5.1`, `2.5.2`, `2.5.3`, `2.5.4`, `2.6.0` **(default)**] |
101+
| 14 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3`, `2.0.1`, `2.1.0`, `2.1.1`, `2.1.2`, `2.1.3`, `2.2.0`, `2.2.1`, `2.2.2`, `2.2.3`, `2.3.0`, `2.4.0`, `2.4.1`, `2.5.0`, `2.5.1`, `2.5.2`, `2.5.3`, `2.5.4`, `2.6.0` **(default)**] |
102+
| 15 | [`1.22.3`, `2.0.1`, `2.1.0`, `2.2.0`, `2.3.0`, `2.4.0`, `2.5.0`, `2.6.0` **(default)**] |
103103

104-
### 2.2 Supported iOS Versions for Web Testing
104+
<!-- ### 2.2 Supported iOS Versions for Web Testing
105105
The following table lists the iOS versions supported for web testing, along with the corresponding Appium versions.
106106
107107
| iOS Versions | Appium Versions (iOS) |
@@ -115,4 +115,4 @@ The following table lists the iOS versions supported for web testing, along with
115115
| 15.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
116116
| 16.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
117117
| 17.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
118-
| 18.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
118+
| 18.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] | -->

0 commit comments

Comments
 (0)