Skip to content

Commit 433f478

Browse files
Ishavyas9Ishavyas9
authored
Merge pull request #1080 from Ishavyas9/main
artifacts and reports for HYP espresso xcui test
2 parents bdb4f07 + 88c71cb commit 433f478

6 files changed

+176
-9
lines changed

‎docs/hyperexecute-cli-run-tests-on-hyperexecute-grid.md‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -125,7 +125,6 @@ This flag allows you to download all the test related results that are generated
125125
</div>
126126

127127
:::note
128-
- This functionality is not available with **XCUI** tests.
129128
- For Espresso with private devices HyperExecute can download user generated artefacts.
130129
:::
131130

‎docs/hyperexecute-espresso-testing.md‎

Lines changed: 24 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -167,13 +167,16 @@ runson: android
167167

168168
autosplit: true
169169

170+
report: true #to generate reports
171+
170172
framework:
171173
name: "android/espresso"
172174
args:
173175
buildName: "Espresso"
174176
video: true
175177
deviceLog: true
176-
178+
artifacts: true #to generate artifacts
179+
177180
# You can use either the appId (lt://APP1234567) or provide the path of the application using appPath. Both examples are given below.
178181
appPath: proverbial_android.apk
179182
testSuitePath: proverbial_android_expressotest.apk
@@ -209,12 +212,16 @@ runson: android
209212
210213
autosplit: false
211214
215+
report: true #to generate reports
216+
212217
framework:
213218
name: android/espresso
214219
args:
215220
buildName: Espresso
216221
video: true
217222
deviceLog: true
223+
artifacts: true #to generate artifacts
224+
218225
# highlight-next-line
219226
appPath: proverbial_android.apk
220227
# highlight-next-line
@@ -264,21 +271,34 @@ preservedDevice: true
264271
```
265272
:::
266273

267-
## Step 6: Execute your Test Suite
274+
## Step 6: Generate Reports and Artifacts
275+
To generate artifacts for your Espresso tests, add the `artifacts: true` flag in your YAML file:
276+
277+
```yaml
278+
report: true
279+
framework:
280+
name: "android/espresso"
281+
args:
282+
artifacts: true
283+
...//
284+
```
285+
286+
To download these artifacts in your local machine, you can pass the `--download-artifacts` and `--download-report` flag with the CLI command to execute the tests as shown in the next step.
287+
## Step 7: Execute your Test Suite
268288

269289
> **NOTE :** In case of MacOS, if you get a permission denied warning while executing CLI, simply run **`chmod u+x ./hyperexecute`** to allow permission. In case you get a security popup, allow it from your **System Preferences** → **Security & Privacy** → **General tab**.
270290

271291
Run the below command in your terminal at the root folder of the project:
272292

273293
```bash
274-
./hyperexecute --config RELATIVE_PATH_OF_YOUR_YAML_FILE
294+
./hyperexecute --config RELATIVE_PATH_OF_YOUR_YAML_FILE --download-artifacts --download-report
275295
```
276296

277297
OR use this command if you have not exported your username and access key in the step 2.
278298

279299
<div className="lambdatest__codeblock">
280300
<CodeBlock className="language-bash">
281-
{`./hyperexecute --user ${ YOUR_LAMBDATEST_USERNAME()} --key ${ YOUR_LAMBDATEST_ACCESS_KEY()} --config RELATIVE_PATH_OF_YOUR_YAML_FILE `}
301+
{`./hyperexecute --user ${ YOUR_LAMBDATEST_USERNAME()} --key ${ YOUR_LAMBDATEST_ACCESS_KEY()} --config RELATIVE_PATH_OF_YOUR_YAML_FILE --download-artifacts --download-report`}
282302
</CodeBlock>
283303
</div>
284304

‎docs/hyperexecute-xcui-testing.md‎

Lines changed: 18 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -224,6 +224,7 @@ framework:
224224
values: ["LambdaUiKitIOSUITests/testverifyAppLaunch"]
225225
deviceSelectionStrategy: any
226226
devices: [".*"]
227+
artifacts: true
227228

228229
shards:
229230
mappings:
@@ -258,25 +259,38 @@ If you are using the `deviceSelectionStrategy: any`, then in that case all the m
258259

259260
:::
260261

261-
## Step 5: Execute your Test Suite
262+
## Step 5: Generate Artifacts
263+
To generate artifacts for your XCUI tests, add the `artifacts: true` flag in your YAML file:
264+
265+
```yaml
266+
framework:
267+
name: "ios/xcui"
268+
args:
269+
artifacts: true
270+
...//
271+
```
272+
273+
To download these artifacts in your local machine, you can pass the `--download-artifacts` flag with the CLI command to execute the tests as shown in the next step.
274+
275+
## Step 6: Execute your Test Suite
262276

263277
> **NOTE :** In case of macOS, if you get a permission denied warning while executing CLI, simply run **`chmod u+x ./hyperexecute`** to allow permission. In case you get a security popup, allow it from your **System Preferences** → **Security & Privacy** → **General tab**.
264278

265279
Run the below command in your terminal at the root folder of the project:
266280

267281
```bash
268-
./hyperexecute --config RELATIVE_PATH_OF_YOUR_YAML_FILE
282+
./hyperexecute --config RELATIVE_PATH_OF_YOUR_YAML_FILE --download-artifacts
269283
```
270284

271285
OR use this command if you have not exported your username and access key in the step 2.
272286

273287
<div className="lambdatest__codeblock">
274288
<CodeBlock className="language-bash">
275-
{`./hyperexecute --user ${ YOUR_LAMBDATEST_USERNAME()} --key ${ YOUR_LAMBDATEST_ACCESS_KEY()} --config RELATIVE_PATH_OF_YOUR_YAML_FILE `}
289+
{`./hyperexecute --user ${ YOUR_LAMBDATEST_USERNAME()} --key ${ YOUR_LAMBDATEST_ACCESS_KEY()} --config RELATIVE_PATH_OF_YOUR_YAML_FILE --download-artifacts`}
276290
</CodeBlock>
277291
</div>
278292

279-
## Step 6: Monitor the Test Execution
293+
## Step 7: Monitor the Test Execution
280294

281295
Visit the [HyperExecute Dashboard](https://hyperexecute.lambdatest.com/hyperexecute) and check your Job status.
282296

‎docs/hyperexecute-yaml-version0.2.md‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -64,6 +64,7 @@ The ```framework``` field in Hyperexecute YAML Version 0.2 allows you to configu
6464
| [workingDirectory](#workingDirectory) | String | No | Specifies the working directory where all discovery and execution commands will be executed.|
6565
| [defaultReports](#defaultReports) | Boolean | No | Specifies whether to create default reports for the specified framework.|
6666
| [region](#region) | String | No | Specifies in which region you want to spin your appium tests.|
67+
| [artifacts](#artifacts) | Boolean | No | Specifies whether to generate artifacts or not |
6768

6869
### `name`
6970
Specifies the testing framework used in your repository.
@@ -167,6 +168,16 @@ framework:
167168
region: us
168169
```
169170

171+
### `artifacts`
172+
173+
To generate artifacts for your Espresso tests, add the `artifacts: true` flag in your YAML file:
174+
175+
```yaml
176+
framework:
177+
args:
178+
artifacts: true
179+
```
180+
170181
> 📕 Learn [how to perform group-based test discovery in TestNG](/support/docs/hyperexecute-how-to-perform-group-based-test-discovery-in-testng)
171182

172183
## Sample Yaml Version 0.2

‎docs/supported-appium-versions-on-emulator-simulator.md‎

Lines changed: 118 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,118 @@
1+
---
2+
id: supported-appium-versions-on-emulator-simulator
3+
title: Supported Appium Versions
4+
hide_title: false
5+
sidebar_label: Supported Appium Versions
6+
description: Find detailed information on the compatible Appium versions for testing your Android apps on virtual devices (emulator/simulator) using LambdaTest.
7+
keywords:
8+
- appium
9+
- appium languages
10+
- appium framework
11+
- configuration
12+
- supported platforms
13+
- automation testing framework
14+
- test automation frameworks
15+
- app testing
16+
- lambdaTest
17+
- appium version selection
18+
url: https://www.lambdatest.com/support/docs/supported-appium-versions-on-emulator-simulator/
19+
site_name: LambdaTest
20+
slug: supported-appium-versions-on-emulator-simulator/
21+
---
22+
23+
import Tabs from '@theme/Tabs';
24+
import TabItem from '@theme/TabItem';
25+
import NewTag from '../src/component/newTag';
26+
27+
<script type="application/ld+json"
28+
dangerouslySetInnerHTML={{ __html: JSON.stringify({
29+
"@context": "https://schema.org",
30+
"@type": "BreadcrumbList",
31+
"itemListElement": [{
32+
"@type": "ListItem",
33+
"position": 1,
34+
"name": "Home",
35+
"item": "https://www.lambdatest.com"
36+
},{
37+
"@type": "ListItem",
38+
"position": 2,
39+
"name": "Support",
40+
"item": "https://www.lambdatest.com/support/docs/"
41+
},{
42+
"@type": "ListItem",
43+
"position": 3,
44+
"name": "Languages and Frameworks Supported on HyperExecute ",
45+
"item": "https://www.lambdatest.com/support/docs/supported-appium-versions-on-emulator-simulator/"
46+
}]
47+
})
48+
}}
49+
></script>
50+
LambdaTest offers a powerful and reliable cloud-based platform for testing mobile applications and websites on a wide range of Android and iOS devices using emulators and simulators. This document provides comprehensive information on the supported versions of Android and iOS devices for both mobile app and web testing.
51+
52+
53+
## 1. App Testing on Android and iOS
54+
Mobile app testing on LambdaTest emulators and simulators allows developers to ensure their applications perform as expected across multiple Android and iOS versions. Below are the supported versions for app testing.
55+
56+
### 1.1 Supported Android Versions for App Testing
57+
The following table lists the Android versions supported for app testing, along with the corresponding Appium versions.
58+
59+
| Android Versions | Supported Appium Versions (Android) |
60+
|------------------|-------------------------------------|
61+
| 7 | ['2.2.1', '2.3.0'] |
62+
| 8 | ['2.2.1', '2.3.0'] |
63+
| 9 | ['2.2.1', '2.3.0'] |
64+
| 10 | ['2.2.1', '2.3.0'] |
65+
| 11 | ['2.2.1', '2.3.0'] |
66+
| 12 | ['2.2.1', '2.3.0'] |
67+
| 13 | ['2.2.1', '2.3.0'] |
68+
| 14 | ['2.2.1', '2.3.0'] |
69+
| 15 | ['2.2.1', '2.3.0'] |
70+
71+
### 1.2 Supported iOS Versions for App Testing
72+
The following table lists the iOS versions supported for app testing, along with the corresponding Appium versions.
73+
74+
| iOS Versions | Supported Appium Versions (iOS) |
75+
|--------------|---------------------------------|
76+
| 12 | ['2.2.1', '2.3.0'] |
77+
| 13 | ['2.2.1', '2.3.0'] |
78+
| 14 | ['2.2.1', '2.3.0'] |
79+
| 15 | ['2.2.1', '2.3.0'] |
80+
| 16 | ['2.2.1', '2.3.0'] |
81+
| 17 | ['2.2.1', '2.3.0'] |
82+
| 18 | ['2.2.1', '2.3.0'] |
83+
84+
## 2. Web Testing on Android <!-- and iOS -->
85+
For mobile web testing, LambdaTest supports various Android <!--and iOS device--> versions, ensuring that your web applications are responsive and compatible with different browsers and devices. Below are the supported versions for web testing.
86+
87+
<!-- ### 2.1 Supported Android Versions for Web Testing -->
88+
The following table lists the Android versions supported for web testing, along with the corresponding Appium versions.
89+
90+
| Android Versions | Appium Versions (Android) |
91+
|------------------|-----------------------------------------|
92+
| 7 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
93+
| 7.1 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
94+
| 8 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
95+
| 8.1 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
96+
| 9 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
97+
| 10 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
98+
| 11 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**] |
99+
| 12 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3` **(default)**, `2.0.1`, `2.1.0`, `2.1.1`, `2.1.2`, `2.1.3`, `2.2.0`, `2.2.1`, `2.2.2`, `2.2.3`, `2.3.0`, `2.4.0`, `2.4.1`, `2.5.0`, `2.5.1`, `2.5.2`, `2.5.3`, `2.5.4`, `2.6.0`] |
100+
| 13 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3`, `2.0.1`, `2.1.0`, `2.1.1`, `2.1.2`, `2.1.3`, `2.2.0`, `2.2.1`, `2.2.2`, `2.2.3`, `2.3.0`, `2.4.0`, `2.4.1`, `2.5.0`, `2.5.1`, `2.5.2`, `2.5.3`, `2.5.4`, `2.6.0` **(default)**] |
101+
| 14 | [`1.17.0`, `1.17.1`, `1.18.0`, `1.19.0`, `1.19.1`, `1.20.0`, `1.20.1`, `1.20.2`, `1.21.0`, `1.22.0`, `1.22.1`, `1.22.2`, `1.22.3`, `2.0.1`, `2.1.0`, `2.1.1`, `2.1.2`, `2.1.3`, `2.2.0`, `2.2.1`, `2.2.2`, `2.2.3`, `2.3.0`, `2.4.0`, `2.4.1`, `2.5.0`, `2.5.1`, `2.5.2`, `2.5.3`, `2.5.4`, `2.6.0` **(default)**] |
102+
| 15 | [`1.22.3`, `2.0.1`, `2.1.0`, `2.2.0`, `2.3.0`, `2.4.0`, `2.5.0`, `2.6.0` **(default)**] |
103+
104+
<!-- ### 2.2 Supported iOS Versions for Web Testing
105+
The following table lists the iOS versions supported for web testing, along with the corresponding Appium versions.
106+
107+
| iOS Versions | Appium Versions (iOS) |
108+
|--------------|-----------------------------------------|
109+
| 8.1 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
110+
| 10.3 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
111+
| 11.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
112+
| 12.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
113+
| 13.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
114+
| 14.1 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
115+
| 15.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
116+
| 16.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
117+
| 17.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] |
118+
| 18.0 | ['1.12.1', '1.17.0', '1.22.3', '2.6.0'] | -->

‎sidebars.js‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2329,6 +2329,11 @@ module.exports = {
23292329
label: "Emulator / Simulator",
23302330
items: ["app-automation-app-sim"],
23312331
},
2332+
{
2333+
type: 'doc',
2334+
label: 'Supported Appium Version',
2335+
id: 'supported-appium-versions-on-emulator-simulator'
2336+
}
23322337
],
23332338
],
23342339

0 commit comments

Comments
 (0)