You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/learning-paths/mobile-graphics-and-gaming/Vision-LLM-inference-on-Android-with-KleidiAI-and-MNN/Benchmark_the_performance.md
+13-2Lines changed: 13 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,5 @@
1
1
---
2
-
title: Build the MNN Command-line ViT Demo
2
+
title: Benchmark the Vision Transformer performance with KleidiAI
Copy file name to clipboardExpand all lines: content/learning-paths/mobile-graphics-and-gaming/Vision-LLM-inference-on-Android-with-KleidiAI-and-MNN/Build_the_MNN_Android_Demo_with_GUI.md
+8-21Lines changed: 8 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -24,7 +24,7 @@ Open up a Windows PowerShell or Git Bash and checkout the source tree:
@@ -33,28 +33,15 @@ The app code is currently not merged into the MNN repo. The repo above is a fork
33
33
34
34
## Build the app using Android Studio
35
35
36
-
Create a signing.gradle file at android/app with the following template:
37
-
```shell
38
-
ext{
39
-
signingConfigs = [
40
-
release: [
41
-
storeFile: file('PATH_TO_jks_file'),
42
-
storePassword: "****",
43
-
keyAlias: "****",
44
-
keyPassword: "****"
45
-
]
46
-
]
47
-
}
48
-
```
36
+
Open Android Studio
49
37
50
-
If you don't need to compile a release version of the app, you can skip the following step of creating a sign file and write anything in the signing.gradle.
38
+
- Navigate to **Open**.
39
+
- Browse the folder to the MNN/transformers/llm/engine/android, it will be android icon as picture show,
40
+
- Press **OK** to load the android project
41
+
- Wait for a while till the Gradle sync finish
51
42
52
-
- Navigate to **Build -> Generate Signed App Bundle or APK**.
53
-
- Select **APK** and click **next**.
54
-
- Press **Create new** and fill in the information..
55
-
- Fill in the information of the newly generated JKS file in the template above.
43
+
56
44
57
-
Open the MNN/transformers/llm/engine/android directory with Android Studio and wait for the Gradle project sync to finish.
58
45
59
46
## Prepare the model
60
47
You can download the model from ModelScope : https://www.modelscope.cn/models/qwen/qwen2-vl-2b-instruct
- --sym: the quantization parameter, means symmetrical quantization.
80
67
81
68
## Build and run the app
82
-
Before launching the app, you need to push the model into the device manually:
69
+
Before launching the app, you need to push the model into the device manually, connect the android device with the host PC with usb, and make sure the USB debugging is enable in the android device:
title: What is Arm Accuracy Super Resolution (Arm ASR)?
2
+
title: What is Arm Accuracy Super Resolution?
3
3
weight: 2
4
4
5
5
### FIXED, DO NOT MODIFY
@@ -8,43 +8,49 @@ layout: learningpathall
8
8
9
9
## Introduction
10
10
11
-
[Arm® Accuracy Super Resolution™ (Arm ASR)](https://www.arm.com/developer-hub/mobile-graphics-and-gaming/accuracy-super-resolution) is a mobile-optimized temporal upscaling technique derived from [AMD's Fidelity Super Resolution 2 v2.2.2](https://github.com/GPUOpen-LibrariesAndSDKs/FidelityFX-SDK/blob/main/docs/techniques/super-resolution-temporal.md). Arm ASR extends this technology with multiple optimizations to make the technique suited for the more resource-constrained environment of mobile gaming.
11
+
[Arm® Accuracy Super Resolution™ (Arm ASR)](https://www.arm.com/developer-hub/mobile-graphics-and-gaming/accuracy-super-resolution) is a mobile-optimized temporal upscaling technique derived from [AMD's Fidelity Super Resolution 2 v2.2.2](https://github.com/GPUOpen-LibrariesAndSDKs/FidelityFX-SDK/blob/main/docs/techniques/super-resolution-temporal.md).
12
12
13
-
Available as an easy plug-in for Unreal Engine 5.3, 5,4, and 5.5, a Unity plugin coming soon, or as a generic library that you can integrate into other engines, you can easily improve frames per second, enhance visual quality, and prevent thermal throttling for smoother, longer gameplay.
13
+
Arm ASR extends this technology with optimizations suited to the resource-constrained environment of mobile gaming.
14
+
15
+
Arm ASR is currently available as an easy-to-integrate plug-in for Unreal Engine versions 5.3, 5.4, and 5.5, with a Unity plugin coming soon. It is also available as a generic library that you can integrate into other engines.
16
+
17
+
Using ASR, you can improve frames per second (FPS), enhance visual quality, and prevent thermal throttling for smoother and longer gameplay.
14
18
15
19
## What is Super Resolution?
16
20
17
-
Super-resolution techniques render some frames at a lower resolution and use shader upscaling to reconstruct how the frames should look at native resolution. This offers significant performance and battery life improvements for mobile devices.
21
+
Super Resolution techniques render frames at a lower resolution and apply shader-based upscaling to reconstruct how the frames should look at native resolution. This approach significantly improves performance and extends battery life on mobile devices.
18
22
19
23
Arm ASR outperforms spatial upscalers when reconstructing fine details, such as:
20
24
21
-
- Thin features
22
-
- Grid-like structures
23
-
- Fast-moving objects
25
+
- Thin features.
26
+
- Grid-like structures.
27
+
- Fast-moving objects.
24
28
25
-
You can control a range of different settings for Arm ASR:
29
+
You have control over a range of different settings, including:
26
30
27
-
- The upscaling ratio. For example, a value of 50.0 will mean that the plugin upscales frames by a factor of 2.
28
-
- Use Arm ASR’s own auto-exposure or use the game engine’s auto-exposure value.
29
-
-Use a Robust Contrast Adaptive Sharpening (RCAS) filter to sharpen the output image.
The [Arm ASR experience kit](https://github.com/arm/accuracy-super-resolution) is a combination of materials that provide access to the technology, to help you evaluate it and make the best use of it. It includes:
38
+
The [Arm ASR Experience Kit](https://github.com/arm/accuracy-super-resolution) provides resources to help you evaluate and effectively utilize this technology.
39
+
40
+
It includes:
35
41
36
-
-The Arm ASR source code so developers can access it fully and even evolve the technology for their needs.
37
-
- Tutorials and sample materials to help developers with the integration of the technology and how to use it.
38
-
- Plugin for Unreal Engine.
42
+
- Arm ASR source code, which provides developers with the full access and the flexibility to evolve the technology for their needs.
43
+
- Tutorials and sample materials to simplify integration and usage.
44
+
- Plugin support for Unreal Engine.
39
45
40
46
## Unreal Engine Plugin
41
47
42
-
The Unreal Engine 5 plugin can be integrated into your project in a matter of minutes. Once installed, simply enable temporal upscaling on your project and the plugin will automatically handle the upscaling of all frames.
48
+
The Arm ASR plugin for Unreal Engine 5 integrates into your project within minutes. Once installed, simply enable temporal upscaling, and the plugin automatically handles frame upscaling.
43
49
44
-
[Using Arm ASR in Unreal Engine](../03-ue)
50
+
See [Using Arm ASR in Unreal Engine](../03-ue).
45
51
46
-
## Custom engine usage
52
+
## Custom Engine Usage
47
53
48
-
If you are using your own custom engine, you can still integrate Arm ASR using our generic library.
54
+
If you are using your own custom engine, integrate Arm ASR using our generic library.
49
55
50
-
[Using Arm ASR in a custom engine](../04-generic_library)
56
+
See [Using Arm ASR in a custom engine](../04-generic_library).
Copy file name to clipboardExpand all lines: content/learning-paths/mobile-graphics-and-gaming/get-started-with-arm-asr/02-ue.md
+52-33Lines changed: 52 additions & 33 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,87 +7,104 @@ layout: learningpathall
7
7
---
8
8
9
9
10
-
## Introduction
10
+
## Objective
11
11
12
-
This guide describes how to get started with Arm® Accuracy Super Resolution™ (Arm ASR) through an example project in Unreal Engine. It is for Unreal Engine developers who want to apply upscaling techniques to their projects. You will walk through the processes of installing Arm ASR and some of the common tasks that you might encounter when setting up Arm ASR for the first time.
12
+
This Learning Path describes how to get started with Arm® Accuracy Super Resolution™ (Arm ASR) using an example project in Unreal Engine.
13
+
14
+
It is for Unreal Engine developers who want to apply upscaling techniques to their projects.
15
+
16
+
You will walk through the processes of installing Arm ASR performing some of the common setup tasks.
13
17
14
18
## Before you begin
15
19
16
-
We recommend using Unreal Engine versions 5.3-5.5 through this tutorial. Please get in contact with us at [email protected] if you have any questions.
20
+
It is recommended that you use Unreal Engine versions 5.3-5.5 through this tutorial.
3. Navigate to the `UE` directory in the cloned repository. This contains directories containing the plugin for each supported version of Unreal Engine.
40
+
3. Navigate to the `UE` directory in the cloned repository.
41
+
42
+
This directory contains subfolders with plugins for each supported Unreal Engine version.
33
43
34
-
4. From the directory for your version of Unreal Engine, copy the Arm ASR plugin into the `Plugins` folder in the game directory.
44
+
4. From the directory for your version of Unreal Engine, copy the Arm ASR plugin into the `Plugins` folder in the game directory.
1. To enable Arm ASR upscaling, open **Project Settings** and change the Anti-Aliasing Method to **Temporal Anti-Aliasing**.
68
+
2. To enable Arm ASR upscaling, open **Project Settings** and set the **Anti-Aliasing Method** to **Temporal Anti-Aliasing**.
57
69
58
-
{{%notice%}}
59
-
**Mobile Anti-Aliasing Method** is used for the mobile renderer, however this tutorial describes the desktop renderer. You can learn about other available renderers by studying the `README.md` of the `accuracy-super-resolution-for-unreal` repository.
60
-
{{%/notice%}}
70
+
{{%notice%}}
71
+
**Mobile Anti-Aliasing Method** is used for the mobile renderer, however this Learning Path uses the desktop renderer. For information about other available renderers, see the `README.md` in the `accuracy-super-resolution-for-unreal` repository.
63
75
64
-
1. To check that Arm ASR is enabled and working, use the `ShowFlag.VisualizeTemporalUpscaler 1` console command. If Arm ASR is working, you will see Arm ASR listed as the **ThirdParty TemporalUpscaler** in the command window.
76
+
3. To verify that Arm ASR is enabled and active, use the `ShowFlag.VisualizeTemporalUpscaler 1` console command.
77
+
78
+
{{%notice%}}
79
+
The debug views produced by this command are generated by Unreal Engine's TAA, not directly by Arm ASR.{{%/notice%}}
65
80
66
-
{{% notice %}}
67
-
When you use the `ShowFlag.VisualizeTemporalUpscaler 1` console command, the debug views are not generated from Arm ASR but from Unreal Engines TAA.
68
-
{{% /notice %}}
81
+
If Arm ASR is active, you will see Arm ASR listed as the **ThirdParty TemporalUpscaler** in the console window.
For example, you can change the upscaling ratio by modifying the **ScreenPercentage**, via the command option `r.ScreenPercentage`. A value of `50.0` will mean that the plugin upscales frames by a factor of 2.
105
+
For example, you can change the upscaling ratio by modifying the **ScreenPercentage**, through the command option `r.ScreenPercentage`. A value of `50.0` means frames are upscaled by a factor of 2.
89
106
90
-
Arm ASR's behavior can be configured via the following plugin-specific console variables:
107
+
You can configure Arm ASR's behavior through the following plugin-specific console variables:
91
108
92
109
|Console Variable | Default Value | Value Range | Details |
@@ -112,4 +129,6 @@ Arm ASR's behavior can be configured via the following plugin-specific console v
112
129
113
130
## Next steps
114
131
115
-
You are now ready to use Arm ASR in your Unreal Engine projects. You can use [Arm Performance Studio](https://developer.arm.com/Tools%20and%20Software/Arm%20Performance%20Studio) tools to measure the performance of your game as it runs on a mobile device, allowing you to monitor the effect of Arm ASR.
132
+
You are now ready to use Arm ASR in your Unreal Engine projects.
133
+
134
+
You can use [Arm Performance Studio](https://developer.arm.com/Tools%20and%20Software/Arm%20Performance%20Studio) tools to measure the performance of your game as it runs on a mobile device, allowing you to monitor the effect of Arm ASR.
0 commit comments