Skip to content

Commit ca31aba

Browse files
committed
Update NSS model training gym LP
1 parent 9a03b72 commit ca31aba

File tree

4 files changed

+7
-7
lines changed

4 files changed

+7
-7
lines changed

content/learning-paths/mobile-graphics-and-gaming/model-training-gym/1-introduction.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -12,11 +12,11 @@ Neural graphics is an intersection of graphics and machine learning. Rather than
1212

1313
## How does Arm support neural graphics?
1414

15-
Arm enables neural graphics through the **Neural Graphics Development Kit**: a set of open-source tools that let developers train, evaluate, and deploy ML models for graphics workloads.
15+
Arm enables neural graphics through the [**Neural Graphics Development Kit**](https://developer.arm.com/mobile-graphics-and-gaming/neural-graphics): a set of open-source tools that let developers train, evaluate, and deploy ML models for graphics workloads.
1616

1717
At its core are the ML Extensions for Vulkan, which bring native ML inference into the GPU pipeline using structured compute graphs. These extensions (`VK_ARM_tensors` and `VK_ARM_data_graph`) allow real-time upscaling and similar effects to run efficiently alongside rendering tasks.
1818

19-
The neural graphics models can be developed using well-known ML frameworks like **PyTorch**, and exported to deployment using Arm's hardware-aware pipeline. The workflow converts .pt model weights to `.vgf` via the TOSA intermediate representation, making it possible to do tailored model development for you game use-case. This Learning Path focuses on **Neural Super Sampling (NSS)** as the use case for training, evaluating, and deploying neural models using a toolkit called the **Neural Graphics Model Gym**.
19+
The neural graphics models can be developed using well-known ML frameworks like **PyTorch**, and exported to deployment using Arm's hardware-aware pipeline. The workflow converts the model to `.vgf` via the TOSA intermediate representation, making it possible to do tailored model development for you game use-case. This Learning Path focuses on **Neural Super Sampling (NSS)** as the use case for training, evaluating, and deploying neural models using a toolkit called the [**Neural Graphics Model Gym**](https://github.com/arm/neural-graphics-model-gym). To learn more about NSS, you can check out the [resources on Hugging Face](https://huggingface.co/Arm/neural-super-sampling).
2020

2121
Starting in 2026, Arm GPUs will feature dedicated neural accelerators, optimized for low-latency inference in graphics workloads. To help developers get started early, Arm provides the ML Emulation Layers for Vulkan that simulate future hardware behavior, so you can build and test models now.
2222

@@ -29,7 +29,7 @@ The Neural Graphics Model Gym is an open-source toolkit for fine-tuning and expo
2929
Model Gym gives you:
3030

3131
- A training and evaluation API built on PyTorch
32-
- Model export to .vgf for real-time use in game development
32+
- Model export to .vgf using ExecuTorch for real-time use in game development
3333
- Support for quantization-aware training (QAT) and post-training quantization (PTQ) using ExecuTorch
3434
- Optional Docker setup for reproducibility
3535

content/learning-paths/mobile-graphics-and-gaming/model-training-gym/3-model-training.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ weight: 4
66
layout: learningpathall
77
---
88

9-
In this section, you'll get hands-on with how you can use the model gym to train your own models, or fine-tune the NSS use-case.
9+
In this section, you'll get hands-on with how you can use the model gym to fine-tune the NSS use-case.
1010

1111
## About NSS
1212

@@ -54,7 +54,7 @@ neural-graphics-model-gym-examples/model_training_example.ipynb
5454

5555
Step through the notebook for training.
5656

57-
Once your model is trained, the next step is evaluation. You'll measure accuracy, compare checkpoints, and prepare the model for export. Open the evaluation notebook.
57+
Once your model is trained, the next step is evaluation. You'll measure accuracy, compare checkpoints, and prepare the model for export. Open the evaluation notebook located at the following location:
5858

5959
```output
6060
neural-graphics-model-gym-examples/model_evaluation_example.ipynb

content/learning-paths/mobile-graphics-and-gaming/model-training-gym/4-model-explorer.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,4 +56,4 @@ Use the file browser to open the `.vgf` model exported earlier in your training
5656

5757
Through this Learning Path, you’ve learned what neural graphics is and why it matters for game performance. You’ve stepped through the process of training and evaluating an NSS model using PyTorch and the Model Gym, and seen how to export that model into VGF (.vgf) for real-time deployment. You’ve also explored how to visualize and inspect the model’s structure using Model Explorer.
5858

59-
As a next step, you can head over to the [Model Training Gym repository](https://github.com/arm/neural-graphics-model-gym/tree/main) and explore the documentation to explore integration into your own game development workflow. You’ll find resources on fine-tuning, deeper details about the training and export process, and everything you need to adapt to your own content and workflows.
59+
As a next step, you can head over to the [Model Training Gym repository](https://github.com/arm/neural-graphics-model-gym/tree/main) documentation to explore integration into your own game development workflow. You’ll find resources on fine-tuning, deeper details about the training and export process, and everything you need to adapt to your own content and workflows.

content/learning-paths/mobile-graphics-and-gaming/model-training-gym/_index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ learning_objectives:
99
- Understand the principles of neural graphics and how it’s applied to game performance
1010
- Learn how to fine-tune and evaluate a neural network for Neural Super Sampling (NSS)
1111
- Use the Model Gym Python API and CLI to configure and train neural graphics models
12-
- Visualize and inspect models using the Model Explorer tool
12+
- Visualize and inspect `.vgf` models using the Model Explorer tool
1313

1414
prerequisites:
1515
- Basic understanding of PyTorch and machine learning concepts

0 commit comments

Comments
 (0)