You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/groot.mdx
+14-14Lines changed: 14 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
-
# Gr00t N1.5 Policy
1
+
# GR00T N1.5 Policy
2
2
3
-
Gr00t N1.5 is an open foundation model from NVIDIA designed for generalized humanoid robot reasoning and skills. It is a cross-embodiment model that accepts multimodal input, including language and images, to perform manipulation tasks in diverse environments.
3
+
GR00T N1.5 is an open foundation model from NVIDIA designed for generalized humanoid robot reasoning and skills. It is a cross-embodiment model that accepts multimodal input, including language and images, to perform manipulation tasks in diverse environments.
4
4
5
5
This document outlines the specifics of its integration and usage within the LeRobot framework.
6
6
@@ -22,7 +22,7 @@ This approach allows the model to be highly adaptable through post-training for
22
22
23
23
## Installation Requirements
24
24
25
-
As of today, Gr00t N1.5 requires flash attention for it's internal working.
25
+
As of today, GR00T N1.5 requires flash attention for it's internal working.
26
26
27
27
We are working on making this optional, but in the meantime that means that we require an extra installation step and it can only be used in CUDA enabled devices.
28
28
@@ -45,7 +45,7 @@ pip install lerobot[groot] # consider also installing libero,dev and test tags
45
45
46
46
## Usage
47
47
48
-
To use Gr00t in your LeRobot configuration, specify the policy type as:
48
+
To use GR00T in your LeRobot configuration, specify the policy type as:
49
49
50
50
```python
51
51
policy.type=groot
@@ -55,7 +55,7 @@ policy.type=groot
55
55
56
56
### Training Command Example
57
57
58
-
Here's a complete training command for finetuning the base Gr00t model on your own dataset:
58
+
Here's a complete training command for finetuning the base GR00T model on your own dataset:
59
59
60
60
```bash
61
61
# Using a multi-GPU setup
@@ -83,20 +83,20 @@ accelerate launch \
83
83
84
84
### Libero Benchmark Results
85
85
86
-
Gr00t has demonstrated strong performance on the Libero benchmark suite. To compare and test its LeRobot implementation, we finetuned the Gr00t N1.5 model for 20k steps on the Libero dataset and compared the results to the Gr00t reference results.
86
+
GR00T has demonstrated strong performance on the Libero benchmark suite. To compare and test its LeRobot implementation, we finetuned the GR00T N1.5 model for 30k steps on the Libero dataset and compared the results to the GR00T reference results.
These results demonstrate Gr00t's strong generalization capabilities across diverse robotic manipulation tasks. To reproduce these results, you can follow the instructions in the [Libero](https://huggingface.co/docs/lerobot/libero) section.
95
+
These results demonstrate GR00T's strong generalization capabilities across diverse robotic manipulation tasks. To reproduce these results, you can follow the instructions in the [Libero](https://huggingface.co/docs/lerobot/libero) section.
96
96
97
97
### Evaluate in your hardware setup
98
98
99
-
Once you have trained your model using your parameters you can run inference in your downstream task. Follow our by following for the downstream hardware task, you can follow our instructions in [Imitation Learning for Robots](./il_robots). For example:
99
+
Once you have trained your model using your parameters you can run inference in your downstream task. Follow the instructions in [Imitation Learning for Robots](./il_robots). For example:
100
100
101
101
```bash
102
102
lerobot-record \
@@ -119,4 +119,4 @@ lerobot-record \
119
119
120
120
## License
121
121
122
-
This model follows the **Apache 2.0 License**, consistent with the original [Gr00t repository](https://github.com/NVIDIA/Isaac-GR00T).
122
+
This model follows the **Apache 2.0 License**, consistent with the original [GR00T repository](https://github.com/NVIDIA/Isaac-GR00T).
0 commit comments