Skip to content

Commit 36fa5de

Browse files
committed
[doc] update score of Dexterous & Precise, add more examples of
1 parent 8b89f2d commit 36fa5de

8 files changed

Lines changed: 49 additions & 21 deletions

File tree

src/content/docs/de/evaluation/run-benchmark.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,11 @@ Verfuegbare Aufgabeneinstellungen:
3333

3434
Splits: `val_train`, `val_unseen`, `test`
3535

36-
Alle Aufgaben auf einmal einreichen: `gmp submit ebench --run_id full_run`.
36+
Beispiele:
37+
38+
1. Alle Aufgaben auf einmal einreichen: `gmp submit ebench --run_id full_run`.
39+
2. Alle Evaluationsaufgaben in `mobile_manip` einreichen: `gmp submit ebench/mobile_manip/test --run_id evaluate_mobile_manip`.
40+
3. Die Evaluationsaufgabe `collect_coffee_beans` in `table_top_manip` einreichen: `gmp submit ebench/table_top_manip/test/collect_coffee_beans --run_id evaluate_only_one_task`.
3741

3842
## 3. Modell verbinden
3943

src/content/docs/es/evaluation/run-benchmark.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,11 @@ Configuraciones de tareas disponibles:
3333

3434
Splits: `val_train`, `val_unseen`, `test`
3535

36-
Envía todas las tareas a la vez con `gmp submit ebench --run_id full_run`.
36+
Ejemplos:
37+
38+
1. Enviar todas las tareas de una vez: `gmp submit ebench --run_id full_run`.
39+
2. Enviar todas las tareas de evaluación de `mobile_manip`: `gmp submit ebench/mobile_manip/test --run_id evaluate_mobile_manip`.
40+
3. Enviar la tarea de evaluación `collect_coffee_beans` de `table_top_manip`: `gmp submit ebench/table_top_manip/test/collect_coffee_beans --run_id evaluate_only_one_task`.
3741

3842
## 3. Conectar tu modelo
3943

src/content/docs/evaluation/run-benchmark.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,11 @@ Available task settings:
3333

3434
Splits: `val_train`, `val_unseen`, `test`
3535

36-
Submit all tasks at once with `gmp submit ebench --run_id full_run`.
36+
Examples:
37+
38+
1. Submit all tasks at once: `gmp submit ebench --run_id full_run`.
39+
2. Submit all evaluation tasks in `mobile_manip`: `gmp submit ebench/mobile_manip/test --run_id evaluate_mobile_manip`.
40+
3. Submit `collect_coffee_beans` in `table_top_manip`: `gmp submit ebench/table_top_manip/test/collect_coffee_beans --run_id evaluate_only_one_task`.
3741

3842
## 3. Connect your model
3943

src/content/docs/fr/evaluation/run-benchmark.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,11 @@ Paramètres de tâche disponibles :
3333

3434
Splits : `val_train`, `val_unseen`, `test`
3535

36-
Soumettez toutes les tâches en une seule fois avec `gmp submit ebench --run_id full_run`.
36+
Exemples :
37+
38+
1. Soumettre toutes les tâches en une seule fois : `gmp submit ebench --run_id full_run`.
39+
2. Soumettre toutes les tâches d'évaluation de `mobile_manip` : `gmp submit ebench/mobile_manip/test --run_id evaluate_mobile_manip`.
40+
3. Soumettre la tâche d'évaluation `collect_coffee_beans` dans `table_top_manip` : `gmp submit ebench/table_top_manip/test/collect_coffee_beans --run_id evaluate_only_one_task`.
3741

3842
## 3. Connecter votre modèle
3943

src/content/docs/ja/evaluation/run-benchmark.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,11 @@ gmp submit ebench/mobile_manip/test --run_id my_first_run
3333

3434
スプリット:`val_train``val_unseen``test`
3535

36-
`gmp submit ebench --run_id full_run` で全タスクを一括送信できます。
36+
例:
37+
38+
1. 全タスクを一括送信:`gmp submit ebench --run_id full_run`
39+
2. `mobile_manip` の全評価タスクを送信:`gmp submit ebench/mobile_manip/test --run_id evaluate_mobile_manip`
40+
3. `table_top_manip``collect_coffee_beans` 評価タスクを送信:`gmp submit ebench/table_top_manip/test/collect_coffee_beans --run_id evaluate_only_one_task`
3741

3842
## 3. モデルの接続
3943

src/content/docs/ko/evaluation/run-benchmark.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,11 @@ gmp submit ebench/mobile_manip/test --run_id my_first_run
3333

3434
Split: `val_train`, `val_unseen`, `test`
3535

36-
모든 태스크를 한 번에 제출하려면 `gmp submit ebench --run_id full_run`을 사용하세요.
36+
예시:
37+
38+
1. 모든 태스크를 한 번에 제출: `gmp submit ebench --run_id full_run`.
39+
2. `mobile_manip`의 모든 평가 태스크 제출: `gmp submit ebench/mobile_manip/test --run_id evaluate_mobile_manip`.
40+
3. `table_top_manip``collect_coffee_beans` 평가 태스크 제출: `gmp submit ebench/table_top_manip/test/collect_coffee_beans --run_id evaluate_only_one_task`.
3741

3842
## 3. 모델 연결
3943

src/content/docs/zh-cn/evaluation/run-benchmark.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,11 @@ gmp submit ebench/mobile_manip/test --run_id my_first_run
3333

3434
Split:`val_train``val_unseen``test`
3535

36-
一次性提交所有任务:`gmp submit ebench --run_id full_run`
36+
示例:
37+
38+
1. 一次性提交所有任务:`gmp submit ebench --run_id full_run`
39+
2. 提交`mobile_manip`中所有评测任务:`gmp submit ebench/mobile_manip/test --run_id evaluate_mobile_manip`
40+
3. 提交`table_top_manip``collect_coffee_beans`的评测任务:`gmp submit ebench/table_top_manip/test/collect_coffee_beans --run_id evaluate_only_one_task`
3741

3842
## 3. 接入模型
3943

src/data/taskShowcase.ts

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -328,8 +328,8 @@ export const showcaseCategories: TaskCategory[] = [
328328
'zh-cn': '将散落的 coffee beans 收集到目标容器或区域中。',
329329
},
330330
score: {
331-
en: 'Each coffee bean placed in the jar contributes `0.5/7`. The total score is the sum over all seven beans.',
332-
'zh-cn': '每颗 coffee bean 成功进入 jar 记 `0.5/7`。总分为七颗豆子的得分之和。',
331+
en: 'The lid contributes `0.5` when it is placed on the jar, aligned near the jar axis, and parallel to the tabletop. Each of the seven coffee beans in the jar contributes `0.5/7`.',
332+
'zh-cn': '盖子放在罐子上、与罐子中心轴相近且平行于桌面时记 `0.5`。7 颗咖啡豆中,每颗进入罐子各记 `0.5/7`。',
333333
},
334334
},
335335
{
@@ -342,8 +342,8 @@ export const showcaseCategories: TaskCategory[] = [
342342
'zh-cn': '按任务要求翻转 cup,并完成 cookies 收集。',
343343
},
344344
score: {
345-
en: 'The cup contributes `0.5` when its opening faces upward and its center axis stays within 10 degrees of the world Z axis. Each cookie placed in the bowl contributes `0.5/5`.',
346-
'zh-cn': 'cup 杯口朝上且中心轴与世界坐标 Z 轴夹角在 10 度以内时记 `0.5`。每个 cookie 成功放入 bowl 各记 `0.5/5`。',
345+
en: 'The cup contributes `0.5` when its opening faces upward and its center axis is within 10 degrees of the world Z axis. Each of the five cookies in the bowl contributes `0.5/5`.',
346+
'zh-cn': '杯口朝上且杯子中心轴与 World Z axis 夹角在 10° 以内时记 `0.5`。5 块饼干中,每块放入碗内各记 `0.5/5`。',
347347
},
348348
},
349349
{
@@ -356,8 +356,8 @@ export const showcaseCategories: TaskCategory[] = [
356356
'zh-cn': '移动并对齐 frame,使其按要求贴靠在 pen holder 上。',
357357
},
358358
score: {
359-
en: 'Score `1.0` when the frame is upright, tightly leaning against the pen holder, and the frame normal stays within 45 degrees of the world Z axis.',
360-
'zh-cn': '当 frame 正向、紧贴 pen holder 倾斜放置,且 frame 法向量与世界坐标 Z 轴夹角在 45 度以内时,得分为 `1.0`。',
359+
en: 'Temporal condition 1 (prerequisite): the frame center stays above a required height (`1/3`). Temporal condition 2 (evaluated only after condition 1): the frame is in contact with the cup (`1/3`), and the frame stays in an upright leaning pose (`1/3`).',
360+
'zh-cn': '时序条件 1(前置判断):相框中心点保持一定高度,记 `1/3`。时序条件 2(满足上一条后再判断):相框接触杯子,记 `1/3`,相框保持正向斜靠姿态,记 `1/3`。',
361361
},
362362
},
363363
{
@@ -370,8 +370,8 @@ export const showcaseCategories: TaskCategory[] = [
370370
'zh-cn': '抓取 gear,并将其安装到目标轴或槽位上。',
371371
},
372372
score: {
373-
en: 'Score `1.0` when the operated gear is placed at the specified position and properly engaged with the other two gears.',
374-
'zh-cn': '当被操作的 gear 被放到指定位置,且与另外两个 gear 正确啮合时,得分为 `1.0`。',
373+
en: 'Placing the gear on the shaft contributes `0.5`. Properly meshing the gear with the other two gears contributes `0.5`.',
374+
'zh-cn': '齿轮放在轴上记 `0.5`;齿轮与另外两个齿轮耦合记 `0.5`。',
375375
},
376376
},
377377
{
@@ -384,8 +384,8 @@ export const showcaseCategories: TaskCategory[] = [
384384
'zh-cn': '以要求的精度将 peg 插入目标孔位。',
385385
},
386386
score: {
387-
en: 'Score `1.0` when the peg axis is aligned with the hole axis, inserted to the required depth, and remains vertical.',
388-
'zh-cn': '当 peg 中心轴与孔洞中心轴对齐、插入到要求深度,并保持竖直状态时,得分为 `1.0`。',
387+
en: 'Removing the peg from the original hole contributes `0.5`. Inserting the peg into the designated hole contributes `0.5`.',
388+
'zh-cn': '棍子离开原来孔洞记 `0.5`;棍子放入指定孔洞记 `0.5`。',
389389
},
390390
},
391391
{
@@ -398,8 +398,8 @@ export const showcaseCategories: TaskCategory[] = [
398398
'zh-cn': '小心抓取 glass,并将其放入 glass box 中。',
399399
},
400400
score: {
401-
en: 'Score `1.0` when the glasses are folded, placed inside the glasses box, and the box is closed. The folding angle must be within 20 degrees.',
402-
'zh-cn': '当眼镜被折叠、放入眼镜盒中且眼镜盒关闭时,得分为 `1.0`。镜腿折叠角度需在 20 度以内。',
401+
en: 'Folding both temples contributes `1/3`. Closing the glasses case contributes `1/3`. Placing the glasses in the case contributes `1/3`.',
402+
'zh-cn': '两个镜腿折叠记 `1/3`;眼镜盒闭合记 `1/3`;眼镜在盒中记 `1/3`。',
403403
},
404404
},
405405
{
@@ -412,8 +412,8 @@ export const showcaseCategories: TaskCategory[] = [
412412
'zh-cn': '完成 nut 的对齐与拧紧操作。',
413413
},
414414
score: {
415-
en: 'Score `1.0` when the nut is fully screwed onto the bolt.',
416-
'zh-cn': '当 nut 被完整旋入 bolt 时,得分为 `1.0`。',
415+
en: 'Temporal condition 1 (prerequisite): the nut is at the top end of the bolt (`0.5`). Temporal condition 2 (evaluated only after condition 1): the nut is fully tightened onto the bolt (`0.5`).',
416+
'zh-cn': '时序条件 1(前置判断):螺母位于螺栓上端,记 `0.5`。时序条件 2(满足上一条后再判断):螺母完全旋入螺栓,记 `0.5`。',
417417
},
418418
},
419419
],

0 commit comments

Comments
 (0)