Skip to content

fix(examples): resolve broken paths in MDIL-SS configuration #366

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
krrish175-byte wants to merge 1 commit into
base: main
Choose a base branch
from
Open

fix(examples): resolve broken paths in MDIL-SS configuration #366

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions ...bot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/benchmarkingjob.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ benchmarkingjob:

# the url address of test environment configuration file; string type;
# the file format supports yaml/yml;
testenv: "./examples/class_increment_semantic_segmentation/lifelong_learning_bench/testenv/testenv.yaml"
testenv: "./examples/robot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/testenv/testenv.yaml"

# the configuration of test object
test_object:
Expand All @@ -19,7 +19,7 @@ benchmarkingjob:
- name: "erfnet_lifelong_learning"
# the url address of test algorithm configuration file; string type;
# the file format supports yaml/yml
url: "./examples/class_increment_semantic_segmentation/lifelong_learning_bench/testalgorithms/erfnet/test_algorithm.yaml"
url: "./examples/robot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/testalgorithms/erfnet/test_algorithm.yaml"

# the configuration of ranking leaderboard
rank:
Expand Down
6 changes: 3 additions & 3 deletions ...a/lifelong_learning_bench/semantic-segmentation/testalgorithms/erfnet/test_algorithm.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ algorithm:
# example: basemodel.py has BaseModel module that the alias is "FPN" for this benchmarking;
name: "BaseModel"
# the url address of python module; string type;
url: "./examples/class_increment_semantic_segmentation/lifelong_learning_bench/testalgorithms/erfnet/basemodel.py"
url: "./examples/robot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/testalgorithms/erfnet/basemodel.py"
# hyperparameters configuration for the python module; list type;
hyperparameters:
# name of the hyperparameter; string type;
Expand All @@ -40,7 +40,7 @@ algorithm:
# name of python module; string type;
name: "TaskDefinitionByDomain"
# the url address of python module; string type;
url: "./examples/class_increment_semantic_segmentation/lifelong_learning_bench/testalgorithms/erfnet/task_definition_by_domain.py"
url: "./examples/robot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/testalgorithms/erfnet/task_definition_by_domain.py"
# hyperparameters configuration for the python module; list type;
hyperparameters:
# name of the hyperparameter; string type;
Expand All @@ -53,7 +53,7 @@ algorithm:
# name of python module; string type;
name: "TaskAllocationByDomain"
# the url address of python module; string type;
url: "./examples/class_increment_semantic_segmentation/lifelong_learning_bench/testalgorithms/erfnet/task_allocation_by_domain.py"
url: "./examples/robot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/testalgorithms/erfnet/task_allocation_by_domain.py"
# hyperparameters configuration for the python module; list type;
hyperparameters:
# name of the hyperparameter; string type;
Expand Down
8 changes: 4 additions & 4 deletions ...bot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/testenv/testenv.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@ testenv:
# dataset configuration
dataset:
# the url address of train dataset index; string type;
train_url: "/home/QXY/dataset/mdil-ss/train/mdil-ss-train-index-small.txt"
train_url: "./dataset/mdil-ss/train/mdil-ss-train-index-small.txt"
# the url address of test dataset index; string type;
test_url: "/home/QXY/dataset/mdil-ss/test/mdil-ss-test-index-small.txt"
test_url: "./dataset/mdil-ss/test/mdil-ss-test-index-small.txt"

# model eval configuration of incremental learning;
model_eval:
Expand All @@ -13,7 +13,7 @@ testenv:
# metric name; string type;
name: "accuracy"
# the url address of python file
url: "./examples/class_increment_semantic_segmentation/lifelong_learning_bench/testenv/accuracy.py"
url: "./examples/robot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/testenv/accuracy.py"
mode: "no-inference"

# condition of triggering inference model to update
Expand All @@ -28,7 +28,7 @@ testenv:
# metric name; string type;
- name: "accuracy"
# the url address of python file
url: "./examples/class_increment_semantic_segmentation/lifelong_learning_bench/testenv/accuracy.py"
url: "./examples/robot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/testenv/accuracy.py"
Copy link

@gemini-code-assist gemini-code-assist bot Feb 20, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The URL for accuracy.py is duplicated here and on line 16. To improve maintainability and avoid potential inconsistencies in the future, you could use YAML anchors and aliases to define this URL once and reference it in both places.

For example:

x-accuracy-url: &accuracy_url "./examples/robot-cityscapes-synthia/lifelong_learning_bench/semantic-segmentation/testenv/accuracy.py"

testenv:
  # ...
  model_eval:
    model_metric:
      # ...
      url: *accuracy_url
  # ...
  metrics:
    - name: "accuracy"
      url: *accuracy_url
    # ...

- name: "samples_transfer_ratio"
- name: "task_avg_acc"
- name: "BWT"
Expand Down