Skip to content

Request for evaluation data: User instruction dataset and evaluation details #8

@addressclip

Description

@addressclip

Hi, thanks for the great work!

I'm trying to reproduce the evaluation results in the paper, specifically the experiments on user instructions.

I have a few questions:

  1. Instruction dataset release: Are there plans to release the full set of 87 user instructions used for evaluation? This would be very helpful for fair comparison and reproducibility.
  2. Evaluation protocol details: relation between the instructions and 8 hm3d datasets?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions