Skip to content

Commit 61444f6

Browse files
committed
added vision categories and updated label.py
1 parent 8c68700 commit 61444f6

File tree

4 files changed

+533
-15
lines changed

4 files changed

+533
-15
lines changed

fastchat/serve/monitor/classify/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,8 @@ To test your new classifier for a new category, you would have to make sure you
2929
python label.py --config config.yaml --testing
3030
```
3131

32+
If you are labeling a vision category, add the `--vision` flag to the command. This will add a new column to the input data called `image_path` that contains the path to the image corresponding to each conversation. Ensure that you update your config with the correct `image_dir` where the images are stored.
33+
3234
Then, add your new category bench to `tag_names` in `display_score.py`. After making sure that you also have a correctly formatted ground truth json file, you can report the performance of your classifier by running
3335
```console
3436
python display_score.py --bench <your_bench>

0 commit comments

Comments
 (0)