Panoptic Seg With Custom Dataset

[Viky397]

I am trying to register a custom panoptic dataset that I've put into the appropriate COCO format following here.

However, when I go to train, I get the following error:

assert "sem_seg" in batched_inputs[0] AssertionError

I am curious if my registration process is incorrect. I use:

for d in ["test"]:

    DatasetCatalog.register(
        "dataset_" + d,
        lambda d=d: load_coco_panoptic_json("/path/test/" + d + ".json"),
    )
    MetadataCatalog.get("dataset_" + d).set(
        panoptic_root="/path/image_panoptic",
        image_root="/path/image_raw",
        panoptic_json="/patht/" + d + ".json",
        json_file="/path/" + d + ".json",
        evaluator_type="coco_panoptic_seg",
        ignore_label=255,
        label_divisor=1000,
        **{},
    )

And the following is the format of the annotations:

{"annotations": [{"image_id": 3234, 
    "file_name": "/path/source_image.jpg", 
    "height": 964,
    "width": 1288,
    "segments_info": 
    [{"id": 0, "category_id": 11, "area": 109980, "bbox": [407, 99, 234, 470], "iscrowd": 0}, 
    {"id": 1, "category_id": 4, "area": 609966, "bbox": [0, 0, 927, 658], "iscrowd": 0}, 
    {"id": 2, "category_id": 6, "area": 441504, "bbox": [531, 0, 756, 584], "iscrowd": 0}, 
    {"id": 3, "category_id": 11, "area": 33583, "bbox": [273, 98, 71, 473], "iscrowd": 0}, 
    {"id": 4, "category_id": 0, "area": 583011, "bbox": [0, 510, 1287, 453], "iscrowd": 0}, 
    {"id": 5, "category_id": 11, "area": 25024, "bbox": [281, 297, 92, 272], "iscrowd": 0}, 
    {"id": 6, "category_id": 11, "area": 100794, "bbox": [617, 110, 314, 321], "iscrowd": 0}, 
    {"id": 7, "category_id": 8, "area": 206955, "bbox": [565, 14, 365, 567], "iscrowd": 0}, 
    {"id": 8, "category_id": 5, "area": 37922, "bbox": [544, 0, 67, 566], "iscrowd": 0}, 
    {"id": 9, "category_id": 12, "area": 224450, "bbox": [707, 0, 335, 670], "iscrowd": 0}, 
    {"id": 10, "category_id": 3, "area": 536962, "bbox": [0, 0, 929, 578], "iscrowd": 0}], 
    "pan_seg_file_name": "/path/image_panoptic/000003233.jpg"}]}

[zhangliyun9120]

Do you started the panoptic training? if did can you share some code structure? thank you!

[sushmasuresh28]

I am also blocked by a similar issue. If you were able to figure it out, could you please let me know how you got it to work?

[zhangliyun9120]

#1691 (comment)