./tools/infer_kie_token_ser_re.py 预测报错AttributeError: 'bool' object has no attribute 'sum'

[nikooooooooooooooooooo]

https://github.com/PaddlePaddle/PaddleOCR/blob/main/doc/doc_ch/kie.md#31-%E6%8C%87%E6%A0%87%E8%AF%84%E4%BC%B0
执行章节3.2，预测脚本如下

python3 ./tools/infer_kie_token_ser_re.py \
  -c configs/kie/vi_layoutxlm/re_vi_layoutxlm_xfund_zh.yml \
  -o Architecture.Backbone.checkpoints=./pretrained_model/re_vi_layoutxlm_xfund_pretrained/best_accuracy \
  Global.infer_img=./train_data/XFUND/zh_val/image/zh_val_42.jpg \
  -c_ser configs/kie/vi_layoutxlm/ser_vi_layoutxlm_xfund_zh.yml \
  -o_ser Architecture.Backbone.checkpoints=./pretrained_model/ser_vi_layoutxlm_xfund_pretrained/best_accuracy

报错信息如下

[2024-05-31 06:04:22,263] [    INFO] - Loading configuration file ./pretrained_model/re_vi_layoutxlm_xfund_pretrained/best_accuracy/config.json
[2024-05-31 06:04:22,264] [    INFO] - Loading weights file ./pretrained_model/re_vi_layoutxlm_xfund_pretrained/best_accuracy/model_state.pdparams
[2024-05-31 06:04:23,577] [    INFO] - Loaded weights file from disk, setting weights to model.
[2024-05-31 06:04:25,640] [    INFO] - All model checkpoint weights were used when initializing LayoutXLMForRelationExtraction.

[2024-05-31 06:04:25,640] [    INFO] - All the weights of LayoutXLMForRelationExtraction were initialized from the model checkpoint at ./pretrained_model/re_vi_layoutxlm_xfund_pretrained/best_accuracy.
If your task is similar to the task the model of the checkpoint was trained on, you can already use LayoutXLMForRelationExtraction for predictions without further training.
[2024/05/31 06:04:25] ppocr INFO: resume from ./pretrained_model/re_vi_layoutxlm_xfund_pretrained/best_accuracy
Corrupt JPEG data: premature end of data segment
Traceback (most recent call last):
  File "/PaddleOCR/./tools/infer_kie_token_ser_re.py", line 216, in <module>
    result = ser_re_engine(data)
  File "/PaddleOCR/./tools/infer_kie_token_ser_re.py", line 151, in __call__
    preds = self.model(re_input)
  File "/usr/local/lib/python3.10/dist-packages/paddle/nn/layer/layers.py", line 1429, in __call__
    return self.forward(*inputs, **kwargs)
  File "/PaddleOCR/ppocr/modeling/architectures/base_model.py", line 85, in forward
    x = self.backbone(x)
  File "/usr/local/lib/python3.10/dist-packages/paddle/nn/layer/layers.py", line 1429, in __call__
    return self.forward(*inputs, **kwargs)
  File "/PaddleOCR/ppocr/modeling/backbones/vqa_layoutlm.py", line 248, in forward
    x = self.model(
  File "/usr/local/lib/python3.10/dist-packages/paddle/nn/layer/layers.py", line 1429, in __call__
    return self.forward(*inputs, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/paddlenlp/transformers/layoutxlm/modeling.py", line 1329, in forward
    loss, pred_relations = self.extractor(sequence_output, entities, relations)
  File "/usr/local/lib/python3.10/dist-packages/paddle/nn/layer/layers.py", line 1429, in __call__
    return self.forward(*inputs, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/paddlenlp/transformers/layoutxlm/modeling.py", line 1223, in forward
    relations, entities = self.build_relation(relations, entities)
  File "/usr/local/lib/python3.10/dist-packages/paddlenlp/transformers/layoutxlm/modeling.py", line 1189, in build_relation
    if negative_mask.sum() > 0:
AttributeError: 'bool' object has no attribute 'sum'

[nikooooooooooooooooooo]

#11844
#11793
#11539
根据issues提示，尝试了不同版本的paddlenlp，还是报错

[nikooooooooooooooooooo]

@UserWangZz 大佬，有时间帮忙看下吗？

[UserWangZz]

报错位置在paddlenlp/transformers/layoutxlm/modeling.py的这个文件，目测报错问题可能是negative_mask变量应该为一个list or array，但是不知什么原因变成了bool类型，可以去paddlenlp仓库问问，或者debug查看更详细的原因

[UserWangZz]

Corrupt JPEG data: premature end of data segment
log中还有一个信息需要参考，提示检测jpg又问题，可以尝试更换推理图片试试

[nikooooooooooooooooooo]

非常感谢，我再排查一下

[GreatV]

可以参考一下

• 按照教程将SER+RE串联执行，代码报错 argument 'x' (position 0) must be list of Tensors, but got empty list #12570