[ WARNING] - file<https://bj.bcebos.com/paddlenlp/models/transformers/layoutxlm_base/sentencepiece.bpe.model> not exist

[turgutguvercin]

#> `[2025/02/08 11:43:51] ppocr WARNING: Skipping import of the encryption module.

[2025/02/08 11:43:51] ppocr INFO: Architecture :
[2025/02/08 11:43:51] ppocr INFO: Models :
[2025/02/08 11:43:51] ppocr INFO: Student :
[2025/02/08 11:43:51] ppocr INFO: Backbone :
[2025/02/08 11:43:51] ppocr INFO: checkpoints : None
[2025/02/08 11:43:51] ppocr INFO: mode : vi
[2025/02/08 11:43:51] ppocr INFO: name : LayoutXLMForSer
[2025/02/08 11:43:51] ppocr INFO: num_classes : 25
[2025/02/08 11:43:51] ppocr INFO: pretrained : True
[2025/02/08 11:43:51] ppocr INFO: Transform : None
[2025/02/08 11:43:51] ppocr INFO: algorithm : LayoutXLM
[2025/02/08 11:43:51] ppocr INFO: freeze_params : False
[2025/02/08 11:43:51] ppocr INFO: model_type : kie
[2025/02/08 11:43:51] ppocr INFO: pretrained : None
[2025/02/08 11:43:51] ppocr INFO: return_all_feats : True
[2025/02/08 11:43:51] ppocr INFO: Teacher :
[2025/02/08 11:43:51] ppocr INFO: Backbone :
[2025/02/08 11:43:51] ppocr INFO: checkpoints : None
[2025/02/08 11:43:51] ppocr INFO: mode : vi
[2025/02/08 11:43:51] ppocr INFO: name : LayoutXLMForSer
[2025/02/08 11:43:51] ppocr INFO: num_classes : 25
[2025/02/08 11:43:51] ppocr INFO: pretrained : True
[2025/02/08 11:43:51] ppocr INFO: Transform : None
[2025/02/08 11:43:51] ppocr INFO: algorithm : LayoutXLM
[2025/02/08 11:43:51] ppocr INFO: freeze_params : False
[2025/02/08 11:43:51] ppocr INFO: model_type : kie
[2025/02/08 11:43:51] ppocr INFO: pretrained : None
[2025/02/08 11:43:51] ppocr INFO: return_all_feats : True
[2025/02/08 11:43:51] ppocr INFO: algorithm : Distillation
[2025/02/08 11:43:51] ppocr INFO: model_type : kie
[2025/02/08 11:43:51] ppocr INFO: name : DistillationModel
[2025/02/08 11:43:51] ppocr INFO: Eval :
[2025/02/08 11:43:51] ppocr INFO: dataset :
[2025/02/08 11:43:51] ppocr INFO: data_dir : ./train_data/det
[2025/02/08 11:43:51] ppocr INFO: label_file_list : ['./train_data/det/val.txt']
[2025/02/08 11:43:51] ppocr INFO: name : SimpleDataSet
[2025/02/08 11:43:51] ppocr INFO: transforms :
[2025/02/08 11:43:51] ppocr INFO: DecodeImage :
[2025/02/08 11:43:51] ppocr INFO: channel_first : False
[2025/02/08 11:43:51] ppocr INFO: img_mode : RGB
[2025/02/08 11:43:51] ppocr INFO: VQATokenLabelEncode :
[2025/02/08 11:43:51] ppocr INFO: algorithm : LayoutXLM
[2025/02/08 11:43:51] ppocr INFO: class_path : train_data/XFUND/class_list_xfun.txt
[2025/02/08 11:43:51] ppocr INFO: contains_re : False
[2025/02/08 11:43:51] ppocr INFO: order_method : tb-yx
[2025/02/08 11:43:51] ppocr INFO: VQATokenPad :
[2025/02/08 11:43:51] ppocr INFO: max_seq_len : 512
[2025/02/08 11:43:51] ppocr INFO: return_attention_mask : True
[2025/02/08 11:43:51] ppocr INFO: VQASerTokenChunk :
[2025/02/08 11:43:51] ppocr INFO: max_seq_len : 512
[2025/02/08 11:43:51] ppocr INFO: Resize :
[2025/02/08 11:43:51] ppocr INFO: size : [224, 224]
[2025/02/08 11:43:51] ppocr INFO: NormalizeImage :
[2025/02/08 11:43:51] ppocr INFO: mean : [123.675, 116.28, 103.53]
[2025/02/08 11:43:51] ppocr INFO: order : hwc
[2025/02/08 11:43:51] ppocr INFO: scale : 1
[2025/02/08 11:43:51] ppocr INFO: std : [58.395, 57.12, 57.375]
[2025/02/08 11:43:51] ppocr INFO: ToCHWImage : None
[2025/02/08 11:43:51] ppocr INFO: KeepKeys :
[2025/02/08 11:43:51] ppocr INFO: keep_keys : ['input_ids', 'bbox', 'attention_mask', 'token_type_ids', 'image', 'labels']
[2025/02/08 11:43:51] ppocr INFO: loader :
[2025/02/08 11:43:51] ppocr INFO: batch_size_per_card : 8
[2025/02/08 11:43:51] ppocr INFO: drop_last : False
[2025/02/08 11:43:51] ppocr INFO: num_workers : 4
[2025/02/08 11:43:51] ppocr INFO: shuffle : False
[2025/02/08 11:43:51] ppocr INFO: Global :
[2025/02/08 11:43:51] ppocr INFO: cal_metric_during_train : False
[2025/02/08 11:43:51] ppocr INFO: distributed : False
[2025/02/08 11:43:51] ppocr INFO: epoch_num : 200
[2025/02/08 11:43:51] ppocr INFO: eval_batch_step : [0, 19]
[2025/02/08 11:43:51] ppocr INFO: infer_img : ppstructure/docs/kie/input/zh_val_42.jpg
[2025/02/08 11:43:51] ppocr INFO: log_smooth_window : 10
[2025/02/08 11:43:51] ppocr INFO: print_batch_step : 10
[2025/02/08 11:43:51] ppocr INFO: save_epoch_step : 2000
[2025/02/08 11:43:51] ppocr INFO: save_inference_dir : None
[2025/02/08 11:43:51] ppocr INFO: save_model_dir : ./output/ser_vi_layoutxlm_xfund_zh_udml
[2025/02/08 11:43:51] ppocr INFO: save_res_path : ./output/ser_layoutxlm_xfund_zh/res
[2025/02/08 11:43:51] ppocr INFO: seed : 2022
[2025/02/08 11:43:51] ppocr INFO: use_gpu : True
[2025/02/08 11:43:51] ppocr INFO: use_visualdl : False
[2025/02/08 11:43:51] ppocr INFO: Loss :
[2025/02/08 11:43:51] ppocr INFO: loss_config_list :
[2025/02/08 11:43:51] ppocr INFO: DistillationVQASerTokenLayoutLMLoss :
[2025/02/08 11:43:51] ppocr INFO: key : backbone_out
[2025/02/08 11:43:51] ppocr INFO: model_name_list : ['Student', 'Teacher']
[2025/02/08 11:43:51] ppocr INFO: num_classes : 25
[2025/02/08 11:43:51] ppocr INFO: weight : 1.0
[2025/02/08 11:43:51] ppocr INFO: DistillationSERDMLLoss :
[2025/02/08 11:43:51] ppocr INFO: act : softmax
[2025/02/08 11:43:51] ppocr INFO: key : backbone_out
[2025/02/08 11:43:51] ppocr INFO: model_name_pairs : [['Student', 'Teacher']]
[2025/02/08 11:43:51] ppocr INFO: use_log : True
[2025/02/08 11:43:51] ppocr INFO: weight : 1.0
[2025/02/08 11:43:51] ppocr INFO: DistillationVQADistanceLoss :
[2025/02/08 11:43:51] ppocr INFO: key : hidden_states_5
[2025/02/08 11:43:51] ppocr INFO: mode : l2
[2025/02/08 11:43:51] ppocr INFO: model_name_pairs : [['Student', 'Teacher']]
[2025/02/08 11:43:51] ppocr INFO: name : loss_5
[2025/02/08 11:43:51] ppocr INFO: weight : 0.5
[2025/02/08 11:43:51] ppocr INFO: DistillationVQADistanceLoss :
[2025/02/08 11:43:51] ppocr INFO: key : hidden_states_8
[2025/02/08 11:43:51] ppocr INFO: mode : l2
[2025/02/08 11:43:51] ppocr INFO: model_name_pairs : [['Student', 'Teacher']]
[2025/02/08 11:43:51] ppocr INFO: name : loss_8
[2025/02/08 11:43:51] ppocr INFO: weight : 0.5
[2025/02/08 11:43:51] ppocr INFO: name : CombinedLoss
[2025/02/08 11:43:51] ppocr INFO: Metric :
[2025/02/08 11:43:51] ppocr INFO: base_metric_name : VQASerTokenMetric
[2025/02/08 11:43:51] ppocr INFO: key : Student
[2025/02/08 11:43:51] ppocr INFO: main_indicator : hmean
[2025/02/08 11:43:51] ppocr INFO: name : DistillationMetric
[2025/02/08 11:43:51] ppocr INFO: Optimizer :
[2025/02/08 11:43:51] ppocr INFO: beta1 : 0.9
[2025/02/08 11:43:51] ppocr INFO: beta2 : 0.999
[2025/02/08 11:43:51] ppocr INFO: lr :
[2025/02/08 11:43:51] ppocr INFO: epochs : 200
[2025/02/08 11:43:51] ppocr INFO: learning_rate : 5e-05
[2025/02/08 11:43:51] ppocr INFO: name : Linear
[2025/02/08 11:43:51] ppocr INFO: warmup_epoch : 10
[2025/02/08 11:43:51] ppocr INFO: name : AdamW
[2025/02/08 11:43:51] ppocr INFO: regularizer :
[2025/02/08 11:43:51] ppocr INFO: factor : 0.0
[2025/02/08 11:43:51] ppocr INFO: name : L2
[2025/02/08 11:43:51] ppocr INFO: PostProcess :
[2025/02/08 11:43:51] ppocr INFO: class_path : train_data/XFUND/class_list_xfun.txt
[2025/02/08 11:43:51] ppocr INFO: key : backbone_out
[2025/02/08 11:43:51] ppocr INFO: model_name : ['Student', 'Teacher']
[2025/02/08 11:43:51] ppocr INFO: name : DistillationSerPostProcess
[2025/02/08 11:43:51] ppocr INFO: Train :
[2025/02/08 11:43:51] ppocr INFO: dataset :
[2025/02/08 11:43:51] ppocr INFO: data_dir : ./train_data/det
[2025/02/08 11:43:51] ppocr INFO: label_file_list : ['./train_data/det/train.txt']
[2025/02/08 11:43:51] ppocr INFO: name : SimpleDataSet
[2025/02/08 11:43:51] ppocr INFO: ratio_list : [1.0]
[2025/02/08 11:43:51] ppocr INFO: transforms :
[2025/02/08 11:43:51] ppocr INFO: DecodeImage :
[2025/02/08 11:43:51] ppocr INFO: channel_first : False
[2025/02/08 11:43:51] ppocr INFO: img_mode : RGB
[2025/02/08 11:43:51] ppocr INFO: VQATokenLabelEncode :
[2025/02/08 11:43:51] ppocr INFO: algorithm : LayoutXLM
[2025/02/08 11:43:51] ppocr INFO: class_path : train_data/XFUND/class_list_xfun.txt
[2025/02/08 11:43:51] ppocr INFO: contains_re : False
[2025/02/08 11:43:51] ppocr INFO: order_method : tb-yx
[2025/02/08 11:43:51] ppocr INFO: VQATokenPad :
[2025/02/08 11:43:51] ppocr INFO: max_seq_len : 512
[2025/02/08 11:43:51] ppocr INFO: return_attention_mask : True
[2025/02/08 11:43:51] ppocr INFO: VQASerTokenChunk :
[2025/02/08 11:43:51] ppocr INFO: max_seq_len : 512
[2025/02/08 11:43:51] ppocr INFO: Resize :
[2025/02/08 11:43:51] ppocr INFO: size : [224, 224]
[2025/02/08 11:43:51] ppocr INFO: NormalizeImage :
[2025/02/08 11:43:51] ppocr INFO: mean : [123.675, 116.28, 103.53]
[2025/02/08 11:43:51] ppocr INFO: order : hwc
[2025/02/08 11:43:51] ppocr INFO: scale : 1
[2025/02/08 11:43:51] ppocr INFO: std : [58.395, 57.12, 57.375]
[2025/02/08 11:43:51] ppocr INFO: ToCHWImage : None
[2025/02/08 11:43:51] ppocr INFO: KeepKeys :
[2025/02/08 11:43:51] ppocr INFO: keep_keys : ['input_ids', 'bbox', 'attention_mask', 'token_type_ids', 'image', 'labels']
[2025/02/08 11:43:51] ppocr INFO: loader :
[2025/02/08 11:43:51] ppocr INFO: batch_size_per_card : 4
[2025/02/08 11:43:51] ppocr INFO: drop_last : False
[2025/02/08 11:43:51] ppocr INFO: num_workers : 4
[2025/02/08 11:43:51] ppocr INFO: shuffle : True
[2025/02/08 11:43:51] ppocr INFO: profiler_options : None
[2025/02/08 11:43:51] ppocr INFO: train with paddle 2.5.2 and device Place(gpu:0)
[2025/02/08 11:43:51] ppocr INFO: Initialize indexs of datasets:['./train_data/det/train.txt']
[2025-02-08 11:43:52,556] [ INFO] - Downloading https://bj.bcebos.com/paddlenlp/models/transformers/layoutxlm_base/sentencepiece.bpe.model and saved to /root/.paddlenlp/models/layoutxlm-base-uncased
[2025-02-08 11:43:53,284] [ WARNING] - filehttps://bj.bcebos.com/paddlenlp/models/transformers/layoutxlm_base/sentencepiece.bpe.model not exist
Traceback (most recent call last):
File "/content/PaddleOCR/tools/train.py", line 270, in
main(config, device, logger, vdl_writer, seed)
File "/content/PaddleOCR/tools/train.py", line 55, in main
train_dataloader = build_dataloader(config, "Train", device, logger, seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/content/PaddleOCR/ppocr/data/init.py", line 107, in build_dataloader
dataset = eval(module_name)(config, mode, logger, seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/content/PaddleOCR/ppocr/data/simple_dataset.py", line 53, in init
self.ops = create_operators(dataset_config["transforms"], global_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/content/PaddleOCR/ppocr/data/imaug/init.py", line 94, in create_operators
op = eval(op_name)(**param)
^^^^^^^^^^^^^^^^^^^^^^
File "/content/PaddleOCR/ppocr/data/imaug/label_ops.py", line 1051, in init
self.tokenizer = tokenizer_config["class"].from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/paddlenlp/transformers/tokenizer_utils_base.py", line 1587, in from_pretrained
tokenizer = cls(*init_args, **init_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/paddlenlp/transformers/utils.py", line 170, in impl
init_func(self, *args, **kwargs)
File "/usr/local/lib/python3.11/dist-packages/paddlenlp/transformers/layoutxlm/tokenizer.py", line 93, in init
self.sp_model.Load(vocab_file)
File "/usr/local/lib/python3.11/dist-packages/sentencepiece/init.py", line 961, in Load
return self.LoadFromFile(model_file)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/sentencepiece/init.py", line 316, in LoadFromFile
return _sentencepiece.SentencePieceProcessor_LoadFromFile(self, arg)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: not a string`

I guess the link doesnt work anymore. And also this model is licensed under apache2.0 or CC-BY-NC-SA-4.0?