IndexError: list index out of range in training of recognition model

[hrnbot]

请提供下述完整信息以便快速定位问题/Please provide the following information to quickly locate the problem

• 系统环境/System Environment：Windows with NVidia GPu
• 版本号/Version：PaddleGPU：2.5.2 PaddleOCR：2.7.0.3 问题相关组件/Related components：
  Complete requirement

anyio                     4.1.0                    pypi_0    pypi
astor                     0.8.1                    pypi_0    pypi
attrdict                  2.0.1                    pypi_0    pypi
babel                     2.13.1                   pypi_0    pypi
bce-python-sdk            0.8.97                   pypi_0    pypi
beautifulsoup4            4.12.2                   pypi_0    pypi
blas                      1.0                         mkl
blinker                   1.7.0                    pypi_0    pypi
brotli-python             1.0.9            py39hd77b12b_7
ca-certificates           2023.08.22           haa95532_0
cachetools                5.3.2                    pypi_0    pypi
certifi                   2023.11.17       py39haa95532_0
cffi                      1.16.0           py39h2bbff1b_0
chardet                   5.2.0                    pypi_0    pypi
charset-normalizer        3.3.2                    pypi_0    pypi
click                     8.1.7                    pypi_0    pypi
colorama                  0.4.6                    pypi_0    pypi
coloredlogs               15.0.1                   pypi_0    pypi
contourpy                 1.2.0                    pypi_0    pypi
cryptography              41.0.3           py39h89fc84f_0
cssselect                 1.2.0                    pypi_0    pypi
cssutils                  2.9.0                    pypi_0    pypi
cuda-cccl                 12.3.101                      0    nvidia
cuda-cudart               11.8.89                       0    nvidia
cuda-cudart-dev           11.8.89                       0    nvidia
cuda-cupti                11.8.87                       0    nvidia
cuda-libraries            11.8.0                        0    nvidia
cuda-libraries-dev        11.8.0                        0    nvidia
cuda-nvrtc                11.8.89                       0    nvidia
cuda-nvrtc-dev            11.8.89                       0    nvidia
cuda-nvtx                 11.8.86                       0    nvidia
cuda-profiler-api         12.3.101                      0    nvidia
cuda-runtime              11.8.0                        0    nvidia
cudatoolkit               11.8.0               hd77b12b_0
cudnn                     8.9.2.26               cuda11_0
cycler                    0.12.1                   pypi_0    pypi
cython                    3.0.6                    pypi_0    pypi
decorator                 5.1.1                    pypi_0    pypi
et-xmlfile                1.1.0                    pypi_0    pypi
exceptiongroup            1.2.0                    pypi_0    pypi
filelock                  3.13.1           py39haa95532_0
fire                      0.5.0                    pypi_0    pypi
flask                     3.0.0                    pypi_0    pypi
flask-babel               4.0.0                    pypi_0    pypi
flatbuffers               23.5.26                  pypi_0    pypi
fonttools                 4.46.0                   pypi_0    pypi
freetype                  2.12.1               ha860e81_0
future                    0.18.3                   pypi_0    pypi
giflib                    5.2.1                h8cc25b3_3
gmpy2                     2.1.2            py39h7f96b67_0
h11                       0.14.0                   pypi_0    pypi
httpcore                  1.0.2                    pypi_0    pypi
httpx                     0.25.2                   pypi_0    pypi
humanfriendly             10.0                     pypi_0    pypi
idna                      3.6                      pypi_0    pypi
imageio                   2.33.0                   pypi_0    pypi
imgaug                    0.4.0                    pypi_0    pypi
importlib-metadata        7.0.0                    pypi_0    pypi
importlib-resources       6.1.1                    pypi_0    pypi
intel-openmp              2023.1.0         h59b6b97_46320
itsdangerous              2.1.2                    pypi_0    pypi
jinja2                    3.1.2            py39haa95532_0
jpeg                      9e                   h2bbff1b_1
kiwisolver                1.4.5                    pypi_0    pypi
lazy-loader               0.3                      pypi_0    pypi
lerc                      3.0                  hd77b12b_0
libcublas                 11.11.3.6                     0    nvidia
libcublas-dev             11.11.3.6                     0    nvidia
libcufft                  10.9.0.58                     0    nvidia
libcufft-dev              10.9.0.58                     0    nvidia
libcurand                 10.3.4.101                    0    nvidia
libcurand-dev             10.3.4.101                    0    nvidia
libcusolver               11.4.1.48                     0    nvidia
libcusolver-dev           11.4.1.48                     0    nvidia
libcusparse               11.7.5.86                     0    nvidia
libcusparse-dev           11.7.5.86                     0    nvidia
libdeflate                1.17                 h2bbff1b_1
libjpeg-turbo             2.0.0                h196d8e1_0
libnpp                    11.8.0.86                     0    nvidia
libnpp-dev                11.8.0.86                     0    nvidia
libnvjpeg                 11.9.0.86                     0    nvidia
libnvjpeg-dev             11.9.0.86                     0    nvidia
libpng                    1.6.39               h8cc25b3_0
libtiff                   4.5.1                hd77b12b_0
libuv                     1.44.2               h2bbff1b_0
libwebp                   1.3.2                hbc33d0d_0
libwebp-base              1.3.2                h2bbff1b_0
lmdb                      1.4.1                    pypi_0    pypi
lxml                      4.9.3                    pypi_0    pypi
lz4-c                     1.9.4                h2bbff1b_0
markupsafe                2.1.3                    pypi_0    pypi
matplotlib                3.8.2                    pypi_0    pypi
mkl                       2023.1.0         h6b88ed4_46358
mkl-service               2.4.0            py39h2bbff1b_1
mkl_fft                   1.3.8            py39h2bbff1b_0
mkl_random                1.2.4            py39h59b6b97_0
mpc                       1.1.0                h7edee0f_1
mpfr                      4.0.2                h62dcd97_1
mpir                      3.0.0                hec2e145_1
mpmath                    1.3.0            py39haa95532_0
networkx                  3.2.1                    pypi_0    pypi
numpy                     1.26.2           py39h055cbcc_0
numpy-base                1.26.2           py39h65a83cf_0
onnxruntime               1.16.3                   pypi_0    pypi
opencv-contrib-python     4.6.0.66                 pypi_0    pypi
opencv-python             4.6.0.66                 pypi_0    pypi
openjpeg                  2.4.0                h4fc8c34_0
openpyxl                  3.1.2                    pypi_0    pypi
openssl                   3.0.12               h2bbff1b_0
opt-einsum                3.3.0                    pypi_0    pypi
packaging                 23.2                     pypi_0    pypi
paddleocr                 2.7.0.3                  pypi_0    pypi
paddlepaddle-gpu          2.5.2                    pypi_0    pypi
pandas                    2.1.3                    pypi_0    pypi
pdf2docx                  0.5.6                    pypi_0    pypi
pillow                    10.1.0                   pypi_0    pypi
pip                       23.3.1           py39haa95532_0
premailer                 3.10.0                   pypi_0    pypi
protobuf                  3.20.2                   pypi_0    pypi
psutil                    5.9.6                    pypi_0    pypi
pyclipper                 1.3.0.post5              pypi_0    pypi
pycparser                 2.21               pyhd3eb1b0_0
pycryptodome              3.19.0                   pypi_0    pypi
pymupdf                   1.20.2                   pypi_0    pypi
pyopenssl                 23.2.0           py39haa95532_0
pyparsing                 3.1.1                    pypi_0    pypi
pyreadline3               3.4.1                    pypi_0    pypi
pysocks                   1.7.1            py39haa95532_0
python                    3.9.18               h1aa4202_0
python-dateutil           2.8.2                    pypi_0    pypi
python-docx               1.1.0                    pypi_0    pypi
pytorch                   2.1.1           py3.9_cuda11.8_cudnn8_0    pytorch
pytorch-cuda              11.8                 h24eeafa_5    pytorch
pytorch-mutex             1.0                        cuda    pytorch
pytz                      2023.3.post1             pypi_0    pypi
pyyaml                    6.0.1            py39h2bbff1b_0
rapidfuzz                 3.5.2                    pypi_0    pypi
rarfile                   4.1                      pypi_0    pypi
requests                  2.31.0           py39haa95532_0
scikit-image              0.22.0                   pypi_0    pypi
scipy                     1.11.4                   pypi_0    pypi
setuptools                68.0.0           py39haa95532_0
shapely                   2.0.2                    pypi_0    pypi
six                       1.16.0                   pypi_0    pypi
sniffio                   1.3.0                    pypi_0    pypi
soupsieve                 2.5                      pypi_0    pypi
sqlite                    3.41.2               h2bbff1b_0
sympy                     1.12             py39haa95532_0
tbb                       2021.8.0             h59b6b97_0
termcolor                 2.4.0                    pypi_0    pypi
tifffile                  2023.9.26                pypi_0    pypi
tk                        8.6.12               h2bbff1b_0
torchaudio                2.1.1                    pypi_0    pypi
torchvision               0.16.1                   pypi_0    pypi
tqdm                      4.66.1                   pypi_0    pypi
typing-extensions         4.8.0                    pypi_0    pypi
typing_extensions         4.7.1            py39haa95532_0
tzdata                    2023.3                   pypi_0    pypi
urllib3                   2.1.0                    pypi_0    pypi
vc                        14.2                 h21ff451_1
visualdl                  2.5.3                    pypi_0    pypi
vs2015_runtime            14.27.29016          h5e58377_2
werkzeug                  3.0.1                    pypi_0    pypi
wget                      3.2                      pypi_0    pypi
wheel                     0.41.2           py39haa95532_0
win_inet_pton             1.1.0            py39haa95532_0
xz                        5.4.5                h8cc25b3_0
yaml                      0.2.5                he774522_0
zipp                      3.17.0                   pypi_0    pypi
zlib                      1.2.13               h8cc25b3_0
zstd                      1.5.5                hd43e919_0

• 运行指令/Command Code： python tools/train.py -c configs/rec/PP-OCRv3/en_PP-OCRv3_rec.yml -o Global.pretrained_model=./pretrain_models/ch_PP-OCRv3_rec_train/best_accuracy
• 完整报错/Complete Error Message：

[{'DecodeImage': {'img_mode': 'BGR', 'channel_first': False}}, {'RecConAug': {'prob': 0.5, 'ext_data_num': 2, 'image_shape': [48, 320, 3], 'max_text_length': 25}}, {'RecAug': None}, {'MultiLabelEncabelEncode': None}, {'RecResizeImg': {'image_shape': [3, 48, 320]}}, {'KeepKeys': {'keep_keys': ['image', 'label_ctc', 'label_sar', 'length', 'valid_ratio']}}]
list index out of range
Traceback (most recent call last):
  File "D:\Projects-ai\PaddleOCR\ppocr\data\simple_dataset.py", line 72, in set_epoch_as_seed
    border_map_id = [index for index, dictionary in enumerate(dataset_config['transforms']) if 'MakeBorderMap' in dictionary][0]
IndexError: list index out of range

请尽量不要包含图片在问题中/Please try to not include the image in the issue.

Complete error

[2023/12/07 19:46:20] ppocr INFO: Architecture : 
[2023/12/07 19:46:20] ppocr INFO:     Backbone : 
[2023/12/07 19:46:20] ppocr INFO:         last_conv_stride : [1, 2]
[2023/12/07 19:46:20] ppocr INFO:         last_pool_kernel_size : [2, 2]
[2023/12/07 19:46:20] ppocr INFO:         last_pool_type : avg
[2023/12/07 19:46:20] ppocr INFO:         name : MobileNetV1Enhance
[2023/12/07 19:46:20] ppocr INFO:         scale : 0.5
[2023/12/07 19:46:20] ppocr INFO:     Head :
[2023/12/07 19:46:20] ppocr INFO:         head_list :
[2023/12/07 19:46:20] ppocr INFO:             CTCHead :
[2023/12/07 19:46:20] ppocr INFO:                 Head :
[2023/12/07 19:46:20] ppocr INFO:                     fc_decay : 1e-05
[2023/12/07 19:46:20] ppocr INFO:                 Neck :
[2023/12/07 19:46:20] ppocr INFO:                     depth : 2
[2023/12/07 19:46:20] ppocr INFO:                     dims : 64
[2023/12/07 19:46:20] ppocr INFO:                     hidden_dims : 120
[2023/12/07 19:46:20] ppocr INFO:                     name : svtr
[2023/12/07 19:46:20] ppocr INFO:                     use_guide : True
[2023/12/07 19:46:20] ppocr INFO:             SARHead :
[2023/12/07 19:46:20] ppocr INFO:                 enc_dim : 512
[2023/12/07 19:46:20] ppocr INFO:                 max_text_length : 25
[2023/12/07 19:46:20] ppocr INFO:         name : MultiHead
[2023/12/07 19:46:20] ppocr INFO:     Transform : None
[2023/12/07 19:46:20] ppocr INFO:     algorithm : SVTR_LCNet
[2023/12/07 19:46:20] ppocr INFO:     model_type : rec
[2023/12/07 19:46:20] ppocr INFO: Eval :
[2023/12/07 19:46:20] ppocr INFO:     dataset :
[2023/12/07 19:46:20] ppocr INFO:         data_dir : ./train_data
[2023/12/07 19:46:20] ppocr INFO:         label_file_list : ['./train_data/val_list.txt']
[2023/12/07 19:46:20] ppocr INFO:         name : SimpleDataSet
[2023/12/07 19:46:20] ppocr INFO:         transforms :
[2023/12/07 19:46:20] ppocr INFO:             DecodeImage :
[2023/12/07 19:46:20] ppocr INFO:                 channel_first : False
[2023/12/07 19:46:20] ppocr INFO:                 img_mode : BGR
[2023/12/07 19:46:20] ppocr INFO:             MultiLabelEncode : None
[2023/12/07 19:46:20] ppocr INFO:             RecResizeImg :
[2023/12/07 19:46:20] ppocr INFO:                 image_shape : [3, 48, 320]
[2023/12/07 19:46:20] ppocr INFO:             KeepKeys :
[2023/12/07 19:46:20] ppocr INFO:                 keep_keys : ['image', 'label_ctc', 'label_sar', 'length', 'valid_ratio']
[2023/12/07 19:46:20] ppocr INFO:     loader :
[2023/12/07 19:46:20] ppocr INFO:         batch_size_per_card : 128
[2023/12/07 19:46:20] ppocr INFO:         drop_last : False
[2023/12/07 19:46:20] ppocr INFO:         num_workers : 4
[2023/12/07 19:46:20] ppocr INFO:         shuffle : False
[2023/12/07 19:46:20] ppocr INFO: Global :
[2023/12/07 19:46:20] ppocr INFO:     cal_metric_during_train : True
[2023/12/07 19:46:20] ppocr INFO:     character_dict_path : ppocr/utils/en_dict.txt
[2023/12/07 19:46:20] ppocr INFO:     checkpoints : None
[2023/12/07 19:46:20] ppocr INFO:     debug : True
[2023/12/07 19:46:20] ppocr INFO:     distributed : False
[2023/12/07 19:46:20] ppocr INFO:     epoch_num : 500
[2023/12/07 19:46:20] ppocr INFO:     eval_batch_step : [0, 2000]
[2023/12/07 19:46:20] ppocr INFO:     infer_img : doc/imgs_words/ch/word_1.jpg
[2023/12/07 19:46:20] ppocr INFO:     infer_mode : False
[2023/12/07 19:46:20] ppocr INFO:     log_smooth_window : 20
[2023/12/07 19:46:20] ppocr INFO:     max_text_length : 25
[2023/12/07 19:46:20] ppocr INFO:     pretrained_model : ./pretrain_models/ch_PP-OCRv3_rec_train/best_accuracy
[2023/12/07 19:46:20] ppocr INFO:     print_batch_step : 10
[2023/12/07 19:46:20] ppocr INFO:     save_epoch_step : 3
[2023/12/07 19:46:20] ppocr INFO:     save_inference_dir : None
[2023/12/07 19:46:20] ppocr INFO:     save_model_dir : ./output/v3_en_mobile
[2023/12/07 19:46:20] ppocr INFO:     save_res_path : ./output/rec/predicts_ppocrv3_en.txt
[2023/12/07 19:46:20] ppocr INFO:     use_gpu : True
[2023/12/07 19:46:20] ppocr INFO:     use_space_char : True
[2023/12/07 19:46:20] ppocr INFO:     use_visualdl : False
[2023/12/07 19:46:20] ppocr INFO: Loss :
[2023/12/07 19:46:20] ppocr INFO:     loss_config_list :
[2023/12/07 19:46:20] ppocr INFO:         CTCLoss : None
[2023/12/07 19:46:20] ppocr INFO:         SARLoss : None
[2023/12/07 19:46:20] ppocr INFO:     name : MultiLoss
[2023/12/07 19:46:20] ppocr INFO: Metric :
[2023/12/07 19:46:20] ppocr INFO:     ignore_space : False
[2023/12/07 19:46:20] ppocr INFO:     main_indicator : acc
[2023/12/07 19:46:20] ppocr INFO:     name : RecMetric
[2023/12/07 19:46:20] ppocr INFO: Optimizer :
[2023/12/07 19:46:20] ppocr INFO:     beta1 : 0.9
[2023/12/07 19:46:20] ppocr INFO:     beta2 : 0.999
[2023/12/07 19:46:20] ppocr INFO:     lr :
[2023/12/07 19:46:20] ppocr INFO:         learning_rate : 0.001
[2023/12/07 19:46:20] ppocr INFO:         name : Cosine
[2023/12/07 19:46:20] ppocr INFO:         warmup_epoch : 5
[2023/12/07 19:46:20] ppocr INFO:     name : Adam
[2023/12/07 19:46:20] ppocr INFO:     regularizer :
[2023/12/07 19:46:20] ppocr INFO:         factor : 3e-05
[2023/12/07 19:46:20] ppocr INFO:         name : L2
[2023/12/07 19:46:20] ppocr INFO: PostProcess :
[2023/12/07 19:46:20] ppocr INFO:     name : CTCLabelDecode
[2023/12/07 19:46:20] ppocr INFO: Train : 
[2023/12/07 19:46:20] ppocr INFO:     dataset :
[2023/12/07 19:46:20] ppocr INFO:         data_dir : ./train_data/
[2023/12/07 19:46:20] ppocr INFO:         ext_op_transform_idx : 1
[2023/12/07 19:46:20] ppocr INFO:         label_file_list : ['./train_data/train_list.txt']
[2023/12/07 19:46:20] ppocr INFO:         name : SimpleDataSet
[2023/12/07 19:46:20] ppocr INFO:         transforms :
[2023/12/07 19:46:20] ppocr INFO:             DecodeImage :
[2023/12/07 19:46:20] ppocr INFO:                 channel_first : False
[2023/12/07 19:46:20] ppocr INFO:                 img_mode : BGR
[2023/12/07 19:46:20] ppocr INFO:             RecConAug :
[2023/12/07 19:46:20] ppocr INFO:                 ext_data_num : 2
[2023/12/07 19:46:20] ppocr INFO:                 image_shape : [48, 320, 3]
[2023/12/07 19:46:20] ppocr INFO:                 max_text_length : 25
[2023/12/07 19:46:20] ppocr INFO:                 prob : 0.5
[2023/12/07 19:46:20] ppocr INFO:             RecAug : None
[2023/12/07 19:46:20] ppocr INFO:             MultiLabelEncode : None
[2023/12/07 19:46:20] ppocr INFO:             RecResizeImg :
[2023/12/07 19:46:20] ppocr INFO:                 image_shape : [3, 48, 320]
[2023/12/07 19:46:20] ppocr INFO:             KeepKeys :
[2023/12/07 19:46:20] ppocr INFO:                 keep_keys : ['image', 'label_ctc', 'label_sar', 'length', 'valid_ratio']
[2023/12/07 19:46:20] ppocr INFO:     loader :
[2023/12/07 19:46:20] ppocr INFO:         batch_size_per_card : 128
[2023/12/07 19:46:20] ppocr INFO:         drop_last : True
[2023/12/07 19:46:20] ppocr INFO:         num_workers : 4
[2023/12/07 19:46:20] ppocr INFO:         shuffle : True
[2023/12/07 19:46:20] ppocr INFO: profiler_options : None
[2023/12/07 19:46:20] ppocr INFO: train with paddle 2.5.2 and device Place(gpu:0)
[2023/12/07 19:46:20] ppocr INFO: Initialize indexs of datasets:['./train_data/train_list.txt']
[{'DecodeImage': {'img_mode': 'BGR', 'channel_first': False}}, {'RecConAug': {'prob': 0.5, 'ext_data_num': 2, 'image_shape': [48, 320, 3], 'max_text_length': 25}}, {'RecAug': None}, {'MultiLabelEncabelEncode': None}, {'RecResizeImg': {'image_shape': [3, 48, 320]}}, {'KeepKeys': {'keep_keys': ['image', 'label_ctc', 'label_sar', 'length', 'valid_ratio']}}]
list index out of range
Traceback (most recent call last):
  File "D:\Projects-ai\PaddleOCR\ppocr\data\simple_dataset.py", line 72, in set_epoch_as_seed
    border_map_id = [index for index, dictionary in enumerate(dataset_config['transforms']) if 'MakeBorderMap' in dictionary][0]
IndexError: list index out of range
[2023/12/07 19:46:20] ppocr INFO: Initialize indexs of datasets:['./train_data/val_list.txt']
[2023/12/07 19:46:20] ppocr INFO: Total number of samples:4
W1207 19:46:20.607062 22332 gpu_resources.cc:96] The GPU architecture in your current machine is Pascal, which is not compatible with Paddle installation with arch: 70 75 80 86 , it is recommended mended to install the corresponding wheel package according to the installation information on the official Paddle website.
W1207 19:46:20.607062 22332 gpu_resources.cc:119] Please NOTE: device: 0, GPU Compute Capability: 6.1, Driver API Version: 12.2, Runtime API Version: 11.8
W1207 19:46:20.611063 22332 gpu_resources.cc:149] device: 0, cuDNN Version: 8.9.

[aaakouaaaa]

你好 解决了吗

[hrnbot]

No it is not resolved

[ariefwijaya]

it is bug from latest paddleocr , you can ignore it since it is printed from exception.