Issue with debug model for ner_demo_update project

[lzmodel]

How to reproduce the behaviour

1. Executed spacy project run create-config for ner_demo_update project
2. Run spacy debug model configs/config.cfg ner -P0 -P1 --gpu-id 0
   ========================== STEP 0 - before training ==========================
   ...
   ℹ Layer 66: model ID 175: 'maxout'
   ℹ Layer 67: model ID 176: 'layernorm'

✘ Could not initialize the model: you'll have to provide a valid
'train_corpus' argument in the config file.

3. Executed spacy project run train - successfully
4. Edited config.cfg file by adding params like in command line --paths.train corpus/train.spacy --paths.dev corpus/dev.spacy --training.eval_frequency 10 --training.max_steps 500 --training.patience 50 and run spacy debug model - error remains the same.

I tried to edit this config.cfg with my data and by deleting some components from pipeline, but i can not know exactly if these error mine or from original config.

Your Environment

• spaCy version: 3.4.1
• Platform: Linux-5.15.0-48-generic-x86_64-with-glibc2.35
• Python version: 3.9.13
• Pipelines: en_core_web_sm (3.4.1), en_core_web_lg (3.4.1), en_core_web_trf (3.4.1)
• ** Environment Information:** conda env

[danieldk]

I can't reproduce this issue. From a fresh checkout of the project:

$ spacy project run create-config
$ spacy debug model configs/config.cfg ner -P0 -P1 --gpu-id 0
[...]
ℹ Layer 66: model ID 175: 'maxout'
ℹ Layer 67: model ID 176: 'layernorm'
✔ Succesfully ended analysis - model looks good.

What changes did you make to the configuration? What do you have in the paths section? Could you also check if debug data works for the original project configuration?

[lzmodel]

I just did the following:

1. deleted the ner_demo_update project completely
2. reinstalled the project
3. spacy project run create-config
4. run python -m spacy debug model configs/config.cfg ner -P0 -P1 --gpu-id 0
   Result is the same:

ℹ Layer 65: model ID 168: 'layernorm'
ℹ Layer 66: model ID 175: 'maxout'
ℹ Layer 67: model ID 176: 'layernorm'

✘ Could not initialize the model: you'll have to provide a valid
'train_corpus' argument in the config file.

[adrianeboyd]

I think you're just missing the overrides for the corpus paths in your command (something like --paths.train train.spacy --paths.dev dev.spacy).

[lzmodel]

@adrianeboyd How to check paths correctly?

1. I edited config.cfg by adding

train = "./corpus/train.spacy"
dev = "./corpus/dev.spacy"

2. Run spacy debug data ./configs/config.cfg - OK.
3. Run spacy debug model configs/config.cfg ner -P0 -P1 --gpu-id 0 - OK
4. I changed the directory to my data, that i used for training model from scratch many times (data exist exactly) - now i have another error:

...
File "spacy/pipeline/tagger.pyx", line 297, in spacy.pipeline.tagger.Tagger.initialize
  File "spacy/pipeline/tagger.pyx", line 322, in spacy.pipeline.tagger.Tagger.add_label
  File "spacy/pipeline/trainable_pipe.pyx", line 224, in spacy.pipeline.trainable_pipe.TrainablePipe._allow_extra_label
ValueError: [E922] Component 'tagger' has been initialized with an output dimension of 50 - cannot add any more labels.

The Path to the data is correct. I tried to corrupt it and got a message "FileNotFoundError: [Errno 2] No such file or directory".

[rmitsch]

Moving this to discussions, as this seems to be a usage-related question rather than an issue with spaCy per se.