AssertionError: [E923] It looks like there is no proper sample data to initialize the Model of component 'tok2vec'.

[butterflyhigh]

How to reproduce the behaviour

Run spacy train config.cfg

Your Environment

• Operating System: Windows 10
• Python Version Used: 3.11.0
• spaCy Version Used: 3.5.3

The error message from running spacy train config.cfg:

ℹ No output directory provided
ℹ Using CPU

=========================== Initializing pipeline ===========================
[2023-06-27 08:49:53,939] [INFO] Set up nlp object from config
[2023-06-27 08:49:53,958] [INFO] Pipeline: ['tok2vec', 'tagger', 'parser', 'ner']
[2023-06-27 08:49:53,962] [INFO] Created vocabulary
[2023-06-27 08:49:53,963] [INFO] Finished initializing nlp object
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "c:\users\salt lick\appdata\roaming\python\python311\scripts\spacy.exe\__main__.py", line 7, in <module>
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\cli\_util.py", line 74, in setup_cli
    command(prog_name=COMMAND)
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\click\core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\site-packages\typer\core.py", line 778, in main
    return _main(
           ^^^^^^
  File "C:\Python311\Lib\site-packages\typer\core.py", line 216, in _main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\click\core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\click\core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\click\core.py", line 760, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\site-packages\typer\main.py", line 683, in wrapper
    return callback(**use_params)  # type: ignore
           ^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\cli\train.py", line 45, in train_cli
    train(config_path, output_path, use_gpu=use_gpu, overrides=overrides)
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\cli\train.py", line 72, in train
    nlp = init_nlp(config, use_gpu=use_gpu)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\training\initialize.py", line 85, in init_nlp
    nlp.initialize(lambda: train_corpus(nlp), sgd=optimizer)
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\language.py", line 1308, in initialize
    proc.initialize(get_examples, nlp=self, **p_settings)
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\pipeline\tok2vec.py", line 216, in initialize
    assert doc_sample, Errors.E923.format(name=self.name)
AssertionError: [E923] It looks like there is no proper sample data to initialize the Model of component 'tok2vec'. To check your input data paths and annotation, run: python -m spacy debug data config.cfg and include the same config override values you would specify for the 'spacy train' command.

The output from spacy debug data config.cfg:

============================ Data file validation ============================
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "c:\users\salt lick\appdata\roaming\python\python311\scripts\spacy.exe\__main__.py", line 7, in <module>
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\cli\_util.py", line 74, in setup_cli
    command(prog_name=COMMAND)
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\click\core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\site-packages\typer\core.py", line 778, in main
    return _main(
           ^^^^^^
  File "C:\Python311\Lib\site-packages\typer\core.py", line 216, in _main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\click\core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\click\core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\click\core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\click\core.py", line 760, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\site-packages\typer\main.py", line 683, in wrapper
    return callback(**use_params)  # type: ignore
           ^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\cli\debug_data.py", line 77, in debug_data_cli
    debug_data(
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\cli\debug_data.py", line 117, in debug_data
    nlp.initialize(lambda: train_corpus(nlp))
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\language.py", line 1308, in initialize
    proc.initialize(get_examples, nlp=self, **p_settings)
  File "C:\Users\Salt lick\AppData\Roaming\Python\Python311\site-packages\spacy\pipeline\tok2vec.py", line 216, in initialize
    assert doc_sample, Errors.E923.format(name=self.name)
AssertionError: [E923] It looks like there is no proper sample data to initialize the Model of component 'tok2vec'. To check your input data paths and annotation, run: python -m spacy debug data config.cfg and include the same config override values you would specify for the 'spacy train' command.

The format for the JSON file I converted (using spacy convert):

[
    [
      "Blah blah blah\r",
      {
        "entities": [
          [
            25,
            38,
            "label"
          ],
          [
            46,
            61,
            "label"
          ]
        ]
      }
    ], ...

I'm not sure if this is a bug or user error, but any help is very much appreciated.

[danieldk]

I have moved this to the discussion forum, since it is not clear that this is a bug in spaCy. Could you provide a fully reproducible example including your training configuration (train.cfg)?