Skip to content

Indexing failed #19

@rdiaz02

Description

@rdiaz02

I am getting "Indexing failed" errors. When I rerun, it fails again (though the ID of the error differs) but the statistics of what has been indexed so far do not change. I've played with some of the settings (Max tokens per chunk, Max chunks per paper) but that makes no difference. I seem to be at a point where this just keeps happening: within about 5 minutes of "Update index" I get the error.

The error (the number changes ---see last screen capture)

Image

The statistics (these have not changed after several repeated rounds of relaunching the "Update index" and then getting the error):

Image

The indicator of progress

Image

The indicator of progress when the error was produced:

Image

and the popup for that very error

Image

 

Is there a log file where I can find what file is triggering the error (if any) to temporarily remove it and examine it?

Interestingly, the last modification time of zotseek.sqlite is from about 25' before the error. That file is 2.3 GB of size.


I've rerun the indexing in a server. Instead of copying the zotero.sqlite db (see #18 (comment)) I synced it in the "usual way" so that, presumably, rerunning would not be identical to what happened in the laptop. Since this is a server, I modified the code to use 24 cores. The process run for about 17 hours, created a zotsee.sqlite of 9.3 GB, indexed 7525 papers, and failed:

Image
Image
Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions