Networks browser errors (post-2025.07/8 updates)

[PaulCoddington]

Some problems have appeared after updating to the latest version:

1. Checkpoints can no longer have a full stop in the name. e.g. "FLUX.1-dev", "FLUX.1-schnell", both end up being interpreted as "FLUX", at least insofar as they end up sharing the same thumbnail (I have not checked for additional path errors, such as selecting the model for rendering, etc).

2. Browser no longer reads metadata JSON files for checkpoints and embeddings (metadata loading for LoRA seems to be still working).

3. Symlinks cause errors when the volume they point to is offline. e.g.

*** Error loading embedding …
    Traceback (most recent call last):
      File "C:\stable-diffusion-webui-ux-forge\modules\textual_inversion\textual_inversion.py", line 197, in load_from_dir
        if os.stat(fullfn).st_size == 0:
    FileNotFoundError: [WinError 3] The system cannot find the path specified: 'C:\\folder\\folder\\symlink'

4. Thumbnails are being stored as subfolders within user-curated model folders rather than a temp cache. Apart from housekeeping concerns, model folders are often shared between applications, and it cannot be assumed that all users have write access.

[anapnoe]

1. I think the issue is the '.' and not the '-' char the idea was to clean the path and create correct naming for thumbnails img.preview.thumb.jpg -> thumbnails/img.jpg, img.preview.jpg -> thumbnails/img.jpg
2. Each Metadata JSON file is imported once. If new models are added to the folder with their metadata JSON only those are updated imported to the db - importing them every time makes no sense as it will overwrite any modifications done afterwards.
   (custom tags, custom description etc)
   metadata are stored and managed through the UI and not the JSON file after imported (enabling fast search across 100k+ metadata records)
3. Is this an issue? Yes, but it's expected behavior. Symlinks require their target to be accessible.
4. Thumbnails are being stored as subfolders within user-curated model folders. This is true the user does have access to the folder where the models are stored and thumbnails are saved in a separate folder since the initial image that the thumbnail was created was in the models folder

[PaulCoddington]

Re: 1. The problem is that the name of the model is truncated after the full stop when writing the thumbnail. The filename is being evaluated left-to-right rather than right-to-left. That is, using the characters to the left of the first full stop, rather than to the left of the last full stop.

--

Re: 2. The JSON files are no longer being imported for me at all for checkpoints and embeddings, not even with a fresh installation from scratch, nor after deleting the cache and db.

If changes are no longer written to the JSON, there are two sources of metadata to maintain that can get out of sync, and users will have to backup the internals of the web application and transfer those files between machines/installations rather than rely on metadata being part of the model folder that gets imported to a new installation.

I can see the advantage in terms of performance, and I think you are being sensible on this matter, but it complicates things a bit for users in its current form. One approach to retain both performance and portability might be to: a) ensure all JSON for checkpoints/embeddings are imported once (as they currently are for LoRA only), and b) write metadata amendments to both the db and the JSON file (with graceful failure for users with read-only access).

--

Re: 3. Technically not a failure state, so no harm done, but more of a false alarm that distracts when reading the logs to make sure everything is working OK. Linked sources may be deliberately disconnected for some scenarios and many applications in the Windows ecosystem tend to silently ignore them when this happens.

--

Re. 4. To clarify, it is good the thumbnails are not overwriting the originals, but it is in-effect adding app-specific temporary caches to folders that contain more permanent data manually curated to be shared by multiple apps (which will not use those thumbnails). It will also fail for users who only have read-access to model folders.

--

The last commit where JSON metadata imports were still working: dfdcbab
Unfortunately, this does not narrow it down by much.

db_lora.py seems to have code for loading user metadata, but db_checkpoints.py, db_textual_inversion.py, db_hypernets.py do not?

BTW: I am using the standard command line parameters to redirect to shared model folders, rather than using the default model locations. TESTED: No difference, not the cause.

--

I forgot to mention another issue earlier:

5. Viewing the Hyperlinks pane logs an error message that the hyperlinks table was not found in the database.

[PaulCoddington]

Additional Findings:

6. When checkpoints and their associated PNG/JSON are renamed in Windows Explorer (to workaround issue 1), the 'Resync' and 'Rebuild Thumbnails' are unable to pick up the changes.

File "C:\Services\Stable Diffusion\stable-diffusion-webui-ux-forge\extensions-builtin\sd-webui-ux\scripts\anapnoe\db_checkpoints.py", line 31, in create_item
FileNotFoundError: [WinError 2] The system cannot find the file specified.

[anapnoe]

Thanks for the detail feedback I will get some time this week to look into the issues here is something you can try to see if it works
set the flag "allow_update": (False, "BOOLEAN") to True this will always update the database from JSON files
the flag was created so it can be used to re-import single items but never made it, maybe in the upcoming version along with the update and save to the JSON file when metadata are modified from UI
sd-webui-ux/scripts/anapnoe/db_checkpoints.py, db_hypernets, db_...

also if you want a bit more info, add this to your webui-user.bat file
set SD_WEBUI_LOG_LEVEL=DEBUG

[anapnoe]

some relevant code to study if you want to try things

    def import_item(self, table_name, item):
        conn = None
        try:
            cleaned_item = {k: v[0] if v is not None else None for k, v in item.items()}
            
            item_filtered = self.filter_and_normalize_paths(cleaned_item)
            item_allow_update = cleaned_item.get('allow_update', False)
            item_exists_by_filename = self.item_exists_by_filename(table_name, item_filtered['filename'])
            item_exists_in_source = self.item_exists_in_source(item_filtered["filename"])

            logger.info(f"Inserting item: {item_filtered['name']} {item_filtered.get('hash', 'N/A')} Exists: {item_exists_in_source}")

            if item_exists_by_filename and not item_exists_in_source:
                logger.info(f"Item {item_filtered['name']} does not exist. Deleting from database.")
                self.delete_item(table_name, item_exists_by_filename)
                return
            
            elif item_exists_by_filename and item_exists_in_source:
                logger.info(f"Item {item_filtered['name']} not found in source. Updating paths.")
                self.update_item_paths(table_name, item_filtered)
                return
            
            elif item_exists_by_filename:
                if item_allow_update:
                    logger.info(f"Updating item: {item_filtered['name']} {item_filtered.get('hash', 'N/A')} (allow_update=True)")
                    self.update_item(table_name, item_filtered)
                    return
                else:
                    logger.info(f"Item {item_filtered['name']} already exists and allow_update is False. Skipping insert.")
                    return
            
            
            validate_name(table_name, "table")  # Validate table 
            logger.info(f"Inserting item: {item_filtered['name']} {item_filtered.get('hash', 'N/A')}")

            conn = self.connect()
            cursor = conn.cursor()

            keys = ', '.join(item_filtered.keys())
            placeholders = ', '.join(['?' for _ in item_filtered])
            values = tuple(json.dumps(val) if isinstance(val, (dict, list)) else val for val in item_filtered.values())

            cursor.execute(f'''
            INSERT INTO {table_name} ({keys})
            VALUES ({placeholders})
            ''', values)

            conn.commit()

            last_inserted_id = cursor.lastrowid
            item_filtered['id'] = last_inserted_id
            self.generate_thumbnails(table_name, file_id=item_filtered['id'])

        except sqlite3.Error as e:
            logger.error(f"Database error: {e}")
        except Exception as e:
            logger.error(f"Error inserting item: {e}")
        finally:
            if conn:
                conn.close()