Long loading of the program.

[marek7400]

Long loading of the program.

I do not know if this problem occurs only with me, but with directories with many photos - the program loads several minutes.
The more photos - the longer it takes to load.
With thousands of photos - the program can load in 15 min.

It could be possible to speed it up somehow.

v1.29

[jhc13]

With thousands of photos - the program can load in 15 min.

That's not normal. It only takes a few seconds for me with several thousand images. What kind of photos are in your directory, and does the directory contain any other types of files?

[marek7400]

More than 40,000 jpg photos + files of other types raw (NEF), mov, txt, gpx, kml, pdf....in one folder.

[jhc13]

I suggest you create a separate directory with just the images and caption files for faster loading. Working on just a few thousand images at a time instead of the entire set of 40000+ images will help as well.

[marek7400]

Thanks for the advice, but I did it a long time ago. As for the virus in the new version-you can apply to individual antivirus publishers to flag the file as a “false positive.” Unfortunately, you have to do this by sending emails and samples to each one individually. (I have the same problem with the exe files I created).

[Seedmanc]

It's very slow starting up even with just two images. The HDD makes a lot of noise during startup, it's like the entire 5gb of the program's folder is being read into memory.

[jhc13]

Did you set a models directory in the settings?

[Seedmanc]

No, it's taking models from the .cache/huggingface folder. There are like 6 models and that folder is on SSD.

[Seedmanc]

Looks like it was windows antivirus re-checking the huge dlls every time the app started. What was the point of repeating checks, I wonder.
I added app's folder to exceptions list and now it starts fast.

[jhc13]

Interesting. Thanks for the update.

[marek7400]

I try 1.3 version
Still 15 mints to load program.
I see taggui in process but no gui.

[jhc13]

You could run the program from source with a profiler to check which part of the code is taking up a lot of time.

[marek7400]

How?

[jhc13]

I use the profiler included in PyCharm.

[marek7400]

It's already too complicated for me.

[ScionoicS]

I pointed the program at my downloads folder because i wanted to caption a single image inside of it. It's not running out of memory or anything. It's just frozen. Now whenever i open the program, it is still trying to load the download folder's files and is frozen completely. Not running out of memory or using too many system resources. It's just halted up and won't proceed.

I can't find where to make it forget that it was pointed at the download folder either.

[jhc13]

See #90.

[generrosity]

I had a similar experiance with first startups of this app just generally without particular folders selected.

Code suggestion: This involves tweaking timings and potentially adding a subapp. Find some of that "display something onscreen immediately while program itself loads" code that happens with eg photoshop and other programs load up. This gives a good indication that its not doing malware in the backgroud (which I KNOW but its a concern!), and confirms that the program hasn't hung. I love intros that you can move around, and then the program opens to where you move it to.

I'd suggest ideally, get into the main program layout ASAP before doing any startup tasks. If its easier to stay with a splash screen instead, divide and number your startup tasks and have a label that updates, like"[4/8] Pre-processing Model Descriptions [2/30]" so every task and loop has a easy 'update loading splash' to show. Then, it means that startup tasks can using the (status bar | Auto-captioner status output | splash label) to indicate if it is working on loading models or files and give indication its alive and busy without huge code overhead.