Heavy CPU usage at startup - how to find culprit?

[pdxrlk]

I make extensive use of dataview/dataviewjs. Recently my CPU usage at startup of Obsidian have become excessive (~500% on a high-end MacBook Pro, for 1 to 2 minutes). I have isolated it to dataview. Is there any way I can narrow it down further? Does dataview execute every code block in every note at startup? Does it index/reindex the world on startup? Any suggestions appreciated!

[blacksmithgu]

Dataview indexes the world (markdown files and some CSV) on startup; how large is your vault? And how large are markdown files in your vault?

[pdxrlk]

1,300 markdown files for 3.1 MB total
150 CSV files for 526MB total
~7,000 non-CSV non-markdown files
11GB total

[blacksmithgu]

Ah, it's almost certainly the CSVs doing this - this is a shortcoming of my current CSV implementation which I am tracking internally and plan to fix in either 0.4.5 or 0.4.6.

[blacksmithgu]

For context, dataview loads many CSVs into memory to index them, which is horridly inefficient at startup if you have large CSV files. It is being changed to index them lazily upon first usage.

[pdxrlk]

Got it, that makes sense. I'll try to cull some of the larger ones and look forward to the update.

Thanks so much for this fantastic add-in and all your efforts.