[Bug]: JASP imports csv data from large files extremely slowly #3015
Description
JASP Version
0.19.1
Commit ID
No response
JASP Module
Unrelated
What analysis are you seeing the problem on?
No response
What OS are you seeing the problem on?
Windows 11, Flatpak
Bug Description
When importing data from .csv files around 15 MB in size, JASP takes 3-4 minutes to import the data (from half-filled progress bar to data tables visible on the screen).
When file sizes grow to ~30 MB, the same process takes about 15 minutes and even longer with larger files.
Computer specs don't seem to play a role, as we tested on PCs with 8 CPU cores and 32GB RAM and SSD's for storage, to much more capable VMs.
Tested on 0.19.1 and 0.18.3, and found the same behavior.
Used dummy csv datasets for testing from https://www.datablist.com/learn/csv/download-sample-csv-files
Expected Behaviour
Data is imported faster.
Steps to Reproduce
- Open Jasp
- Open a file via burger menu -> Open -> Computer -> Browse ... etc
Log (if any)
No log output
More Debug Information
No response
Final Checklist
- I have included a screenshot showcasing the issue, if possible.
- I have included a JASP file (zipped) or data file that causes the crash/bug, if applicable.
- I have accurately described the bug, and steps to reproduce it.