Permission issues with hall_of_fame.csv

[DeanDiFiore]

Hello,

I am running into an issue where the Julia backend has the hall_of_fame.csv access denied by my local computer. This has happened randomly whether it's 10 seconds in or 3 minutes in. I don't operate anything else on my computer so I suspect that the backend is trying to open the same file twice (perhaps with multi-threading). I have since changed parallelism to "serial" and made sure my data sets are below 1000 locations to make sure no batching occurs. This issue is still happening. Do you know what could be the possible cause of this?

Thank you!

[MilesCranmer]

hall_of_fame.csv doesn't get written to in parallel, only the 1st thread (should) be able to write to it. The dataset shouldn't affect this behavior. I'm not really sure why it happens, especially if it is randomly. Can you share the specific error message, your run parameters, and where in the script does the error actually occur? (Start of training, end of training?)

[MilesCranmer]

Also can you confirm if the .csv file has any contents?

[DeanDiFiore]

I am not sure how to check the number of iterations completed. It was printing out the progress at the time of error and it was
around 1% complete so likely 30 iterations completed potentially (since my total iterations is set to 3000).

Here are the contents of the .csv file.

Complexity	Loss	Equation
1	0.059947	0.677306
3	0.0054	0.9983696165319691 ^ x0
4	0.0054	square(0.9991844751698595 ^ x0)
7	0.005343	4.433778613650315 / (4.494071140941999 / (0.9984085096393923 ^ x0))
12	0.005343	abs(4.434272717582602 / (((4.4935761872849 / (0.9984087503569139 ^ x0)) ^ 1.0053739018036052) ^ 0.9948010122074937))
15	0.005335	((((x0 + 4.325596932894799) - x0) / (-4.466924597682228 / (0.9985105899599547 ^ x0))) + 0.040430536582983054) * -1.0613798492398696
17	0.003564	exp((x1 - x0) * (0.13797128210114593 / (x0 + x1))) - (-0.23107205550691262 / (log10(x0) + -3.2391375142996712))
19	0.003345	exp(((x1 - x0) * 0.1411021243925998) / (x1 + x0)) - (-0.23029644073362093 / (log10(x0 - -3.240001308691493) + -3.240001308691493))

[MilesCranmer]

ok thanks. So it seems like at one point it DID have access to the .csv file. Which is really weird!!

[MilesCranmer]

Is there some sort of antivirus operating, or maybe OneDrive syncing, or backup service running in the background?

Maybe you can try running the search in a temp folder (which is outside the scope of, e.g., OneDrive), and see if it works there?

[DeanDiFiore]

Yes, that is true, it could be that. I tried to look into my antivirus settings and did not find anything that would cause this. It could be the OneDrive syncing to the cloud that is causing this issue. I have since tried this on another computer without OneDrive and I have been running 8,000 iterations no problem. Thanks for your help!