Data appearing in intermediate but not output storage.

[pedrozuccolo]

Hello all,

I have a cluster configured and the pRMT app running on some devices for three days. However, when I check MinIO, I only see intermediate data. I wonder, how much time does it take for the system to convert data from intermediate to output storage? Or rather, how can I inspect if something is not working properly with this pod?

[blootsvoets]

Hi, once data is in intermediate storage, it should come in the output bucket within about 5-10 minutes. So if it is not, please inspect the logs of the radar-output pods.

[pedrozuccolo]

Hi Joris, it was indeed not working properly. It was showing several messages such as

Error: Object not found: radar-output-storage/output/Jon/966290ee-f68a-4ae6-b7d6-504c2fd65902/application_record_counts/20220401_0100.csv.gz (cmd.ObjectNotFound)
       1: cmd/web-handlers.go:914:cmd.(*webAPIHandlers).RemoveObject()

I was able to solve the issue by reinitiating all minIO pods in Rancher. Now everything is working properly :)