inspect mesoscope failing tasks

[grg2rsr]

I ran a quick search for imaging sessions on our local server to try to address any remaining extraction issues.This is the current list of biasedChoiceWorld sessions for which the raw_imaging_data exists but the mpci datasets aren't complete, presumably because the extraction didn't start or errored out (22 out of a total of 116 imaging sessions)

SP035\2023-02-23\002
SP035\2023-03-10\001
SP037\2023-02-17\002
SP037\2023-02-21\001
SP037\2023-02-23\001
SP037\2023-02-24\001
SP044\2023-08-03\001
SP044\2023-08-09\001
SP044\2023-08-09\002
SP046\2023-11-28\001
SP046\2023-11-28\002
SP054\2024-02-26\001
SP054\2024-04-24\001
SP054\2024-04-26\001
SP054\2024-04-30\001
SP058\2024-07-15\001
SP058\2024-07-17\001
SP058\2024-07-22\001
SP058\2024-07-26\001
SP060\2024-08-05\001
SP061\2024-12-16\001
SP066\2025-04-08\001

This is a similar list, but for trainingChoiceWorld sessions (49 out of a total of 187 imaging sessions)

SP046\2023-11-20\002
SP046\2023-11-21\002
SP046\2023-11-21\003
SP049\2024-01-30\002
SP052\2024-01-15\001
SP053\2024-01-24\001
SP054\2024-01-30\002
SP054\2024-02-06\001
SP054\2024-02-13\001
SP054\2024-02-14\001
SP058\2024-06-24\001
SP058\2024-07-01\001
SP058\2024-07-08\001
SP060\2024-06-06\001
SP060\2024-06-14\001
SP060\2024-06-14\002
SP060\2024-06-17\001
SP060\2024-06-20\001
SP060\2024-06-25\001
SP060\2024-07-16\002
SP060\2024-07-23\001
SP060\2024-07-25\001
SP061\2024-11-05\001
SP061\2024-11-11\001
SP061\2024-11-12\001
SP061\2024-11-13\001
SP061\2024-11-14\001
SP061\2024-11-15\001
SP061\2024-11-18\001
SP061\2024-11-20\001
SP061\2024-11-21\001
SP061\2024-11-22\001
SP061\2025-02-03\001
SP063\2025-01-31\001
SP065\2024-10-29\001
SP065\2024-10-30\001
SP065\2024-10-31\001
SP065\2024-11-01\001
SP065\2024-11-04\001
SP065\2024-11-05\001
SP065\2024-11-06\001
SP065\2024-11-08\001
SP065\2024-11-12\001
SP065\2024-11-13\001
SP065\2024-11-14\001
SP065\2024-11-19\001
SP072\2025-08-05\001
SP072\2025-08-08\001
SP073\2025-07-28\001

[grg2rsr]

the logs for all the failing tasks associated to the sessions:

3c704925-0399-4b58-9fde-3267a1e26fa0
2025-08-07 20:07:02,565,565 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-08-07 20:07:02,565,565 INFO     [tasks.py:237] running ibllib version 3.4.1
2025-08-07 20:07:02,568,568 INFO     [tasks.py:487] Checking input files
2025-08-07 20:07:02,603,603 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_01/_ibl_rawImagingData.meta.json not found
2025-08-07 20:07:02,603,603 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_02/_ibl_rawImagingData.meta.json not found
2025-08-07 20:07:02,603,603 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_00/_ibl_rawImagingData.meta.json not found
2025-08-07 20:07:02,603,603 ERROR    [tasks.py:543] Signature file pattern suite2p/plane*/data.bin not found
2025-08-07 20:07:02,603,603 ERROR    [tasks.py:543] Signature file pattern suite2p/plane*/imaging.frames_motionRegistered.bin not found
2025-08-07 20:07:02,603,603 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_02/exptQC.mat not found
2025-08-07 20:07:02,604,604 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_01/exptQC.mat not found
2025-08-07 20:07:02,605,605 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-08-07 20:07:02,624,624 WARNING  [tasks.py:417] Not all input files found locally: will still attempt to rerun task
2025-08-07 20:07:02,626,626 INFO     [tasks.py:243] Setup value is: True
2025-08-07 20:07:02,627,627 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 775, in _run
    metadata, all_meta = self.load_meta_files()
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 438, in load_meta_files
    assert len(meta_files) == len(list(self.session_path.glob(self.device_collection))) == len(collections)
AssertionError

2025-08-07 20:07:02,627,627 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-08-07 20:07:02,627,627 INFO     [tasks.py:287] N outputs: 0
2025-08-07 20:07:02,627,627 INFO     [tasks.py:288] --- 0.06167292594909668 seconds run-time ---


e52aa4c4-c179-4ae3-b52e-38ebc8b40332
2025-03-20 09:55:05,724,724 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-03-20 09:55:05,724,724 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-20 09:55:05,725,725 INFO     [tasks.py:487] Checking input files
2025-03-20 09:55:06,169,169 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-03-20 09:55:06,213,213 INFO     [tasks.py:412] All input files found: running task
2025-03-20 09:55:06,222,222 INFO     [tasks.py:243] Setup value is: True
2025-03-20 09:55:06,234,234 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-20 09:55:06,234,234 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-20 09:55:06,234,234 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-20 09:55:06,234,234 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-20 09:55:06,234,234 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-20 09:55:06,234,234 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-20 09:55:06,234,234 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-20 09:55:06,234,234 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key FOV. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key FOV. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-20 09:55:06,235,235 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-20 09:55:06,307,307 INFO     [mesoscope_tasks.py:829] Performing registration
2025-03-20 09:55:06,310,310 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 831, in _run
    ops = np.load(plane.joinpath('ops.npy'), allow_pickle=True).item()
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/numpy/lib/npyio.py", line 427, in load
    fid = stack.enter_context(open(os_fspath(file), "rb"))
FileNotFoundError: [Errno 2] No such file or directory: '/mnt/s0/Data/Subjects/SP061/2024-11-18/001/suite2p/plane0/ops.npy'

2025-03-20 09:55:06,310,310 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-03-20 09:55:06,310,310 INFO     [tasks.py:287] N outputs: 25
2025-03-20 09:55:06,310,310 INFO     [tasks.py:288] --- 0.5863542556762695 seconds run-time ---


65464454-caf0-4dbf-83a3-8ec3fc854b82
2025-03-20 09:55:25,773,773 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-03-20 09:55:25,773,773 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-20 09:55:25,774,774 INFO     [tasks.py:487] Checking input files
2025-03-20 09:55:25,811,811 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-03-20 09:55:25,873,873 INFO     [tasks.py:412] All input files found: running task
2025-03-20 09:55:25,884,884 INFO     [tasks.py:243] Setup value is: True
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key FOV. Using meta_data from first folder!
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-20 09:55:25,919,919 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key FOV. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-20 09:55:25,920,920 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-20 09:55:26,014,14 INFO     [mesoscope_tasks.py:829] Performing registration
2025-03-20 09:55:26,018,18 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 831, in _run
    ops = np.load(plane.joinpath('ops.npy'), allow_pickle=True).item()
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/numpy/lib/npyio.py", line 427, in load
    fid = stack.enter_context(open(os_fspath(file), "rb"))
FileNotFoundError: [Errno 2] No such file or directory: '/mnt/s0/Data/Subjects/SP061/2024-11-15/001/suite2p/plane0/ops.npy'

2025-03-20 09:55:26,018,18 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-03-20 09:55:26,018,18 INFO     [tasks.py:287] N outputs: 26
2025-03-20 09:55:26,018,18 INFO     [tasks.py:288] --- 0.24476361274719238 seconds run-time ---


03670c23-bff9-4b0f-9ffe-df0c18887d2f
2024-11-15 04:44:11,905,905 INFO     [tasks.py:231] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2024-11-15 04:44:11,905,905 INFO     [tasks.py:234] running ibllib version 2.40.1
2024-11-15 04:44:11,907,907 INFO     [tasks.py:480] Checking input files
2024-11-15 04:44:11,998,998 INFO     [tasks.py:405] All input files found: running task
2024-11-15 04:44:12,001,1 INFO     [tasks.py:240] Setup value is: True
2024-11-15 04:44:12,007,7 INFO     [mesoscope_tasks.py:774] Extracting tif data per plane
2024-11-15 04:52:03,840,840 INFO     [mesoscope_tasks.py:812] Performing registration
2024-11-15 05:21:47,605,605 INFO     [mesoscope_tasks.py:821] Performing ROI detection
2024-11-15 05:21:47,735,735 ERROR    [tasks.py:267] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 257, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 825, in _run
    self.roi_detection(ops)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 732, in roi_detection
    ret = suite2p.run_plane(ops)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/run_s2p.py", line 342, in run_plane
    ops = pipeline(f_reg, f_raw, f_reg_chan2, f_raw_chan2, run_registration, ops,
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/run_s2p.py", line 171, in pipeline
    ops, stat = detection.detection_wrapper(f_reg, ops=ops, classfile=classfile)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/detection/detect.py", line 135, in detection_wrapper
    mov = bin_movie(f_reg, bin_size, yrange=yrange, xrange=xrange,
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/detection/detect.py", line 53, in bin_movie
    for k in np.arange(0, n_frames, batch_size):
ValueError: Maximum allowed size exceeded

2024-11-15 05:21:47,736,736 INFO     [tasks.py:268] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2024-11-15 05:21:47,746,746 INFO     [tasks.py:280] N outputs: 19
2024-11-15 05:21:47,747,747 INFO     [tasks.py:281] --- 2255.840845346451 seconds run-time ---


e61f2413-e997-4c93-a0df-5f97ea501d81
2025-03-12 17:19:46,202,202 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-03-12 17:19:46,202,202 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-12 17:19:46,205,205 INFO     [tasks.py:487] Checking input files
2025-03-12 17:19:46,245,245 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-03-12 17:19:46,297,297 INFO     [tasks.py:412] All input files found: running task
2025-03-12 17:19:46,306,306 INFO     [tasks.py:243] Setup value is: True
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-12 17:19:46,334,334 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-12 17:19:46,335,335 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-12 17:19:46,335,335 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-12 17:19:46,335,335 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-12 17:19:46,335,335 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-12 17:19:46,335,335 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-12 17:19:46,335,335 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-12 17:19:46,335,335 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-12 17:19:46,335,335 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-12 17:19:46,335,335 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-12 17:19:46,335,335 INFO     [mesoscope_tasks.py:790] Extracting tif data per plane
2025-03-12 17:23:06,208,208 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 792, in _run
    plane_folders, _ = self.bin_per_plane(metadata, save_folder=save_folder, save_path0=self.session_path)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 689, in bin_per_plane
    ret = suite2p.io.mesoscan_to_binary(ops.copy())
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 330, in mesoscan_to_binary
    tif, Ltif = open_tiff(file, use_sktiff)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 92, in open_tiff
    tif = ScanImageTiffReader(file)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 173, in __init__
    self.open(filename)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 222, in open
    raise Exception(self.__ctx.log.decode("utf-8","strict"))
Exception: Got unrecognized element type in a tiff tag.

2025-03-12 17:23:06,209,209 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-03-12 17:23:06,304,304 INFO     [tasks.py:287] N outputs: 25
2025-03-12 17:23:06,305,305 INFO     [tasks.py:288] --- 200.10190534591675 seconds run-time ---


7464dd33-1c97-40cd-bfcb-69c40cf7885d
2024-07-14 23:39:26,683,683 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2024-07-14 23:39:26,683,683 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-14 23:39:26,684,684 INFO     [tasks.py:429] Checking input files
2024-07-14 23:39:26,815,815 INFO     [tasks.py:364] All input files found: running task
2024-07-14 23:39:26,815,815 INFO     [tasks.py:213] Setup value is: True
2024-07-14 23:39:50,087,87 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/ibllib/pipes/mesoscope_tasks.py", line 612, in _run
    _ = suite2p.run_s2p(ops=ops, db=db)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/suite2p/run_s2p.py", line 551, in run_s2p
    op = run_plane(op, ops_path=ops_path)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/suite2p/run_s2p.py", line 342, in run_plane
    ops = pipeline(f_reg, f_raw, f_reg_chan2, f_raw_chan2, run_registration, ops,
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/suite2p/run_s2p.py", line 171, in pipeline
    ops, stat = detection.detection_wrapper(f_reg, ops=ops, classfile=classfile)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/suite2p/detection/detect.py", line 135, in detection_wrapper
    mov = bin_movie(f_reg, bin_size, yrange=yrange, xrange=xrange,
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/suite2p/detection/detect.py", line 53, in bin_movie
    for k in np.arange(0, n_frames, batch_size):
ValueError: Maximum allowed size exceeded

2024-07-14 23:39:50,087,87 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2024-07-14 23:39:50,088,88 INFO     [tasks.py:253] N outputs: 0
2024-07-14 23:39:50,088,88 INFO     [tasks.py:254] --- 23.40401864051819 seconds run-time ---


89bc89da-df65-45d3-87d3-69a850173557
2025-03-12 17:23:29,882,882 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-03-12 17:23:29,883,883 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-12 17:23:29,885,885 INFO     [tasks.py:487] Checking input files
2025-03-12 17:23:30,122,122 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-03-12 17:23:30,159,159 INFO     [tasks.py:412] All input files found: running task
2025-03-12 17:23:30,167,167 INFO     [tasks.py:243] Setup value is: True
2025-03-12 17:23:30,194,194 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-12 17:23:30,194,194 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-12 17:23:30,195,195 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-12 17:23:30,195,195 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-12 17:23:30,195,195 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-12 17:23:30,195,195 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-12 17:23:30,196,196 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-12 17:23:30,196,196 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-12 17:23:30,197,197 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-12 17:23:30,197,197 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-12 17:23:30,197,197 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-12 17:23:30,197,197 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-12 17:23:30,199,199 INFO     [mesoscope_tasks.py:790] Extracting tif data per plane
2025-03-12 17:28:48,116,116 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 792, in _run
    plane_folders, _ = self.bin_per_plane(metadata, save_folder=save_folder, save_path0=self.session_path)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 689, in bin_per_plane
    ret = suite2p.io.mesoscan_to_binary(ops.copy())
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 330, in mesoscan_to_binary
    tif, Ltif = open_tiff(file, use_sktiff)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 92, in open_tiff
    tif = ScanImageTiffReader(file)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 173, in __init__
    self.open(filename)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 222, in open
    raise Exception(self.__ctx.log.decode("utf-8","strict"))
Exception: Got unrecognized element type in a tiff tag.

2025-03-12 17:28:48,116,116 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-03-12 17:28:48,219,219 INFO     [tasks.py:287] N outputs: 18
2025-03-12 17:28:48,219,219 INFO     [tasks.py:288] --- 318.3361783027649 seconds run-time ---


d925c9fb-5d6a-49a7-90c5-5d83d74045f2
2024-07-15 19:01:43,545,545 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2024-07-15 19:01:43,545,545 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-15 19:01:43,547,547 INFO     [tasks.py:429] Checking input files
2024-07-15 19:01:43,678,678 INFO     [tasks.py:364] All input files found: running task
2024-07-15 19:01:43,678,678 INFO     [tasks.py:213] Setup value is: True
2024-07-15 19:01:45,512,512 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2024-07-15 19:01:45,513,513 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2024-07-15 19:01:45,513,513 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2024-07-15 19:01:45,513,513 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2024-07-15 19:01:45,513,513 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2024-07-15 19:01:45,514,514 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2024-07-15 19:01:45,514,514 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2024-07-15 19:01:45,514,514 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2024-07-15 19:01:45,515,515 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key FOV. Using meta_data from first folder!
2024-07-15 19:01:45,515,515 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2024-07-15 19:01:45,515,515 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2024-07-15 19:01:45,515,515 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2024-07-15 19:01:45,515,515 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2024-07-15 19:01:45,516,516 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2024-07-15 19:01:45,516,516 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2024-07-15 19:01:45,516,516 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2024-07-15 19:01:45,516,516 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2024-07-15 19:01:45,517,517 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2024-07-15 19:01:45,517,517 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2024-07-15 19:01:45,517,517 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2024-07-15 19:01:45,517,517 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2024-07-15 19:01:45,518,518 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key FOV. Using meta_data from first folder!
2024-07-15 19:01:45,518,518 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2024-07-15 19:01:45,518,518 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2024-07-15 19:01:45,518,518 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2024-07-15 19:01:45,519,519 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2024-07-15 19:01:46,290,290 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/ibllib/pipes/mesoscope_tasks.py", line 583, in _run
    frameQC, frameQC_names, _ = self._consolidate_exptQC(exptQC)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/ibllib/pipes/mesoscope_tasks.py", line 423, in _consolidate_exptQC
    raise IOError(f'exptQC.mat files have different values for name "{k}"')
OSError: exptQC.mat files have different values for name "high signal"

2024-07-15 19:01:46,290,290 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2024-07-15 19:01:46,291,291 INFO     [tasks.py:253] N outputs: 0
2024-07-15 19:01:46,291,291 INFO     [tasks.py:254] --- 2.744699001312256 seconds run-time ---


7ce2f9f1-7b7e-4327-b25e-f7f8836bc32f
2025-03-12 17:29:10,547,547 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-03-12 17:29:10,548,548 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-12 17:29:10,550,550 INFO     [tasks.py:487] Checking input files
2025-03-12 17:29:10,693,693 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-03-12 17:29:10,744,744 INFO     [tasks.py:412] All input files found: running task
2025-03-12 17:29:10,751,751 INFO     [tasks.py:243] Setup value is: True
2025-03-12 17:29:10,780,780 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-12 17:29:10,780,780 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-12 17:29:10,781,781 INFO     [mesoscope_tasks.py:790] Extracting tif data per plane
2025-03-12 17:37:15,543,543 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 792, in _run
    plane_folders, _ = self.bin_per_plane(metadata, save_folder=save_folder, save_path0=self.session_path)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 689, in bin_per_plane
    ret = suite2p.io.mesoscan_to_binary(ops.copy())
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 330, in mesoscan_to_binary
    tif, Ltif = open_tiff(file, use_sktiff)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 92, in open_tiff
    tif = ScanImageTiffReader(file)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 173, in __init__
    self.open(filename)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 222, in open
    raise Exception(self.__ctx.log.decode("utf-8","strict"))
Exception: Got unrecognized element type in a tiff tag.

2025-03-12 17:37:15,543,543 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-03-12 17:37:15,544,544 INFO     [tasks.py:287] N outputs: 26
2025-03-12 17:37:15,545,545 INFO     [tasks.py:288] --- 484.9961576461792 seconds run-time ---


24688b7e-0ee6-4b9f-bf03-23638c079352
2025-03-12 17:37:37,991,991 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-03-12 17:37:37,991,991 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-12 17:37:37,993,993 INFO     [tasks.py:487] Checking input files
2025-03-12 17:37:38,184,184 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-03-12 17:37:38,225,225 INFO     [tasks.py:412] All input files found: running task
2025-03-12 17:37:38,229,229 INFO     [tasks.py:243] Setup value is: True
2025-03-12 17:37:38,255,255 INFO     [mesoscope_tasks.py:790] Extracting tif data per plane
2025-03-12 17:42:25,112,112 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 792, in _run
    plane_folders, _ = self.bin_per_plane(metadata, save_folder=save_folder, save_path0=self.session_path)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 689, in bin_per_plane
    ret = suite2p.io.mesoscan_to_binary(ops.copy())
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 330, in mesoscan_to_binary
    tif, Ltif = open_tiff(file, use_sktiff)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 92, in open_tiff
    tif = ScanImageTiffReader(file)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 173, in __init__
    self.open(filename)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 222, in open
    raise Exception(self.__ctx.log.decode("utf-8","strict"))
Exception: Got unrecognized element type in a tiff tag.

2025-03-12 17:42:25,113,113 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-03-12 17:42:25,214,214 INFO     [tasks.py:287] N outputs: 16
2025-03-12 17:42:25,214,214 INFO     [tasks.py:288] --- 287.2222774028778 seconds run-time ---


1d6dbacb-0d19-4436-acee-6b284bc5e822
2025-03-12 17:42:46,831,831 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-03-12 17:42:46,832,832 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-12 17:42:46,834,834 INFO     [tasks.py:487] Checking input files
2025-03-12 17:42:46,924,924 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-03-12 17:42:46,963,963 INFO     [tasks.py:412] All input files found: running task
2025-03-12 17:42:46,967,967 INFO     [tasks.py:243] Setup value is: True
2025-03-12 17:42:46,981,981 INFO     [mesoscope_tasks.py:790] Extracting tif data per plane
2025-03-12 17:50:11,979,979 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 792, in _run
    plane_folders, _ = self.bin_per_plane(metadata, save_folder=save_folder, save_path0=self.session_path)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 689, in bin_per_plane
    ret = suite2p.io.mesoscan_to_binary(ops.copy())
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 330, in mesoscan_to_binary
    tif, Ltif = open_tiff(file, use_sktiff)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 92, in open_tiff
    tif = ScanImageTiffReader(file)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 173, in __init__
    self.open(filename)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 222, in open
    raise Exception(self.__ctx.log.decode("utf-8","strict"))
Exception: Got unrecognized element type in a tiff tag.

2025-03-12 17:50:11,979,979 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-03-12 17:50:12,037,37 INFO     [tasks.py:287] N outputs: 16
2025-03-12 17:50:12,038,38 INFO     [tasks.py:288] --- 445.2051537036896 seconds run-time ---


c0ec7310-3d78-4f62-be57-acd46de7c610
2025-03-12 17:50:33,562,562 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-03-12 17:50:33,562,562 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-12 17:50:33,564,564 INFO     [tasks.py:487] Checking input files
2025-03-12 17:50:33,653,653 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-03-12 17:50:33,667,667 INFO     [tasks.py:412] All input files found: running task
2025-03-12 17:50:33,670,670 INFO     [tasks.py:243] Setup value is: True
2025-03-12 17:50:33,687,687 INFO     [mesoscope_tasks.py:790] Extracting tif data per plane
2025-03-12 17:52:12,524,524 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 792, in _run
    plane_folders, _ = self.bin_per_plane(metadata, save_folder=save_folder, save_path0=self.session_path)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 689, in bin_per_plane
    ret = suite2p.io.mesoscan_to_binary(ops.copy())
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 330, in mesoscan_to_binary
    tif, Ltif = open_tiff(file, use_sktiff)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 92, in open_tiff
    tif = ScanImageTiffReader(file)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 173, in __init__
    self.open(filename)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 222, in open
    raise Exception(self.__ctx.log.decode("utf-8","strict"))
Exception: Got unrecognized element type in a tiff tag.

2025-03-12 17:52:12,524,524 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-03-12 17:52:12,558,558 INFO     [tasks.py:287] N outputs: 4
2025-03-12 17:52:12,558,558 INFO     [tasks.py:288] --- 98.99532628059387 seconds run-time ---


188bb275-6c4a-4049-b761-b2cc5357b9ae
2025-06-15 11:31:33,057,57 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-06-15 11:31:33,057,57 INFO     [tasks.py:237] running ibllib version 3.4.0-dev2
2025-06-15 11:31:33,057,57 INFO     [tasks.py:487] Checking input files
2025-06-15 11:31:33,169,169 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-06-15 11:31:33,180,180 INFO     [tasks.py:412] All input files found: running task
2025-06-15 11:31:33,181,181 INFO     [tasks.py:243] Setup value is: True
2025-06-15 11:31:33,208,208 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-06-15 11:31:33,208,208 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-06-15 11:31:33,208,208 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-06-15 11:31:33,208,208 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-06-15 11:31:33,208,208 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-06-15 11:31:33,209,209 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-06-15 11:31:33,209,209 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-06-15 11:31:33,209,209 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-06-15 11:31:33,209,209 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-06-15 11:31:33,209,209 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-06-15 11:31:33,209,209 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-06-15 11:31:33,209,209 WARNING  [mesoscope_tasks.py:474] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-06-15 11:31:33,209,209 INFO     [mesoscope_tasks.py:793] Extracting tif data per plane
2025-06-15 11:32:08,583,583 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 795, in _run
    plane_folders, _ = self.bin_per_plane(metadata, save_folder=save_folder, save_path0=self.session_path)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 686, in bin_per_plane
    ret = suite2p.io.mesoscan_to_binary(ops.copy())
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 368, in mesoscan_to_binary
    nfunc = ops["functional_chan"] - 1
KeyError: 'functional_chan'

2025-06-15 11:32:08,583,583 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-06-15 11:32:08,626,626 INFO     [tasks.py:287] N outputs: 0
2025-06-15 11:32:08,626,626 INFO     [tasks.py:288] --- 35.56887340545654 seconds run-time ---


b9631aa2-f3bb-4ff2-9798-050f67f1336d
2024-07-16 01:03:48,185,185 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2024-07-16 01:03:48,186,186 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-16 01:03:48,187,187 INFO     [tasks.py:429] Checking input files
2024-07-16 01:03:48,413,413 INFO     [tasks.py:364] All input files found: running task
2024-07-16 01:03:48,413,413 INFO     [tasks.py:213] Setup value is: True
2024-07-16 01:03:49,659,659 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2024-07-16 01:03:49,659,659 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2024-07-16 01:03:49,659,659 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2024-07-16 01:03:49,659,659 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2024-07-16 01:03:49,659,659 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2024-07-16 01:03:49,659,659 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2024-07-16 01:03:49,659,659 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key rawScanImageMeta. Using meta_data from first folder!
2024-07-16 01:03:49,659,659 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2024-07-16 01:03:49,660,660 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2024-07-16 01:03:49,660,660 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2024-07-16 01:03:49,660,660 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2024-07-16 01:03:49,660,660 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2024-07-16 01:03:49,660,660 WARNING  [mesoscope_tasks.py:388] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2024-07-16 01:22:30,117,117 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/ibllib/pipes/mesoscope_tasks.py", line 612, in _run
    _ = suite2p.run_s2p(ops=ops, db=db)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/suite2p/run_s2p.py", line 551, in run_s2p
    op = run_plane(op, ops_path=ops_path)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/suite2p/run_s2p.py", line 342, in run_plane
    ops = pipeline(f_reg, f_raw, f_reg_chan2, f_raw_chan2, run_registration, ops,
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/suite2p/run_s2p.py", line 114, in pipeline
    registration_outputs = registration.registration_wrapper(
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.8/site-packages/suite2p/registration/register.py", line 678, in registration_wrapper
    badframes[bf_indices] = True
IndexError: index 54215 is out of bounds for axis 0 with size 23450

2024-07-16 01:22:30,117,117 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2024-07-16 01:22:30,118,118 INFO     [tasks.py:253] N outputs: 0
2024-07-16 01:22:30,118,118 INFO     [tasks.py:254] --- 1121.931301355362 seconds run-time ---


f7c55056-1c44-4ee5-a980-7a00df472a85
2025-08-15 18:24:26,410,410 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2025-08-15 18:24:26,411,411 INFO     [tasks.py:237] running ibllib version 3.4.1
2025-08-15 18:24:26,411,411 INFO     [tasks.py:487] Checking input files
2025-08-15 18:24:26,418,418 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_02/_ibl_rawImagingData.meta.json not found
2025-08-15 18:24:26,418,418 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_00/_ibl_rawImagingData.meta.json not found
2025-08-15 18:24:26,418,418 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_01/_ibl_rawImagingData.meta.json not found
2025-08-15 18:24:26,418,418 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_02/rawImagingData.times_scanImage.npy not found
2025-08-15 18:24:26,419,419 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_00/rawImagingData.times_scanImage.npy not found
2025-08-15 18:24:26,419,419 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_01/rawImagingData.times_scanImage.npy not found
2025-08-15 18:24:26,422,422 WARNING  [tasks.py:417] Not all input files found locally: will still attempt to rerun task
2025-08-15 18:24:26,424,424 ERROR    [tasks.py:351] Missing required input files: raw_imaging_data_02/rawImagingData.times_scanImage.npy, raw_imaging_data_00/rawImagingData.times_scanImage.npy, raw_imaging_data_01/rawImagingData.times_scanImage.npy
2025-08-15 18:24:26,425,425 INFO     [tasks.py:243] Setup value is: True
2025-08-15 18:24:26,427,427 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 904, in _run
    self.rawImagingData = alfio.load_object(self.session_path / next(iter(collections)), 'rawImagingData')
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/one/alf/io.py", line 521, in load_object
    files_alf, parts = _ls(alfpath, object, **kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/one/alf/io.py", line 379, in _ls
    raise ALFObjectNotFound(f'No {err_str} found in {alfpath}')
one.alf.exceptions.ALFObjectNotFound: No object "rawImagingData" found in /mnt/s0/Data/Subjects/SP072/2025-08-08/001/raw_imaging_data_01 
 The ALF object was not found.  This may occur if the object or namespace or incorrectly formatted e.g. the object "_ibl_trials.intervals.npy" would be found with the filters `object="trials", namespace="ibl"` 

2025-08-15 18:24:26,427,427 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2025-08-15 18:24:26,427,427 INFO     [tasks.py:287] N outputs: 0
2025-08-15 18:24:26,427,427 INFO     [tasks.py:288] --- 0.016222715377807617 seconds run-time ---


3c704925-0399-4b58-9fde-3267a1e26fa0
2025-08-07 13:55:09,943,943 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2025-08-07 13:55:09,943,943 INFO     [tasks.py:237] running ibllib version 3.4.1
2025-08-07 13:55:09,943,943 INFO     [tasks.py:487] Checking input files
2025-08-07 13:55:09,953,953 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_02/_ibl_rawImagingData.meta.json not found
2025-08-07 13:55:09,953,953 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_01/_ibl_rawImagingData.meta.json not found
2025-08-07 13:55:09,953,953 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_00/_ibl_rawImagingData.meta.json not found
2025-08-07 13:55:09,953,953 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_01/rawImagingData.times_scanImage.npy not found
2025-08-07 13:55:09,953,953 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_00/rawImagingData.times_scanImage.npy not found
2025-08-07 13:55:09,953,953 ERROR    [tasks.py:543] Signature file pattern raw_imaging_data_02/rawImagingData.times_scanImage.npy not found
2025-08-07 13:55:09,959,959 WARNING  [tasks.py:417] Not all input files found locally: will still attempt to rerun task
2025-08-07 13:55:09,962,962 ERROR    [tasks.py:351] Missing required input files: raw_imaging_data_01/rawImagingData.times_scanImage.npy, raw_imaging_data_00/rawImagingData.times_scanImage.npy, raw_imaging_data_02/rawImagingData.times_scanImage.npy
2025-08-07 13:55:09,962,962 INFO     [tasks.py:243] Setup value is: True
2025-08-07 13:55:09,966,966 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 903, in _run
    self.rawImagingData = alfio.load_object(self.session_path / next(iter(collections)), 'rawImagingData')
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/one/alf/io.py", line 521, in load_object
    files_alf, parts = _ls(alfpath, object, **kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/one/alf/io.py", line 379, in _ls
    raise ALFObjectNotFound(f'No {err_str} found in {alfpath}')
one.alf.exceptions.ALFObjectNotFound: No object "rawImagingData" found in /mnt/s0/Data/Subjects/SP072/2025-08-05/001/raw_imaging_data_00 
 The ALF object was not found.  This may occur if the object or namespace or incorrectly formatted e.g. the object "_ibl_trials.intervals.npy" would be found with the filters `object="trials", namespace="ibl"` 

2025-08-07 13:55:09,966,966 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2025-08-07 13:55:09,966,966 INFO     [tasks.py:287] N outputs: 0
2025-08-07 13:55:09,966,966 INFO     [tasks.py:288] --- 0.023300886154174805 seconds run-time ---


78fbeac2-9d3d-4598-9c12-082e46c579d2
2025-05-12 10:15:40,814,814 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2025-05-12 10:15:40,815,815 INFO     [tasks.py:237] running ibllib version 3.3.1
2025-05-12 10:15:40,815,815 INFO     [tasks.py:487] Checking input files
2025-05-12 10:15:40,842,842 INFO     [tasks.py:412] All input files found: running task
2025-05-12 10:15:40,847,847 INFO     [tasks.py:243] Setup value is: True
2025-05-12 10:15:41,175,175 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 905, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 55, in extract
    files = self._save(out, path_out=path_out) if save else None
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 117, in _save
    _write_to_disk(fpath, data)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 82, in _write_to_disk
    raise ValueError(f'Data for {filename} appears to be empty')
ValueError: Data for alf/FOV_00/mpci.times.npy appears to be empty

2025-05-12 10:15:41,176,176 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2025-05-12 10:15:41,176,176 INFO     [tasks.py:287] N outputs: 3
2025-05-12 10:15:41,176,176 INFO     [tasks.py:288] --- 0.36074233055114746 seconds run-time ---


e52aa4c4-c179-4ae3-b52e-38ebc8b40332
2024-11-19 13:41:23,556,556 INFO     [tasks.py:231] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-11-19 13:41:23,556,556 INFO     [tasks.py:234] running ibllib version 3.0rc0
2024-11-19 13:41:23,557,557 INFO     [tasks.py:480] Checking input files
2024-11-19 13:41:23,571,571 INFO     [tasks.py:405] All input files found: running task
2024-11-19 13:41:23,578,578 INFO     [tasks.py:240] Setup value is: True
2024-11-19 13:41:23,613,613 ERROR    [tasks.py:267] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 257, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 886, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 665, in _extract
    edges = self.get_bout_edges(frame_times, device_collection, events)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 754, in get_bout_edges
    edges = np.c_[starts, ends]
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/numpy/lib/index_tricks.py", line 419, in __getitem__
    res = self.concatenate(tuple(objs), axis=axis)
  File "<__array_function__ internals>", line 200, in concatenate
ValueError: all the input array dimensions except for the concatenation axis must match exactly, but along dimension 0, the array at index 0 has size 2 and the array at index 1 has size 1

2024-11-19 13:41:23,614,614 INFO     [tasks.py:268] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-11-19 13:41:23,614,614 INFO     [tasks.py:280] N outputs: 18
2024-11-19 13:41:23,614,614 INFO     [tasks.py:281] --- 0.057367563247680664 seconds run-time ---


6ba2c02f-81be-47b8-ad0b-7bf3c72b7bf5
2025-05-12 10:15:42,449,449 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2025-05-12 10:15:42,450,450 INFO     [tasks.py:237] running ibllib version 3.3.1
2025-05-12 10:15:42,450,450 INFO     [tasks.py:487] Checking input files
2025-05-12 10:15:42,476,476 INFO     [tasks.py:412] All input files found: running task
2025-05-12 10:15:42,479,479 INFO     [tasks.py:243] Setup value is: True
2025-05-12 10:15:42,772,772 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 905, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 55, in extract
    files = self._save(out, path_out=path_out) if save else None
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 117, in _save
    _write_to_disk(fpath, data)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 82, in _write_to_disk
    raise ValueError(f'Data for {filename} appears to be empty')
ValueError: Data for alf/FOV_00/mpci.times.npy appears to be empty

2025-05-12 10:15:42,773,773 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2025-05-12 10:15:42,773,773 INFO     [tasks.py:287] N outputs: 3
2025-05-12 10:15:42,773,773 INFO     [tasks.py:288] --- 0.3228473663330078 seconds run-time ---


d613f6ac-8354-4b8f-a1b4-1c539568dc9e
2025-05-12 10:15:44,017,17 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2025-05-12 10:15:44,018,18 INFO     [tasks.py:237] running ibllib version 3.3.1
2025-05-12 10:15:44,018,18 INFO     [tasks.py:487] Checking input files
2025-05-12 10:15:44,027,27 INFO     [tasks.py:412] All input files found: running task
2025-05-12 10:15:44,028,28 INFO     [tasks.py:243] Setup value is: True
2025-05-12 10:15:44,168,168 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 905, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 55, in extract
    files = self._save(out, path_out=path_out) if save else None
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 117, in _save
    _write_to_disk(fpath, data)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 82, in _write_to_disk
    raise ValueError(f'Data for {filename} appears to be empty')
ValueError: Data for alf/FOV_00/mpci.times.npy appears to be empty

2025-05-12 10:15:44,169,169 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2025-05-12 10:15:44,169,169 INFO     [tasks.py:287] N outputs: 1
2025-05-12 10:15:44,169,169 INFO     [tasks.py:288] --- 0.15095853805541992 seconds run-time ---


f637e7e8-2333-4a66-b072-ea495d351004
2025-05-12 10:15:45,120,120 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2025-05-12 10:15:45,120,120 INFO     [tasks.py:237] running ibllib version 3.3.1
2025-05-12 10:15:45,121,121 INFO     [tasks.py:487] Checking input files
2025-05-12 10:15:45,129,129 INFO     [tasks.py:412] All input files found: running task
2025-05-12 10:15:45,130,130 INFO     [tasks.py:243] Setup value is: True
2025-05-12 10:15:45,345,345 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 905, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 55, in extract
    files = self._save(out, path_out=path_out) if save else None
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 117, in _save
    _write_to_disk(fpath, data)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 82, in _write_to_disk
    raise ValueError(f'Data for {filename} appears to be empty')
ValueError: Data for alf/FOV_00/mpci.times.npy appears to be empty

2025-05-12 10:15:45,346,346 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2025-05-12 10:15:45,346,346 INFO     [tasks.py:287] N outputs: 1
2025-05-12 10:15:45,346,346 INFO     [tasks.py:288] --- 0.22565960884094238 seconds run-time ---


a6bb2f92-8785-4aaf-929f-87731a27669e
2024-07-29 10:58:06,013,13 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-07-29 10:58:06,013,13 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-29 10:58:06,013,13 INFO     [tasks.py:429] Checking input files
2024-07-29 10:58:06,024,24 INFO     [tasks.py:364] All input files found: running task
2024-07-29 10:58:06,024,24 INFO     [tasks.py:213] Setup value is: True
2024-07-29 10:58:06,053,53 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 672, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 649, in _extract
    edges = self.get_bout_edges(frame_times, device_collection, events)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 746, in get_bout_edges
    raise ValueError('More raw imaging folders than detected bouts')
ValueError: More raw imaging folders than detected bouts

2024-07-29 10:58:06,053,53 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-07-29 10:58:06,053,53 INFO     [tasks.py:253] N outputs: 0
2024-07-29 10:58:06,053,53 INFO     [tasks.py:254] --- 0.04025149345397949 seconds run-time ---


55bd16b7-4e28-4edb-bf57-6ccd1cb4eedb
2024-07-09 15:28:39,603,603 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-07-09 15:28:39,603,603 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-09 15:28:39,603,603 INFO     [tasks.py:429] Checking input files
2024-07-09 15:28:39,608,608 INFO     [tasks.py:364] All input files found: running task
2024-07-09 15:28:39,608,608 INFO     [tasks.py:213] Setup value is: True
2024-07-09 15:28:39,655,655 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 672, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 649, in _extract
    edges = self.get_bout_edges(frame_times, device_collection, events)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 746, in get_bout_edges
    raise ValueError('More raw imaging folders than detected bouts')
ValueError: More raw imaging folders than detected bouts

2024-07-09 15:28:39,656,656 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-07-09 15:28:39,656,656 INFO     [tasks.py:253] N outputs: 0
2024-07-09 15:28:39,656,656 INFO     [tasks.py:254] --- 0.052617788314819336 seconds run-time ---


8e1cfaa5-e2be-4118-9237-3cc6e5cfba6f
2024-07-09 14:00:37,207,207 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-07-09 14:00:37,211,211 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-09 14:00:37,215,215 INFO     [tasks.py:429] Checking input files
2024-07-09 14:00:37,270,270 INFO     [tasks.py:364] All input files found: running task
2024-07-09 14:00:37,270,270 INFO     [tasks.py:213] Setup value is: True
2024-07-09 14:00:37,482,482 WARNING  [mesoscope.py:661] More DAQ frame times detected for raw_imaging_data_00 than were found in the raw image data.
N DAQ frame times:	7828
N raw image data times:	7808.
This may occur if the bout detection fails (e.g. UDPs recorded late), when image data is corrupt, or when frames are not written to file.
2024-07-09 14:00:37,486,486 INFO     [mesoscope.py:667] Dropping last 20 frame times for raw_imaging_data_00
2024-07-09 14:00:37,498,498 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 672, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 659, in _extract
    assert ts.size >= imaging_data['times_scanImage'].size, f'fewer DAQ timestamps for {collection} than expected'
AssertionError: fewer DAQ timestamps for raw_imaging_data_01 than expected

2024-07-09 14:00:37,500,500 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-07-09 14:00:37,502,502 INFO     [tasks.py:253] N outputs: 0
2024-07-09 14:00:37,504,504 INFO     [tasks.py:254] --- 0.2878227233886719 seconds run-time ---


f3326cc1-14e0-4364-96b4-3e7d9bc4c072
2024-07-09 14:04:45,555,555 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-07-09 14:04:45,556,556 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-09 14:04:45,557,557 INFO     [tasks.py:429] Checking input files
2024-07-09 14:04:45,591,591 INFO     [tasks.py:364] All input files found: running task
2024-07-09 14:04:45,591,591 INFO     [tasks.py:213] Setup value is: True
2024-07-09 14:04:45,938,938 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 672, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 649, in _extract
    edges = self.get_bout_edges(frame_times, device_collection, events)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 746, in get_bout_edges
    raise ValueError('More raw imaging folders than detected bouts')
ValueError: More raw imaging folders than detected bouts

2024-07-09 14:04:45,939,939 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-07-09 14:04:45,940,940 INFO     [tasks.py:253] N outputs: 0
2024-07-09 14:04:45,941,941 INFO     [tasks.py:254] --- 0.38386988639831543 seconds run-time ---


e61f2413-e997-4c93-a0df-5f97ea501d81
2024-07-09 14:04:47,486,486 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-07-09 14:04:47,487,487 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-09 14:04:47,488,488 INFO     [tasks.py:429] Checking input files
2024-07-09 14:04:47,534,534 INFO     [tasks.py:364] All input files found: running task
2024-07-09 14:04:47,534,534 INFO     [tasks.py:213] Setup value is: True
2024-07-09 14:04:47,827,827 WARNING  [mesoscope.py:661] More DAQ frame times detected for raw_imaging_data_00 than were found in the raw image data.
N DAQ frame times:	6611
N raw image data times:	6610.
This may occur if the bout detection fails (e.g. UDPs recorded late), when image data is corrupt, or when frames are not written to file.
2024-07-09 14:04:47,828,828 INFO     [mesoscope.py:667] Dropping last 1 frame times for raw_imaging_data_00
2024-07-09 14:04:47,878,878 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 672, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 659, in _extract
    assert ts.size >= imaging_data['times_scanImage'].size, f'fewer DAQ timestamps for {collection} than expected'
AssertionError: fewer DAQ timestamps for raw_imaging_data_01 than expected

2024-07-09 14:04:47,879,879 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-07-09 14:04:47,880,880 INFO     [tasks.py:253] N outputs: 0
2024-07-09 14:04:47,880,880 INFO     [tasks.py:254] --- 0.39223670959472656 seconds run-time ---


e442aa1a-a378-41a0-9fd3-89f21c1f2ec0
2024-07-09 14:04:48,512,512 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-07-09 14:04:48,513,513 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-09 14:04:48,514,514 INFO     [tasks.py:429] Checking input files
2024-07-09 14:04:48,553,553 INFO     [tasks.py:364] All input files found: running task
2024-07-09 14:04:48,553,553 INFO     [tasks.py:213] Setup value is: True
2024-07-09 14:04:48,696,696 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 672, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 649, in _extract
    edges = self.get_bout_edges(frame_times, device_collection, events)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 746, in get_bout_edges
    raise ValueError('More raw imaging folders than detected bouts')
ValueError: More raw imaging folders than detected bouts

2024-07-09 14:04:48,697,697 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-07-09 14:04:48,698,698 INFO     [tasks.py:253] N outputs: 0
2024-07-09 14:04:48,699,699 INFO     [tasks.py:254] --- 0.18456459045410156 seconds run-time ---


5c21d1df-abfb-4434-9bed-fafc6f5f226d
2024-07-09 14:05:19,093,93 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-07-09 14:05:19,094,94 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-09 14:05:19,096,96 INFO     [tasks.py:429] Checking input files
2024-07-09 14:05:19,126,126 INFO     [tasks.py:364] All input files found: running task
2024-07-09 14:05:19,127,127 INFO     [tasks.py:213] Setup value is: True
2024-07-09 14:05:19,529,529 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 672, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 659, in _extract
    assert ts.size >= imaging_data['times_scanImage'].size, f'fewer DAQ timestamps for {collection} than expected'
AssertionError: fewer DAQ timestamps for raw_imaging_data_00 than expected

2024-07-09 14:05:19,531,531 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-07-09 14:05:19,532,532 INFO     [tasks.py:253] N outputs: 0
2024-07-09 14:05:19,532,532 INFO     [tasks.py:254] --- 0.43621373176574707 seconds run-time ---


2e9fb889-842f-46f6-8405-4e3f5ae86d27
2024-07-09 14:05:20,973,973 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-07-09 14:05:20,974,974 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-09 14:05:20,975,975 INFO     [tasks.py:429] Checking input files
2024-07-09 14:05:21,019,19 INFO     [tasks.py:364] All input files found: running task
2024-07-09 14:05:21,019,19 INFO     [tasks.py:213] Setup value is: True
2024-07-09 14:05:21,275,275 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 672, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 649, in _extract
    edges = self.get_bout_edges(frame_times, device_collection, events)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 746, in get_bout_edges
    raise ValueError('More raw imaging folders than detected bouts')
ValueError: More raw imaging folders than detected bouts

2024-07-09 14:05:21,277,277 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-07-09 14:05:21,278,278 INFO     [tasks.py:253] N outputs: 0
2024-07-09 14:05:21,279,279 INFO     [tasks.py:254] --- 0.30266404151916504 seconds run-time ---


3294c87d-0bbd-44c1-b245-b7061e8ab104
2024-07-09 14:05:21,886,886 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-07-09 14:05:21,888,888 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-09 14:05:21,889,889 INFO     [tasks.py:429] Checking input files
2024-07-09 14:05:21,934,934 INFO     [tasks.py:364] All input files found: running task
2024-07-09 14:05:21,934,934 INFO     [tasks.py:213] Setup value is: True
2024-07-09 14:05:22,202,202 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 672, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 649, in _extract
    edges = self.get_bout_edges(frame_times, device_collection, events)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 746, in get_bout_edges
    raise ValueError('More raw imaging folders than detected bouts')
ValueError: More raw imaging folders than detected bouts

2024-07-09 14:05:22,203,203 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-07-09 14:05:22,204,204 INFO     [tasks.py:253] N outputs: 0
2024-07-09 14:05:22,205,205 INFO     [tasks.py:254] --- 0.3157479763031006 seconds run-time ---


2f8c75b4-a9cf-4337-8a07-a7ab79f54c32
2025-03-17 16:10:12,467,467 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2025-03-17 16:10:12,467,467 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-17 16:10:12,468,468 INFO     [tasks.py:487] Checking input files
2025-03-17 16:10:12,475,475 INFO     [tasks.py:412] All input files found: running task
2025-03-17 16:10:12,476,476 INFO     [tasks.py:243] Setup value is: True
2025-03-17 16:10:12,813,813 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 905, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 675, in _extract
    assert ts.size >= imaging_data['times_scanImage'].size, f'fewer DAQ timestamps for {collection} than expected'
AssertionError: fewer DAQ timestamps for raw_imaging_data_00 than expected

2025-03-17 16:10:12,814,814 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2025-03-17 16:10:12,814,814 INFO     [tasks.py:287] N outputs: 1
2025-03-17 16:10:12,815,815 INFO     [tasks.py:288] --- 0.34656763076782227 seconds run-time ---


188bb275-6c4a-4049-b761-b2cc5357b9ae
2025-06-13 19:03:01,115,115 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2025-06-13 19:03:01,115,115 INFO     [tasks.py:237] running ibllib version 3.4.0-dev2
2025-06-13 19:03:01,116,116 INFO     [tasks.py:487] Checking input files
2025-06-13 19:03:01,122,122 INFO     [tasks.py:412] All input files found: running task
2025-06-13 19:03:01,123,123 INFO     [tasks.py:243] Setup value is: True
2025-06-13 19:03:01,172,172 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 909, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 730, in _extract
    volume_times = sync['times'][sync['channels'] == chmap['volume_counter']]
KeyError: 'volume_counter'

2025-06-13 19:03:01,172,172 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2025-06-13 19:03:01,172,172 INFO     [tasks.py:287] N outputs: 2
2025-06-13 19:03:01,172,172 INFO     [tasks.py:288] --- 0.05708169937133789 seconds run-time ---


1a29c29d-9844-49c0-b67c-c91ac7f8dd53
2024-07-09 14:05:49,678,678 INFO     [tasks.py:204] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'>
2024-07-09 14:05:49,679,679 INFO     [tasks.py:207] running ibllib version 2.38.0
2024-07-09 14:05:49,681,681 INFO     [tasks.py:429] Checking input files
2024-07-09 14:05:49,734,734 INFO     [tasks.py:364] All input files found: running task
2024-07-09 14:05:49,734,734 INFO     [tasks.py:213] Setup value is: True
2024-07-09 14:05:49,773,773 ERROR    [tasks.py:240] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 230, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 672, in _run
    _, out_files = mesosync.extract(
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/base.py", line 54, in extract
    out = self._extract(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/iblenv/lib/python3.10/site-packages/ibllib/io/extractors/mesoscope.py", line 659, in _extract
    assert ts.size >= imaging_data['times_scanImage'].size, f'fewer DAQ timestamps for {collection} than expected'
AssertionError: fewer DAQ timestamps for raw_imaging_data_00 than expected

2024-07-09 14:05:49,774,774 INFO     [tasks.py:241] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopeSync'> errored
2024-07-09 14:05:49,774,774 INFO     [tasks.py:253] N outputs: 0
2024-07-09 14:05:49,774,774 INFO     [tasks.py:254] --- 0.09318757057189941 seconds run-time ---


71f1b8c2-0f71-4524-986f-04abc723cd02
2025-03-20 10:05:35,294,294 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-03-20 10:05:35,294,294 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-20 10:05:35,294,294 INFO     [tasks.py:487] Checking input files
2025-03-20 10:05:35,841,841 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-03-20 10:05:35,897,897 INFO     [tasks.py:412] All input files found: running task
2025-03-20 10:05:35,907,907 INFO     [tasks.py:243] Setup value is: True
2025-03-20 10:05:35,932,932 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-20 10:05:35,932,932 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-20 10:05:35,932,932 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-20 10:05:35,932,932 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-20 10:05:35,933,933 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-20 10:05:35,934,934 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-20 10:05:35,934,934 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-20 10:05:35,987,987 INFO     [mesoscope_tasks.py:829] Performing registration
2025-03-20 10:05:35,988,988 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 831, in _run
    ops = np.load(plane.joinpath('ops.npy'), allow_pickle=True).item()
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/numpy/lib/npyio.py", line 427, in load
    fid = stack.enter_context(open(os_fspath(file), "rb"))
FileNotFoundError: [Errno 2] No such file or directory: '/mnt/s0/Data/Subjects/SP058/2024-07-17/001/suite2p/plane0/ops.npy'

2025-03-20 10:05:35,988,988 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-03-20 10:05:35,988,988 INFO     [tasks.py:287] N outputs: 27
2025-03-20 10:05:35,988,988 INFO     [tasks.py:288] --- 0.694389820098877 seconds run-time ---


d5547f49-70ad-41ce-b17b-125944ad6226
2025-03-14 05:01:49,576,576 INFO     [tasks.py:234] Starting job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'>
2025-03-14 05:01:49,577,577 INFO     [tasks.py:237] running ibllib version 3.3.0
2025-03-14 05:01:49,579,579 INFO     [tasks.py:487] Checking input files
2025-03-14 05:01:49,722,722 WARNING  [tasks.py:500] Some files are not ALF datasets and will not be checked for ambiguity
2025-03-14 05:01:49,780,780 INFO     [tasks.py:412] All input files found: running task
2025-03-14 05:01:49,788,788 INFO     [tasks.py:243] Setup value is: True
2025-03-14 05:01:49,813,813 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key version. Using meta_data from first folder!
2025-03-14 05:01:49,813,813 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelID. Using meta_data from first folder!
2025-03-14 05:01:49,813,813 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key laserPowerCalibration. Using meta_data from first folder!
2025-03-14 05:01:49,813,813 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key imageOrientation. Using meta_data from first folder!
2025-03-14 05:01:49,814,814 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerDeg. Using meta_data from first folder!
2025-03-14 05:01:49,814,814 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key centerMM. Using meta_data from first folder!
2025-03-14 05:01:49,814,814 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key PMTGain. Using meta_data from first folder!
2025-03-14 05:01:49,814,814 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key channelSaved. Using meta_data from first folder!
2025-03-14 05:01:49,814,814 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key acquisitionStartTime. Using meta_data from first folder!
2025-03-14 05:01:49,814,814 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key nFrames. Using meta_data from first folder!
2025-03-14 05:01:49,814,814 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key scanImageParams. Using meta_data from first folder!
2025-03-14 05:01:49,814,814 WARNING  [mesoscope_tasks.py:475] Mismatch in meta data between raw_imaging_data folders for key coordsTF. Using meta_data from first folder!
2025-03-14 05:01:49,814,814 INFO     [mesoscope_tasks.py:790] Extracting tif data per plane
2025-03-14 05:15:54,629,629 ERROR    [tasks.py:272] Traceback (most recent call last):
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/tasks.py", line 262, in run
    outputs = self._run(**kwargs)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 792, in _run
    plane_folders, _ = self.bin_per_plane(metadata, save_folder=save_folder, save_path0=self.session_path)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ibllib/pipes/mesoscope_tasks.py", line 689, in bin_per_plane
    ret = suite2p.io.mesoscan_to_binary(ops.copy())
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 330, in mesoscan_to_binary
    tif, Ltif = open_tiff(file, use_sktiff)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/suite2p/io/tiff.py", line 92, in open_tiff
    tif = ScanImageTiffReader(file)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 173, in __init__
    self.open(filename)
  File "/home/ibladmin/Documents/PYTHON/envs/suite2p/lib/python3.10/site-packages/ScanImageTiffReader/__init__.py", line 222, in open
    raise Exception(self.__ctx.log.decode("utf-8","strict"))
Exception: Got unrecognized element type in a tiff tag.

2025-03-14 05:15:54,629,629 INFO     [tasks.py:273] Job <class 'ibllib.pipes.mesoscope_tasks.MesoscopePreprocess'> errored
2025-03-14 05:15:54,689,689 INFO     [tasks.py:287] N outputs: 36
2025-03-14 05:15:54,689,689 INFO     [tasks.py:288] --- 845.1120774745941 seconds run-time ---