Version Number

v1.1.0.9

Describe the bug

When running face and eyetracking I frequently have my tracking suddenly stop. I think ideally it would be nice if the software could auto reconnect when this issue occurs. Currently manually clicking start again resumes the feeds, but I don't want to click start every time this happens.

Steps to reproduce

I'm providing 3 video streams to Baballonia from my Quest 3, and hit start to begin tracking. After that its normal passive use until Baballonia stops processing the feeds.

Expected behavior

Ideally video stream should never stop, and make reasonable effort to keep the stream going.

Operating System

Windows 10

Hardware setup

ETVR (wifi)

Log Files

[Baballonia.Views.MainWindow] Information: Baballonia version 1.1.0.9 starting...
[Microsoft.Hosting.Lifetime] Information: Application started. Press Ctrl+C to shut down.
[Microsoft.Hosting.Lifetime] Information: Hosting environment: Production
[Microsoft.Hosting.Lifetime] Information: Content root path: C:\Users\stel9\AppData\Local\Baballonia
[DefaultInferenceRunner.tuned_temporal_eye_tracking_20260206_064614.onnx] Information: Initialized ExecutionProvider: DirectML for C:\Users\stel9\AppData\Roaming\ProjectBabble\Models\tuned_temporal_eye_tracking_20260206_064614.onnx
[DefaultInferenceRunner.faceModel.onnx] Information: Initialized ExecutionProvider: DirectML for C:\Users\stel9\AppData\Local\Baballonia\faceModel.onnx
[DefaultInferenceRunner.tuned_temporal_eye_tracking_20260206_064614.onnx] Information: C:\Users\stel9\AppData\Roaming\ProjectBabble\Models\tuned_temporal_eye_tracking_20260206_064614.onnx initialization finished
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[DefaultInferenceRunner.faceModel.onnx] Information: C:\Users\stel9\AppData\Local\Baballonia\faceModel.onnx initialization finished
[Baballonia.Services.ActivationService] Information: Configuring OpenVR...
[Baballonia.Services.OpenVRService] Information: Successfully Added to SteamVR startup apps
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[DefaultInferenceRunner.tuned_temporal_eye_tracking_20260206_064614.onnx] Information: Initialized ExecutionProvider: DirectML for C:/Users/stel9/AppData/Roaming/ProjectBabble/Models/tuned_temporal_eye_tracking_20260206_064614.onnx
[DefaultInferenceRunner.tuned_temporal_eye_tracking_20260206_064614.onnx] Information: C:/Users/stel9/AppData/Roaming/ProjectBabble/Models/tuned_temporal_eye_tracking_20260206_064614.onnx initialization finished
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Face Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: src.cols > 0 && src.rows > 0
at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData)
at OpenCvSharp.Internal.NativeMethods.imgproc_warpAffine(IntPtr src, IntPtr dst, IntPtr m, Size dsize, Int32 flags, Int32 borderMode, Scalar borderValue)
at Baballonia.Services.Inference.ImageTransformer.Apply(Mat image) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\Transformers\ImageTransformer.cs:line 21
at Baballonia.Services.Inference.FaceProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\FaceProcessingPipeline.cs:line 28
at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 63
[Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Eye Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: !ssize.empty()
at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData)
at OpenCvSharp.Internal.NativeMethods.imgproc_resize(IntPtr src, IntPtr dst, Size dsize, Double fx, Double fy, Int32 interpolation)
at Baballonia.Services.Inference.DualCameraSource.GetFrame(Nullable1 color) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\VideoSources\DualCameraSource.cs:line 62 at Baballonia.Services.Inference.EyeProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\EyeProcessingPipeline.cs:line 22 at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 76 [Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Eye Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: !ssize.empty() at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData) at OpenCvSharp.Internal.NativeMethods.imgproc_resize(IntPtr src, IntPtr dst, Size dsize, Double fx, Double fy, Int32 interpolation) at Baballonia.Services.Inference.DualCameraSource.GetFrame(Nullable1 color) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\VideoSources\DualCameraSource.cs:line 62
at Baballonia.Services.Inference.EyeProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\EyeProcessingPipeline.cs:line 22
at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 76
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Eye Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: !ssize.empty()
at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData)
at OpenCvSharp.Internal.NativeMethods.imgproc_resize(IntPtr src, IntPtr dst, Size dsize, Double fx, Double fy, Int32 interpolation)
at Baballonia.Services.Inference.DualCameraSource.GetFrame(Nullable1 color) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\VideoSources\DualCameraSource.cs:line 62 at Baballonia.Services.Inference.EyeProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\EyeProcessingPipeline.cs:line 22 at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 76 [Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Face Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: !_src.empty() at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData) at OpenCvSharp.Internal.NativeMethods.imgproc_cvtColor(IntPtr src, IntPtr dst, Int32 code, Int32 dstCn) at OpenCvSharp.Cv2.CvtColor(InputArray src, OutputArray dst, ColorConversionCodes code, Int32 dstCn) at Baballonia.Services.Inference.VideoSources.SingleCameraSource.GetFrame(Nullable1 color) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\VideoSources\SingleCameraSource.cs:line 76
at Baballonia.Services.Inference.FaceProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\FaceProcessingPipeline.cs:line 22
at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 63
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Eye Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: !_src.empty()
at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData)
at OpenCvSharp.Internal.NativeMethods.imgproc_cvtColor(IntPtr src, IntPtr dst, Int32 code, Int32 dstCn)
at OpenCvSharp.Cv2.CvtColor(InputArray src, OutputArray dst, ColorConversionCodes code, Int32 dstCn)
at Baballonia.Services.Inference.VideoSources.SingleCameraSource.GetFrame(Nullable1 color) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\VideoSources\SingleCameraSource.cs:line 76 at Baballonia.Services.Inference.DualCameraSource.GetFrame(Nullable1 color) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\VideoSources\DualCameraSource.cs:line 29
at Baballonia.Services.Inference.EyeProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\EyeProcessingPipeline.cs:line 22
at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 76
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Face Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: src.cols > 0 && src.rows > 0
at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData)
at OpenCvSharp.Internal.NativeMethods.imgproc_warpAffine(IntPtr src, IntPtr dst, IntPtr m, Size dsize, Int32 flags, Int32 borderMode, Scalar borderValue)
at Baballonia.Services.Inference.ImageTransformer.Apply(Mat image) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\Transformers\ImageTransformer.cs:line 21
at Baballonia.Services.Inference.FaceProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\FaceProcessingPipeline.cs:line 28
at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 63
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Eye Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: inv_scale_x > 0
at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData)
at OpenCvSharp.Internal.NativeMethods.imgproc_resize(IntPtr src, IntPtr dst, Size dsize, Double fx, Double fy, Int32 interpolation)
at Baballonia.Services.Inference.DualCameraSource.GetFrame(Nullable1 color) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\VideoSources\DualCameraSource.cs:line 62 at Baballonia.Services.Inference.EyeProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\EyeProcessingPipeline.cs:line 22 at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 76 [Baballonia.Services.LocalSettingsService] Information: Saving settings [Baballonia.Services.LocalSettingsService] Information: Saving settings [Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Eye Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: inv_scale_x > 0 at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData) at OpenCvSharp.Internal.NativeMethods.imgproc_resize(IntPtr src, IntPtr dst, Size dsize, Double fx, Double fy, Int32 interpolation) at Baballonia.Services.Inference.DualCameraSource.GetFrame(Nullable1 color) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\VideoSources\DualCameraSource.cs:line 62
at Baballonia.Services.Inference.EyeProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\EyeProcessingPipeline.cs:line 22
at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 76
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Face Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: src.cols > 0 && src.rows > 0
at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData)
at OpenCvSharp.Internal.NativeMethods.imgproc_warpAffine(IntPtr src, IntPtr dst, IntPtr m, Size dsize, Int32 flags, Int32 borderMode, Scalar borderValue)
at Baballonia.Services.Inference.ImageTransformer.Apply(Mat image) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\Transformers\ImageTransformer.cs:line 21
at Baballonia.Services.Inference.FaceProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\FaceProcessingPipeline.cs:line 28
at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 63
[Baballonia.Services.Inference.SingleCameraSourceFactory] Error: No data was received from http://localhost:8081/mouthtracker, with IpCameraCapture, closing... Maybe the camera is opened somewhere else?
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Face Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: src.cols > 0 && src.rows > 0
at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData)
at OpenCvSharp.Internal.NativeMethods.imgproc_warpAffine(IntPtr src, IntPtr dst, IntPtr m, Size dsize, Int32 flags, Int32 borderMode, Scalar borderValue)
at Baballonia.Services.Inference.ImageTransformer.Apply(Mat image) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\Transformers\ImageTransformer.cs:line 21
at Baballonia.Services.Inference.FaceProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\FaceProcessingPipeline.cs:line 28
at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 63
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Eye Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: !ssize.empty()
at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData)
at OpenCvSharp.Internal.NativeMethods.imgproc_resize(IntPtr src, IntPtr dst, Size dsize, Double fx, Double fy, Int32 interpolation)
at Baballonia.Services.Inference.DualCameraSource.GetFrame(Nullable`1 color) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\VideoSources\DualCameraSource.cs:line 62
at Baballonia.Services.Inference.EyeProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\EyeProcessingPipeline.cs:line 22
at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 76
[Baballonia.Services.ProcessingLoopService] Error: Unexpected exception in Face Tracking pipeline, stopping... : OpenCvSharp.OpenCVException: src.cols > 0 && src.rows > 0
at OpenCvSharp.Internal.NativeMethods.<>c.<.cctor>b__1687_0(ErrorCode status, String funcName, String errMsg, String fileName, Int32 line, IntPtr userData)
at OpenCvSharp.Internal.NativeMethods.imgproc_warpAffine(IntPtr src, IntPtr dst, IntPtr m, Size dsize, Int32 flags, Int32 borderMode, Scalar borderValue)
at Baballonia.Services.Inference.ImageTransformer.Apply(Mat image) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\Transformers\ImageTransformer.cs:line 21
at Baballonia.Services.Inference.FaceProcessingPipeline.RunUpdate() in D:\a\Baballonia\Baballonia\src\Baballonia\Services\Inference\FaceProcessingPipeline.cs:line 28
at Baballonia.Services.ProcessingLoopService.TimerEvent(Object s, EventArgs e) in D:\a\Baballonia\Baballonia\src\Baballonia\Services\ProcessingLoopService.cs:line 63
[Baballonia.Services.LocalSettingsService] Information: Saving settings
[Baballonia.Services.LocalSettingsService] Information: Saving settings

Other Notes

No response