AccessViolationException trying to read StandardOut

[rcdailey]

I have an open source project named Recyclarr, which is a console application currently utilizing CliWrap. A user of mine reported an exception (copied below) originating from CliWrap. The underlying exception is AccessViolationException coming from what appears to be CliWrap's attempt to read from the StandardOutput stream of the Process class.

The user is running on a Apple M1 Mac Mini. My primary question is: What would be the underlying issue causing this? My best guess right now is that there's a permission problem preventing .NET from accessing the stdout of the process (A git command is being executed in this case). It looks like stdout access is facilitated through network sockets, but it's unclear what corrective action the user must take.

I'm doubtful that this is an issue in CliWrap itself. I'm hoping that the domain expertise of the maintainers here can help point me in the right direction.

If there's more information I can provide please let me know. Thank you in advance for your support!

Last login: Mon Mar 31 17:07:30 on ttys000 plexserver@Plex-Mac-mini ~ % recyclarr sync --preview Fatal error. System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt. at System.Runtime.InteropServices.MemoryMarshal.GetReference[[System.Byte, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]](System.Span1)
at System.Net.Sockets.SocketPal.TryCompleteReceiveFrom(System.Net.Sockets.SafeSocketHandle, System.Span1<Byte>, System.Collections.Generic.IList1<System.ArraySegment1<Byte>>, System.Net.Sockets.SocketFlags, System.Span1, Int32 ByRef, Int32 ByRef, System.Net.Sockets.SocketFlags ByRef, System.Net.Sockets.SocketError ByRef)
at System.Net.Sockets.SocketAsyncContext.ReceiveFromAsync(System.Memory1<Byte>, System.Net.Sockets.SocketFlags, System.Memory1, Int32 ByRef, Int32 ByRef, System.Net.Sockets.SocketFlags ByRef, System.Action4<Int32,System.Memory1,System.Net.Sockets.SocketFlags,System.Net.Sockets.SocketError>, System.Threading.CancellationToken)
at System.Net.Sockets.SocketAsyncEventArgs.DoOperationReceive(System.Net.Sockets.SafeSocketHandle, System.Threading.CancellationToken)
at System.Net.Sockets.Socket.ReceiveAsync(System.Net.Sockets.SocketAsyncEventArgs, System.Threading.CancellationToken)
at System.Net.Sockets.Socket+AwaitableSocketAsyncEventArgs.ReceiveAsync(System.Net.Sockets.Socket, System.Threading.CancellationToken)
at System.Net.Sockets.Socket.ReceiveAsync(System.Memory1<Byte>, System.Net.Sockets.SocketFlags, Boolean, System.Threading.CancellationToken) at System.IO.Pipes.PipeStream+<ReadAsyncCore>d__82.MoveNext() at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.IO.Pipes.PipeStream+<ReadAsyncCore>d__82, System.IO.Pipes, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]](<ReadAsyncCore>d__82 ByRef) at System.Runtime.CompilerServices.AsyncValueTaskMethodBuilder1[[System.Int32, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Start[[System.IO.Pipes.PipeStream+d__82, System.IO.Pipes, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]](d__82 ByRef)
at System.IO.Pipes.PipeStream.ReadAsyncCore(System.Memory1<Byte>, System.Threading.CancellationToken) at System.IO.Pipes.PipeStream.ReadAsync(System.Memory1, System.Threading.CancellationToken)
at System.IO.StreamReader+d__72.MoveNext()
at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.IO.StreamReader+d__72, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]](d__72 ByRef)
at System.IO.StreamReader.ReadBufferAsync(System.Threading.CancellationToken)
at System.IO.StreamReader+d__69.MoveNext()
at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.IO.StreamReader+d__69, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]](d__69 ByRef)
at System.IO.StreamReader.ReadAsyncInternal(System.Memory1<Char>, System.Threading.CancellationToken) at System.IO.StreamReader.ReadAsync(System.Memory1, System.Threading.CancellationToken)
at CliWrap.PipeTarget+<>c__DisplayClass11_0+<b__0>d.MoveNext()
at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[CliWrap.PipeTarget+<>c__DisplayClass11_0+<b__0>d, CliWrap, Version=3.7.1.0, Culture=neutral, PublicKeyToken=1c4a4fc2d6886e5a]](<b__0>d ByRef)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[CliWrap.PipeTarget+<>c__DisplayClass11_0+<b__0>d, CliWrap, Version=3.7.1.0, Culture=neutral, PublicKeyToken=1c4a4fc2d6886e5a]](<b__0>d ByRef)
at CliWrap.PipeTarget+<>c__DisplayClass11_0.b__0(System.IO.Stream, System.Threading.CancellationToken)
at CliWrap.PipeTarget+AnonymousPipeTarget+d__2.MoveNext()
at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[CliWrap.PipeTarget+AnonymousPipeTarget+d__2, CliWrap, Version=3.7.1.0, Culture=neutral, PublicKeyToken=1c4a4fc2d6886e5a]](d__2 ByRef)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[CliWrap.PipeTarget+AnonymousPipeTarget+d__2, CliWrap, Version=3.7.1.0, Culture=neutral, PublicKeyToken=1c4a4fc2d6886e5a]](d__2 ByRef)
at CliWrap.PipeTarget+AnonymousPipeTarget.CopyFromAsync(System.IO.Stream, System.Threading.CancellationToken)
at CliWrap.Command+d__47.MoveNext()
at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[CliWrap.Command+d__47, CliWrap, Version=3.7.1.0, Culture=neutral, PublicKeyToken=1c4a4fc2d6886e5a]](d__47 ByRef)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[CliWrap.Command+d__47, CliWrap, Version=3.7.1.0, Culture=neutral, PublicKeyToken=1c4a4fc2d6886e5a]](d__47 ByRef)
at CliWrap.Command.PipeStandardOutputAsync(CliWrap.Utils.ProcessEx, System.Threading.CancellationToken)
at CliWrap.Command+d__49.MoveNext()
at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[CliWrap.Command+d__49, CliWrap, Version=3.7.1.0, Culture=neutral, PublicKeyToken=1c4a4fc2d6886e5a]](d__49 ByRef)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Start[[CliWrap.Command+<ExecuteAsync>d__49, CliWrap, Version=3.7.1.0, Culture=neutral, PublicKeyToken=1c4a4fc2d6886e5a]](<ExecuteAsync>d__49 ByRef) at CliWrap.Command.ExecuteAsync(CliWrap.Utils.ProcessEx, System.Threading.CancellationToken, System.Threading.CancellationToken) at CliWrap.Command.ExecuteAsync(System.Threading.CancellationToken, System.Threading.CancellationToken) at CliWrap.Command.ExecuteAsync(System.Threading.CancellationToken) at Recyclarr.VersionControl.GitRepository+<RunGitCmd>d__5.MoveNext() at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[Recyclarr.VersionControl.GitRepository+<RunGitCmd>d__5, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](<RunGitCmd>d__5 ByRef) at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[Recyclarr.VersionControl.GitRepository+<RunGitCmd>d__5, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](<RunGitCmd>d__5 ByRef) at Recyclarr.VersionControl.GitRepository.RunGitCmd(System.Threading.CancellationToken, System.Collections.Generic.ICollection1<System.String>)
at Recyclarr.VersionControl.GitRepository.RunGitCmd(System.Threading.CancellationToken, System.String[])
at Recyclarr.VersionControl.GitRepository+d__9.MoveNext()
at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[Recyclarr.VersionControl.GitRepository+d__9, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](d__9 ByRef)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[Recyclarr.VersionControl.GitRepository+d__9, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](d__9 ByRef)
at Recyclarr.VersionControl.GitRepository.Status(System.Threading.CancellationToken)
at Recyclarr.VersionControl.GitRepositoryFactory+d__4.MoveNext()
at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[Recyclarr.VersionControl.GitRepositoryFactory+d__4, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](d__4 ByRef)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Start[[Recyclarr.VersionControl.GitRepositoryFactory+<CreateAndCloneIfNeeded>d__4, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](<CreateAndCloneIfNeeded>d__4 ByRef) at Recyclarr.VersionControl.GitRepositoryFactory.CreateAndCloneIfNeeded(System.Uri, System.IO.Abstractions.IDirectoryInfo, System.String, System.Threading.CancellationToken) at Recyclarr.Repo.RepoUpdater+<CheckoutAndUpdateRepo>d__4.MoveNext() at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[Recyclarr.Repo.RepoUpdater+<CheckoutAndUpdateRepo>d__4, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](<CheckoutAndUpdateRepo>d__4 ByRef) at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[Recyclarr.Repo.RepoUpdater+<CheckoutAndUpdateRepo>d__4, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](<CheckoutAndUpdateRepo>d__4 ByRef) at Recyclarr.Repo.RepoUpdater.CheckoutAndUpdateRepo(System.IO.Abstractions.IDirectoryInfo, Recyclarr.Settings.IRepositorySettings, System.Threading.CancellationToken) at Recyclarr.Repo.RepoUpdater+<UpdateRepo>d__3.MoveNext() at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[Recyclarr.Repo.RepoUpdater+<UpdateRepo>d__3, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](<UpdateRepo>d__3 ByRef) at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[Recyclarr.Repo.RepoUpdater+<UpdateRepo>d__3, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](<UpdateRepo>d__3 ByRef) at Recyclarr.Repo.RepoUpdater.UpdateRepo(System.IO.Abstractions.IDirectoryInfo, Recyclarr.Settings.IRepositorySettings, System.Threading.CancellationToken) at Recyclarr.Repo.TrashGuidesRepo.Update(System.Threading.CancellationToken) at Recyclarr.Repo.ConsoleMultiRepoUpdater+<>c+<<UpdateAllRepositories>b__3_0>d.MoveNext() at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[Recyclarr.Repo.ConsoleMultiRepoUpdater+<>c+<<UpdateAllRepositories>b__3_0>d, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](<<UpdateAllRepositories>b__3_0>d ByRef) at System.Runtime.CompilerServices.AsyncValueTaskMethodBuilder.Start[[Recyclarr.Repo.ConsoleMultiRepoUpdater+<>c+<<UpdateAllRepositories>b__3_0>d, Recyclarr.Core, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null]](<<UpdateAllRepositories>b__3_0>d ByRef) at Recyclarr.Repo.ConsoleMultiRepoUpdater+<>c.<UpdateAllRepositories>b__3_0(Recyclarr.Repo.IUpdateableRepo, System.Threading.CancellationToken) at System.Threading.Tasks.Parallel+<>c__531+<b__53_0>d[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].MoveNext()
at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[System.Threading.Tasks.Parallel+<>c__531+<<ForEachAsync>b__53_0>d[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]], System.Threading.Tasks.Parallel, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]](<<ForEachAsync>b__53_0>d<System.__Canon> ByRef) at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[System.Threading.Tasks.Parallel+<>c__531+<b__53_0>d[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]], System.Threading.Tasks.Parallel, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a]](<b__53_0>d<System.__Canon> ByRef)
at System.Threading.Tasks.Parallel+<>c__531[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].<ForEachAsync>b__53_0(System.Object) at System.Threading.Tasks.Parallel+ForEachAsyncState1+<>c[[System.__Canon, System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].<System.Threading.IThreadPoolWorkItem.Execute>b__18_0(System.Object)
at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
at System.Threading.ThreadPoolWorkQueue.Dispatch()
at System.Threading.PortableThreadPool+WorkerThread.WorkerThreadStart()
at System.Threading.Thread.StartCallback()
zsh: abort recyclarr sync --preview`

[Tyrrrz]

No idea why the underlying Process's StreamReader is implemented through a Socket. Is it a network process?

In any case, it looks like the same issue could be reproduced by using System.Diagnostics.Process directly, so maybe if you can reproduce it, you may be able to narrow down the scope of the problem/question a bit.

[rcdailey]

On linux/mac, don't process pipes use network sockets for IPC? I'm not able to find any dotnet documentation explaining how Process/Pipes are implemented for mac/linux in .NET, so I thought I'd tap into your domain expertise here for a clue. I appreciate your attention to my question.

[Tyrrrz]

Ah, maybe you're right. Unfortunately, I'm not that well-versed in the implementation details of the Process abstraction. I think if I were, I'd rewrite it myself so as to not deal with some of its issues 😂