Skip to content

Commit 7774020

Browse files
noahfalkgewarren
andauthored
Improve dump FAQ (#44714)
* Improve dump FAQ Fixes dotnet/diagnostics#4375 - The previous guidance for diagnosing dump permission issues did not mention the interaction between setcap and ptrace. I added that information as well as a more complete description of the ptrace access checking. - There was no link to the FAQ in the TOC so I added one. - I made some minor edits to the dump overview page that IMO improved clarity and flow of the text. Co-authored-by: Genevieve Warren <[email protected]>
1 parent b296371 commit 7774020

File tree

3 files changed

+44
-9
lines changed

3 files changed

+44
-9
lines changed

docs/core/diagnostics/dumps.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -13,10 +13,7 @@ A dump is a file that contains a snapshot of the process at the time the dump wa
1313
Dumps can be collected in a variety of ways depending on which platform your app is running on.
1414

1515
> [!NOTE]
16-
> Dumps may contain sensitive information because they can contain the full memory of the running process. Handle them with any security restrictions and guidances in mind.
17-
18-
> [!TIP]
19-
> For frequently asked questions about dump collection, analysis, and other caveats, see [Dumps: FAQ](faq-dumps.yml).
16+
> Dumps might contain sensitive information because they can contain the full memory of the running process. Handle them with any security restrictions and guidance in mind.
2017
2118
* You can use environment variables to configure your application to [collect a dump on a crash](collect-dumps-crash.md).
2219

@@ -26,6 +23,9 @@ Dumps can be collected in a variety of ways depending on which platform your app
2623

2724
* If you are running your app in production or you are running it in a distributed manner (several services, replicas), [dotnet-monitor](dotnet-monitor.md) provides support for many common scenarios and ad-hoc diagnostic investigations, including dump collection and egress. It enables dumps to be collected remotely or with triggering conditions.
2825

26+
> [!TIP]
27+
> For troubleshooting and frequently asked questions about dump collection, see [Dumps: FAQ](faq-dumps.yml).
28+
2929
## Analyze dumps
3030

3131
* Navigate to [Debug Linux dumps](debug-linux-dumps.md) for information regarding analyzing dumps collected on Linux.

docs/core/diagnostics/faq-dumps.yml

Lines changed: 38 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -11,15 +11,48 @@ sections:
1111
- name: Collecting dumps on macOS and Linux
1212
questions:
1313
- question: |
14-
Why do I only get dumps on Linux if [dotnet-dump](dotnet-dump.md) or my [crashing process](dumps.md#collect-dumps-on-crash) is running elevated?
15-
answer: |
16-
On Linux-based systems, `/proc/sys/kernel/ptrace_scope` controls who can call `ptrace` and what processes they can trace. We recommend it being set to `1` - meaning only processes in the same ancestry chain can use traced. Any value higher than this requires elevation or might disable `ptrace` altogether.
14+
Why is dump collection failing on Linux?
15+
answer: |
16+
In order to implement dump collection, .NET processes spawn a child process called createdump. This child process uses the Linux API [ptrace()](https://www.man7.org/linux/man-pages/man2/ptrace.2.html) and also reads from the [/proc](https://www.kernel.org/doc/html/latest/filesystems/proc.html) filesystem to access thread and memory data that is written into the dump file. Although the API usage is allowed by the default security settings on many Linux distros, sometimes a less common security configuration will deny access. You might see output from the createdump process written on the console of the application being dumped such as:
17+
18+
```
19+
[createdump] The process or container does not have permissions or access: open(/proc/1234/mem) FAILED Permission denied (13)
20+
```
21+
22+
One reason that access can be denied is if a security sandbox intercepts the call using a [seccomp BPF filter](https://www.kernel.org/doc/html/v4.19/userspace-api/seccomp_filter.html). For applications running in a container using Open Container Initiative technology, the `seccomp` profile must allow for calls to `ptrace`. For example, `Docker` uses [containerd](https://github.com/moby/containerd) under the hood as a container runtime. When initializing, it specifies a default [seccomp profile](https://github.com/moby/moby/blob/master/profiles/seccomp/default.json) that allows `ptrace` only if the container host has a kernel version higher than 4.8 or if the `CAP_SYS_PTRACE` capability was specified on the container.
23+
24+
If the calls aren't intercepted, then the kernel does a variety of built-in access checks. The docs for [ptrace()](https://www.man7.org/linux/man-pages/man2/ptrace.2.html) include a detailed description near the end, titled "Ptrace access mode checking", that describes how these are done. Accessing the /proc filesystem also uses a variation of the same ptrace access mode checking. What follows is an abbreviated summary of the security checks performed and places where access might be denied:
25+
26+
- Either the calling process needs to have the same user ID as the target process, or the calling process needs to have CAP_SYS_PTRACE. If neither of these is true, access is denied. Since the .NET runtime doesn't do anything to change the user account when launching createdump, the user IDs should match and this step should succeed.
27+
- If createdump doesn't have CAP_SYS_PTRACE (it doesn't by default), then the target process being dumped needs to be marked "dumpable". By default, most processes on Linux are dumpable, but you can change this setting by calling [prctl()](https://www.man7.org/linux/man-pages/man2/prctl.2.html) with the PR_SET_DUMPABLE option. If you add capabilities to a process using the setcap tool, this can also cause a process to stop being dumpable. For a more detailed description of the dumpable setting and what causes it to be disabled, see [the Linux documentation](https://www.man7.org/linux/man-pages/man2/PR_SET_DUMPABLE.2const.html).
28+
- All of the enabled [Linux security modules](https://www.kernel.org/doc/html/v4.16/admin-guide/LSM/index.html) (LSMs) are enumerated and each of them must approve the access. Unfortunately, if an LSM denies the access, there's no uniform Linux reporting mechanism to know which one is responsible. Instead you need to determine which ones are enabled on your system and then investigate each individually. You can determine which LSMs are active by running: `cat /sys/kernel/security/lsm`. Although any LSM could be responsible, [Yama](https://www.kernel.org/doc/html/v4.16/admin-guide/LSM/Yama.html), [SELinux](https://selinuxproject.org/page/Main_Page), and [AppArmor](https://gitlab.com/apparmor/apparmor/-/wikis/GettingStarted) are frequently the relevant ones.
29+
30+
AppArmor and SELinux both have rich configuration and reporting mechanisms, so if you need to learn how to work with them, it's best to view each project's own documentation. Yama only has a single configuration setting, which can be displayed by running:
31+
32+
```
33+
cat /proc/sys/kernel/yama/ptrace_scope
34+
```
35+
36+
This command outputs a number indicating the current Yama ptrace security policy:
37+
38+
- 0: Classic ptrace permissions.
39+
- 1: Restricted ptrace.
40+
- 2: Admin-only attach.
41+
- 3: No attach.
42+
43+
Yama should grant access for createdump under policies 0 and 1, but expect access will be denied under policies 2 and 3. Policy 3 always denies access, and policy 2 doesn't work by default because createdump normally does not have the capability CAP_SYS_PTRACE.
44+
45+
- question: |
46+
Why do I only get dumps on Linux if dotnet-dump or my crashing process is running elevated?
47+
answer: |
48+
Some Linux-based systems are configured with security policies that require any process collecting a dump to have the capability CAP_SYS_PTRACE. Normally processes do not have this capability but running elevated is one way to enable it. For a fuller description of how Linux security policies impact dump collection, see 'Why is dump collection failing on Linux?'.
1749
1850
- question: |
1951
Why can't I collect dumps when running inside a container?
2052
answer: |
21-
For applications running under any Open Container Initiative technology, the `seccomp` profile must allow for calls to `ptrace`. For example, `Docker` uses [containerd](https://github.com/moby/containerd) under the hood as a container runtime. When initializing the runtime, it specifies a default [seccomp profile](https://github.com/moby/moby/blob/master/profiles/seccomp/default.json) that allows `ptrace` only if the container host has a kernel version higher than 4.8 or if the `CAP_SYS_PTRACE` capability was specified.
22-
53+
For applications running under any Open Container Initiative technology, the `seccomp` profile must allow for calls to [ptrace()](https://www.man7.org/linux/man-pages/man2/ptrace.2.html). For example, `Docker` uses [containerd](https://github.com/moby/containerd) under the hood as a container runtime. When initializing the runtime, it specifies a default [seccomp profile](https://github.com/moby/moby/blob/master/profiles/seccomp/default.json) that allows `ptrace` only if the container host has a kernel version higher than 4.8 or if the `CAP_SYS_PTRACE` capability was specified.
54+
55+
For a fuller description of how Linux security policies impact dump collection, see the question 'Why is dump collection failing on Linux?'.
2356
- question: |
2457
Why can't I collect dumps on macOS?
2558
answer: |

docs/navigate/tools-diagnostics/toc.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -485,6 +485,8 @@ items:
485485
href: ../../core/diagnostics/debug-windows-dumps.md
486486
- name: Collect dumps on crash
487487
href: ../../core/diagnostics/collect-dumps-crash.md
488+
- name: Frequently asked questions
489+
href: ../../core/diagnostics/faq-dumps.yml
488490
- name: Symbols
489491
href: ../../core/diagnostics/symbols.md
490492
- name: EventPipe

0 commit comments

Comments
 (0)