feat(performance): Add local profiling to vector by connoryy · Pull Request #2 · connoryy/vector

connoryy · 2026-02-26T15:48:51Z

Summary

Vector configuration

How did you test this PR?

Change Type

Bug fix
New feature
Non-functional (chore, refactoring, docs)
Performance

Is this a breaking change?

Yes
No

Does this PR include user facing changes?

Yes. Please add a changelog fragment based on our guidelines.
No. A maintainer will apply the no-changelog label to this PR.

References

Notes

Please read our Vector contributor resources.
Do not hesitate to use @vectordotdev/vector to reach out to us regarding this PR.
Some CI checks run only after we manually approve them.
- We recommend adding a pre-push hook, please see this template.
- Alternatively, we recommend running the following locally before pushing to the remote branch:
  - make fmt
  - make check-clippy (if there are failures it's possible some of them can be fixed with make clippy-fix)
  - make test
After a review is requested, please avoid force pushes to help us review incrementally.
- Feel free to push as many commits as you want. They will be squashed into one before merging.
- For example, you can run git merge origin master and git push.
If this PR introduces changes Vector dependencies (modifies Cargo.lock), please
run make build-licenses to regenerate the license inventory and commit the changes (if any). More details here.

…s rather than just transform types

…revent overwriting

… (very infrequent)

…ector into connor/local-vector-profiling

…consolidating testing infra to vector-helm

profiling/README.md

changelog.d/local_profiling_uprobe_layer.feature.md

CLAUDE.md

@@ -0,0 +1,112 @@
+# CLAUDE.md


CLAUDE.md

@@ -0,0 +1,112 @@
+# CLAUDE.md


CLAUDE.md

@@ -0,0 +1,112 @@
+# CLAUDE.md
+
+This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.


CLAUDE.md

+
+Requires [`cargo-nextest`](https://nexte.st/) for `make test`. Use `TEST_LOG=vector=debug` for verbose test output.
+
+## Formatting and Linting


CLAUDE.md

+### Internal Telemetry (`src/internal_telemetry/`)
+
+- **Allocation tracking** (`allocations/`): Per-component memory tracking via `GroupedTraceableAllocator` wrapping jemalloc. 256 allocation groups. Enabled with `allocation-tracing` feature.
+- **Component probes** (`component_probes.rs`): `VECTOR_COMPONENT_LABELS` shared-memory array for bpftrace-based CPU profiling attribution. Enabled with `component-probes` feature. Uses a single `vector_register_component` uprobe at startup; runtime attribution is via atomic byte writes (no uprobes in hot path).


CLAUDE.md

+### Internal Telemetry (`src/internal_telemetry/`)
+
+- **Allocation tracking** (`allocations/`): Per-component memory tracking via `GroupedTraceableAllocator` wrapping jemalloc. 256 allocation groups. Enabled with `allocation-tracing` feature.
+- **Component probes** (`component_probes.rs`): `VECTOR_COMPONENT_LABELS` shared-memory array for bpftrace-based CPU profiling attribution. Enabled with `component-probes` feature. Uses a single `vector_register_component` uprobe at startup; runtime attribution is via atomic byte writes (no uprobes in hot path).


CLAUDE.md

+### Internal Telemetry (`src/internal_telemetry/`)
+
+- **Allocation tracking** (`allocations/`): Per-component memory tracking via `GroupedTraceableAllocator` wrapping jemalloc. 256 allocation groups. Enabled with `allocation-tracing` feature.
+- **Component probes** (`component_probes.rs`): `VECTOR_COMPONENT_LABELS` shared-memory array for bpftrace-based CPU profiling attribution. Enabled with `component-probes` feature. Uses a single `vector_register_component` uprobe at startup; runtime attribution is via atomic byte writes (no uprobes in hot path).


connoryy added 9 commits February 25, 2026 17:52

Add local profiling using perf

c44064c

Integrate test-log-producer to generate more realistic workloads

e6ee569

Update .gitignore

6840e3c

Integrate bpftrace + uprobe to perf data to partition by component ID…

8434d0e

…s rather than just transform types

Make profile and profile-realistic generate separate flamegraphs to p…

0e54e28

…revent overwriting

Update comment to reflect moving from frame pointers -> DWARF

684f8d2

Cache perf output to prevent executing multiple times

da12b79

Parse [[unknown]]'s if possible, else keep in flamegraph as [unknown]…

40687a5

… (very infrequent)

Delete CLAUDE.md

d96bea9

connoryy changed the title ~~Connor/local vector profiling~~ Add local profiling to vector Feb 26, 2026

connoryy added 5 commits February 26, 2026 15:10

Revert unintentional version bumps and remove dead code

b8385a4

Merge branch 'connor/local-vector-profiling' of github.com:connoryy/v…

211126f

…ector into connor/local-vector-profiling

Remove dead code

5a52787

Add sizeof(pid) check

41ae225

Remove everything except for minimal rust infrastructure in favor of …

19afcdb

…consolidating testing infra to vector-helm

github-actions bot added the domain: ci label Feb 27, 2026

github-advanced-security bot found potential problems Feb 27, 2026

View reviewed changes

profiling/README.md Fixed Show fixed Hide fixed

profiling/README.md Fixed Show fixed Hide fixed

profiling/README.md Fixed Show fixed Hide fixed

Run formatter

e4cf6bb

connoryy changed the title ~~Add local profiling to vector~~ [feat] Add local profiling to vector Feb 27, 2026

connoryy changed the title ~~[feat] Add local profiling to vector~~ feat: Add local profiling to vector Feb 27, 2026

Update changelog

f4e3100

github-advanced-security bot found potential problems Feb 27, 2026

View reviewed changes

changelog.d/local_profiling_uprobe_layer.feature.md Dismissed Show dismissed Hide dismissed

changelog.d/local_profiling_uprobe_layer.feature.md Dismissed Show dismissed Hide dismissed

changelog.d/local_profiling_uprobe_layer.feature.md Dismissed Show dismissed Hide dismissed

Add author to changelog

e2a7010

connoryy changed the title ~~feat: Add local profiling to vector~~ feat(performance): Add local profiling to vector Feb 27, 2026

connoryy added 6 commits February 27, 2026 14:24

Add newline at end of file

5f943cd

Update workflow to run on commits on this branch

d21567d

Add missing protoc dependency

1170bb1

Add more dependencies

1464dea

Update .gitignore after moving tooling to vector-helm

57a47af

Minimize changes by reusing existing layer

532479f

connoryy added 8 commits February 27, 2026 16:36

Use onclose for exiting component

f8113a6

Run formatter

c651430

Move component exit probe into AllocationGroupToken::close()

bf23db9

Add arm64 release

974de8d

Use in-memory buffer and set debug to true

e768252

Temporarily add back local testing infrastructure to test quicker

905ce5b

Update .gitignore

c9802c8

Revert change that removing tracking exits

64bafb6

github-advanced-security bot found potential problems Mar 3, 2026

View reviewed changes

connoryy added 2 commits March 4, 2026 15:51

Switch to frame pointers (much faster)

c8d4cb5

Add frame pointers to release

13bda0c

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(performance): Add local profiling to vector#2

feat(performance): Add local profiling to vector#2
connoryy wants to merge 33 commits intov0.49from
connor/local-vector-profiling

connoryy commented Feb 26, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Check failure

Check failure

Check failure

Check failure

Check failure

Check failure

Check failure

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

		@@ -0,0 +1,112 @@
		# CLAUDE.md

		This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.


		Requires [`cargo-nextest`](https://nexte.st/) for `make test`. Use `TEST_LOG=vector=debug` for verbose test output.

		## Formatting and Linting

Conversation

connoryy commented Feb 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Vector configuration

How did you test this PR?

Change Type

Is this a breaking change?

Does this PR include user facing changes?

References

Notes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Check failure

Check failure

Check failure

Check failure

Check failure

Check failure

Check failure

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

connoryy commented Feb 26, 2026 •

edited

Loading