Skip to content

[RUM-12600] Refine Continuous Benchmarking#3977

Merged
amortemousque merged 5 commits intomainfrom
aymeric/refine-test-performance
Nov 27, 2025
Merged

[RUM-12600] Refine Continuous Benchmarking#3977
amortemousque merged 5 commits intomainfrom
aymeric/refine-test-performance

Conversation

@amortemousque
Copy link
Collaborator

@amortemousque amortemousque commented Nov 21, 2025

Motivation

  • Improve the performance test setup to produce predictable results:

    • Remove redundant tests that target the same pages or elements.
    • Replace fill with pressSequentially to mimic real typing behavior.
    • Reduce the number of hosts shown on the infra page so INP falls in the “needs improvement” range.
  • Fix the ShopistLike test by removing the SDK initialization from the app itself. The perf test already injects the SDK init script.

  • Address inflated TTFB by warming up the page: load it once before running the actual test.

Test instructions

Checklist

  • Tested locally
  • Tested on staging
  • Added unit tests for this change.
  • Added e2e/integration tests for this change.

@amortemousque amortemousque changed the title Aymeric/refine test performance Refine test performance Nov 21, 2025
@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025

Bundles Sizes Evolution

📦 Bundle Name Base Size Local Size 𝚫 𝚫% Status
Rum 164.05 KiB 164.05 KiB 0 B 0.00%
Rum Profiler 4.84 KiB 4.84 KiB 0 B 0.00%
Rum Recorder 19.50 KiB 19.50 KiB 0 B 0.00%
Logs 55.91 KiB 55.91 KiB 0 B 0.00%
Flagging 944 B 944 B 0 B 0.00%
Rum Slim 121.33 KiB 121.33 KiB 0 B 0.00%
Worker 23.63 KiB 23.63 KiB 0 B 0.00%
🚀 CPU Performance
Action Name Base CPU Time (ms) Local CPU Time (ms) 𝚫%
RUM - add global context 0.0039 0.0044 +12.82%
RUM - add action 0.0123 0.0144 +17.07%
RUM - add error 0.0111 0.0121 +9.01%
RUM - add timing 0.003 0.0031 +3.33%
RUM - start view 0.0037 0.0041 +10.81%
RUM - start/stop session replay recording 0.0007 0.0007 0.00%
Logs - log message 0.0132 0.0145 +9.85%
🧠 Memory Performance
Action Name Base Memory Consumption Local Memory Consumption 𝚫
RUM - add global context 26.06 KiB 25.25 KiB -836 B
RUM - add action 100.52 KiB 111.30 KiB +10.78 KiB
RUM - add timing 23.81 KiB 24.69 KiB +905 B
RUM - add error 102.49 KiB 111.78 KiB +9.29 KiB
RUM - start/stop session replay recording 23.33 KiB 23.53 KiB +210 B
RUM - start view 442.18 KiB 481.81 KiB +39.62 KiB
Logs - log message 44.68 KiB 44.13 KiB -567 B

🔗 RealWorld

@datadog-datadog-prod-us1
Copy link

datadog-datadog-prod-us1 bot commented Nov 21, 2025

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 92.67% (-0.00%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: b395669 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@amortemousque amortemousque force-pushed the aymeric/refine-test-performance branch from 37cc3b4 to b395669 Compare November 26, 2025 08:44
@amortemousque amortemousque changed the title Refine test performance [RUM-12600] Refine Continuous Benchmarking Nov 26, 2025
@amortemousque amortemousque marked this pull request as ready for review November 26, 2025 09:06
@amortemousque amortemousque requested a review from a team as a code owner November 26, 2025 09:06
Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@amortemousque amortemousque merged commit db4fa7f into main Nov 27, 2025
22 checks passed
@amortemousque amortemousque deleted the aymeric/refine-test-performance branch November 27, 2025 13:31
sethfowler-datadog added a commit that referenced this pull request Dec 4, 2025
…alization-tests

* main:
  🎨 [PANA-4929] Add the concept of serialization transactions and reorganize state (#3982)
  🔧  migrate the developer-extension to wxt (#3962)
  [EX-1236] Add support for flagevaluation track. (#3976)
  👷 bump monitor (#3990)
  👷 Update actions/checkout action to v6 (#3989)
  👷 Bump staging to staging-49
  [RUM-12600] Refine Continuous Benchmarking (#3977)
  ♻️ separate RUM event collection (#3985)
  ✨ add logs to service worker extension (#3987)
  🔥 remove the `performances/` script (#3986)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants