Skip to content

Conversation

@emdneto
Copy link
Member

@emdneto emdneto commented Oct 30, 2024

Description

We have a lot of test messages being logged in benchmarks that are not necessary to log, and we can suppress them to facilitate seeing the results. Example: https://github.com/open-telemetry/opentelemetry-python/actions/runs/11517939886/job/32063666683

@emdneto emdneto added the Skip Changelog PRs that do not require a CHANGELOG.md entry label Oct 30, 2024
@emdneto emdneto requested a review from a team as a code owner October 30, 2024 19:09
@emdneto emdneto changed the title suppress unecessary test messages from logs benchmark suppress unnecesary test messages from logs benchmark Oct 30, 2024
@xrmx
Copy link
Contributor

xrmx commented Oct 30, 2024

Does it affect numbers?

@emdneto
Copy link
Member Author

emdneto commented Oct 30, 2024

Does it affect numbers?

@xrmx Yes. I can share the differences for test_simple_get_logger_different_names[1000] (but I ran locally in my laptop):

Execution Time Metrics (in milliseconds)

Metric Main (ms) This PR (ms)
Min 480.3077140 5.2409910
Max 804.4341670 13.4429550
Mean 584.9409834 6.4648222
StdDev 137.9129717 0.9937184
Median 507.1512170 6.1664920
IQR 188.2382130 0.6891970

Operational Metrics

Metric Main This PR
OPS 1.7096 154.6833
Rounds 5 136
Iterations per Round 1 1
Outliers 1;0 14;8

@emdneto
Copy link
Member Author

emdneto commented Oct 30, 2024

Closing as the benchmark was added to test LoggingHandler so it does makes sense. Maybe can just set propagate to false to suppress the logs while still benchmark the LoggingHandler

@emdneto emdneto closed this Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Skip Changelog PRs that do not require a CHANGELOG.md entry

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants