Skip to content

Conversation

roypat
Copy link
Contributor

@roypat roypat commented Jul 21, 2025

test_network_latency uses ping to send 15 rounds of 30 pings from the guest to the host and collects the latencies printed. For this, instead of just parsing the ping output for however many lines of latency data there we, implicitly assert that we get exactly 30. However, sometimes this fails. Nikita and Egor investigated and found that no packages are lost, sometimes ping just seems to not print all 30 lines for some reason (presumably a bug in ping). So just drop this assertion to stop spurious test failures from happening. This is a performance test, not a functional test anyway.

Changes

...

Reason

...

License Acceptance

By submitting this pull request, I confirm that my contribution is made under
the terms of the Apache 2.0 license. For more information on following Developer
Certificate of Origin and signing off your commits, please check
CONTRIBUTING.md.

PR Checklist

  • I have read and understand CONTRIBUTING.md.
  • I have run tools/devtool checkbuild --all to verify that the PR passes
    build checks on all supported architectures.
  • I have run tools/devtool checkstyle to verify that the PR passes the
    automated style checks.
  • I have described what is done in these changes, why they are needed, and
    how they are solving the problem in a clear and encompassing way.
  • I have updated any relevant documentation (both in code and in the docs)
    in the PR.
  • I have mentioned all user-facing changes in CHANGELOG.md.
  • If a specific issue led to this PR, this PR closes the issue.
  • When making API changes, I have followed the
    Runbook for Firecracker API changes.
  • I have tested all new and changed functionalities in unit tests and/or
    integration tests.
  • I have linked an issue to every new TODO.

  • This functionality cannot be added in rust-vmm.

test_network_latency uses ping to send 15 rounds of 30 pings from the
guest to the host and collects the latencies printed. For this, instead
of just parsing the ping output for however many lines of latency data
there we, implicitly assert that we get exactly 30. However, sometimes
this fails. Nikita and Egor investigated and found that no packages are
lost, sometimes ping just seems to not print all 30 lines for some
reason (presumably a bug in ping). So just drop this assertion to stop
spurious test failures from happening. This is a performance test, not a
functional test anyway.

Signed-off-by: Patrick Roy <[email protected]>
Copy link

codecov bot commented Jul 21, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 83.02%. Comparing base (7dfe276) to head (e0976f2).
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #5317      +/-   ##
==========================================
+ Coverage   82.96%   83.02%   +0.05%     
==========================================
  Files         250      250              
  Lines       26828    26828              
==========================================
+ Hits        22259    22273      +14     
+ Misses       4569     4555      -14     
Flag Coverage Δ
5.10-c5n.metal 83.47% <ø> (ø)
5.10-m5n.metal 83.47% <ø> (ø)
5.10-m6a.metal 82.68% <ø> (?)
5.10-m6g.metal 79.13% <ø> (ø)
5.10-m6i.metal 83.46% <ø> (+<0.01%) ⬆️
5.10-m7a.metal-48xl 82.67% <ø> (?)
5.10-m7g.metal 79.12% <ø> (-0.01%) ⬇️
5.10-m7i.metal-24xl 83.42% <ø> (?)
5.10-m7i.metal-48xl 83.42% <ø> (?)
5.10-m8g.metal-24xl 79.12% <ø> (?)
5.10-m8g.metal-48xl 79.12% <ø> (?)
6.1-c5n.metal 83.51% <ø> (+<0.01%) ⬆️
6.1-m5n.metal 83.51% <ø> (+<0.01%) ⬆️
6.1-m6a.metal 82.73% <ø> (+<0.01%) ⬆️
6.1-m6g.metal 79.13% <ø> (ø)
6.1-m6i.metal 83.50% <ø> (-0.01%) ⬇️
6.1-m7a.metal-48xl 82.71% <ø> (?)
6.1-m7g.metal 79.13% <ø> (?)
6.1-m7i.metal-24xl 83.52% <ø> (?)
6.1-m7i.metal-48xl 83.52% <ø> (?)
6.1-m8g.metal-24xl 79.12% <ø> (?)
6.1-m8g.metal-48xl 79.12% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@roypat roypat enabled auto-merge (rebase) July 21, 2025 10:11
@roypat roypat added the Status: Awaiting review Indicates that a pull request is ready to be reviewed label Jul 21, 2025
@roypat roypat merged commit 343b0ab into firecracker-microvm:main Jul 21, 2025
7 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Status: Awaiting review Indicates that a pull request is ready to be reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants