We mistakenly added it as `output_path` rather than `serial_out_path`.

Signed-off-by: Riccardo Mancini <[email protected]>

The custom CPU templates were just a plain object with no definition of
their fields. This patch adds specific definition for all its fields.

Signed-off-by: Riccardo Mancini <[email protected]>

To implement a strict API validation, let's annotate when extra fields
are actually expected.

Signed-off-by: Riccardo Mancini <[email protected]>

Validate that all requests we do to the API are conformant to the
swagger, and that all responses are also conformant.
This check is strict, meaning no extra fields are allowed to catch
problems where there is a typo in the swagger.
We only check successful requests as we don't want to fail when we try
to send a bad request on purpose. If the request is successful, then it
means the schema should have been valid.

Signed-off-by: Riccardo Mancini <[email protected]>

Automatically generate bindings for virtio-mem.

Signed-off-by: Riccardo Mancini <[email protected]>

Create the new module for the virtio-mem device.

Signed-off-by: Riccardo Mancini <[email protected]>

Allow to configure the virtio-mem device from the VmmConfig and the PUT
API to /hotplug/memory.

Signed-off-by: Riccardo Mancini <[email protected]>

Test the freshly added PUT API to /hotplug/memory.

Signed-off-by: Riccardo Mancini <[email protected]>

Add a dummy virtio-mem device that is detected by the guest driver.
The device is configured with total_size, block_size, and slot_size, and
uses an allocated after the MMIO64 memory zone.

Signed-off-by: Riccardo Mancini <[email protected]>

Check that the driver correctly detects the virtio-mem device, with the
correct parameters.

Signed-off-by: Riccardo Mancini <[email protected]>

Add support for GET /hotplug/memory that returns the current status of
the virtio-mem device.

This API can only be called after boot.

Signed-off-by: Riccardo Mancini <[email protected]>

Add new API to swagger and device-api.md

Signed-off-by: Riccardo Mancini <[email protected]>

Avoid multiple conversions back and forth from MiB to bytes by just
storing as MiB.

Signed-off-by: Riccardo Mancini <[email protected]>

We should match the exact reason for the RuntimeError to ensure we're
failing for what we're expecting.

Signed-off-by: Riccardo Mancini <[email protected]>

It's better to be explicit on the conversion we're doing as u64 to usize
is always safe in our platforms.

Signed-off-by: Riccardo Mancini <[email protected]>

This type annotation is redoundant, so we can remove it.

Signed-off-by: Riccardo Mancini <[email protected]>

Implements basic snapshot/restore functionality for the dummy virtio-mem
device.

Signed-off-by: Riccardo Mancini <[email protected]>

Wire support for virtio-mem metrics, adding a few basic metrics: queue
events, queue event fails, activation fails.

Signed-off-by: Riccardo Mancini <[email protected]>

Allocate the memory that will be used for hotplugging. Initially, this
memory will be registered with KVM, but that will change later when we
add dynamic slot support.

Signed-off-by: Riccardo Mancini <[email protected]>

Wire up PATCH requests with the virtio-mem device.
All the validation is performed in the device, but the actual operation
is not yet implemented.

Signed-off-by: Riccardo Mancini <[email protected]>

Add entry for the patch API in Swagger and in the docs.

Signed-off-by: Riccardo Mancini <[email protected]>

Test that the new PATCH API behaves as expected.
Also updates expected metrics and fixes memory monitor to account for
hotplugging.

Signed-off-by: Riccardo Mancini <[email protected]>

Parse virtio requests over the queue and always ack them. Following
commits will add the state management inside the device.

Signed-off-by: Riccardo Mancini <[email protected]>

This commit adds block state management and implements the virtio
requests for the virtio-mem device.

Block state is tracked using a BitVec, each bit representing a single
block.

Plug/Unplug requests are validated before being executed to verify the
range is valid (aligned and within range), and that all blocks in range
are unplugged/plugged, as per the virtio spec.

UplugAll is the only request where usable_region_size can be lowered.

This commit is missing the dynamic KVM slot management which will be
added later.

Signed-off-by: Riccardo Mancini <[email protected]>

Adds unit tests using VirtioTestHelper to verify correct functioning of
the new device.

Signed-off-by: Riccardo Mancini <[email protected]>

Add the virtio-mem device metrics to the integ test validation.

Signed-off-by: Riccardo Mancini <[email protected]>

If the handler receives a UFFD remove event, it currently stores the PFN
and will reply with a zero page whenever it receives a pagefault event
for that page.
This works well with 4k pages, but zeropage is not supported on
hugepages. In order to support hugepages, let's just unregister from
UFFD whenever we get a remove event. By doing so, the handler won't
receive a notification for the removed page, and the VM will get a new
zero page from the kernel.

Signed-off-by: Riccardo Mancini <[email protected]>

This moves the logic to measure RSS to framework.utils and adds a logic
to also include huge pages in the measurement.

Furthermore, this also adds caching for the firecracker_pid, as well as
a new property to get the corresponding psutil.Process.

Signed-off-by: Riccardo Mancini <[email protected]>

Move the logic to get the MemAvailable from /proc/meminfo inside the
guest to a new guest_stats module in the test framework. This provides a
new class MeminfoGuest that can be used to retrieve this information
(and more!).

Signed-off-by: Riccardo Mancini <[email protected]>

Since these tests need to be run on an ag=1 host, move them under the
"performance" folder.

Signed-off-by: Riccardo Mancini <[email protected]>

These tests add unit test coverage to the builder.rs and vm.rs files
which where previously untested in the memory hotplug case.

Signed-off-by: Riccardo Mancini <[email protected]>

Add a slot_cnt parameter to next_kvm_slot. This will be used to allocate
multiple slots for a slotted hotpluggable region.

Signed-off-by: Riccardo Mancini <[email protected]>

To avoid boilerplate code in multiple places, let's just define it once
and use it everywhere.

Signed-off-by: Riccardo Mancini <[email protected]>

In preparation to adding support for multiple memory slots, refactor the
mincore_bitmap function to accept a pointer and length rather than an
entire memory region object.

Signed-off-by: Riccardo Mancini <[email protected]>

A single GuestMemoryRegion can be split into multiple KVM slots. This is
used for Hotplug type regions where we can dynamically remove access to
the region from the guest.

Signed-off-by: Riccardo Mancini <[email protected]>

Dynamically plug/unplug KVM slots when any/all of the blocks are
plugged/unplugged.

This prevents the guest from accessing unplugged memory.
However, this doesn't yet prevent the device emulation from accessing
the slots.

Signed-off-by: Riccardo Mancini <[email protected]>

Add a performance test that measures the latency to hot(un)plug
different amounts of memory.

Signed-off-by: Riccardo Mancini <[email protected]>

Add the memory hotplug tests to buildkite.

Signed-off-by: Riccardo Mancini <[email protected]>

This prevents the device emulation to be tricked into accessing
unplugged memory ranges. If a malicious driver tries to do so, the VMM
will crash with a memory error.

Signed-off-by: Riccardo Mancini <[email protected]>

These two functions were doing a similar thing. Let's extend the
build_from_snapshot to support uffd and drop the newly introduced
clone_vm.

Signed-off-by: Riccardo Mancini <[email protected]>

Extend the tests to also check that everything works with diff snapshots
(dirty page tracking and mincore).

Signed-off-by: Riccardo Mancini <[email protected]>

Add a test that verifies that incremental snapshots work as expected.
Each generation will plug more memory and verify that the contents in
memory from previous generations are persisted.

Signed-off-by: Riccardo Mancini <[email protected]>

When the fuzzer generates an invalid bitvec state, the serde code
crashes with an assertion error.
To avoid these crashes, just store it as a plain Vec<bool> as we don't
expect these vecs to be too big (for a 10GB hotpluggable area with 2MiB
blocks it would require 5kB for the Vec<bool> compared to 640B with
BitVec).

Signed-off-by: Riccardo Mancini <[email protected]>

Return the error up the stack instead of unwrapping it.

Note that on PCI this error is unwrapped for every device so there's no
change there.

Signed-off-by: Riccardo Mancini <[email protected]>

When the region state is invalid or corrupted (like when generated by
the fuzzer), it is possible that a DRAM slot is unplugged, leading to
segfaults when accessing guest memory (ie from vmgenid device).
To avoid these crashes, validate the region state and allow the DRAM
region (not hot-pluggable) to only contain one plugged slot.

Signed-off-by: Riccardo Mancini <[email protected]>

Sometimes on m6a the uffd test fails to write 1.2GB within 10s. Bump the
timeout to 30s.

Signed-off-by: Riccardo Mancini <[email protected]>

The previously set 256MB were not enough for hotplugging 16GB of memory.
This is because the kernel needs 64B for every 4kB page, meaning 262MB
for 16GB.

Signed-off-by: Riccardo Mancini <[email protected]>