[net] fix rx queue freeze

Under heavy ingress traffic we might end up in a situation where the tap
device is full, but the rx.deferred_frame flag is not set. Beeing in
this state the firecracker RX queue becomes effectively blocked. The tap
won't issue any new event because of the EPOLLET flag, while any rate
limiter or RX queue event won't do any processing because the
rx.deferred_frame flag is not set.

We need to make sure we set the rx.deferred_frame flag on all the paths
that leave unprocessed frames in the tap.

Signed-off-by: Serban Iorga <[email protected]>
Signed-off-by: Iulian Barbu <[email protected]>

Author: Iulian Barbu

src/devices/src/virtio/net.rs

@@ -534,7 +534,11 @@ impl EpollHandler for NetEpollHandler {
             RX_TAP_EVENT => {
                 METRICS.net.rx_tap_event_count.inc();
 
-                if self.rx.queue.is_empty(&self.mem) {
+                // While there are no available RX queue buffers and there's a deferred_frame
+                // don't process any more incoming. Otherwise start processing a frame. In the
+                // process the deferred_frame flag will be set in order to avoid freezing the
+                // RX queue.
+                if self.rx.queue.is_empty(&self.mem) && self.rx.deferred_frame {
                     return Err(DeviceError::NoAvailBuffers);
                 }
 
@@ -1461,7 +1465,8 @@ mod tests {
         let mem = GuestMemory::new(&[(GuestAddress(0), 0x10000)]).unwrap();
         let (mut h, _txq, rxq) = default_test_netepollhandler(&mem, test_mutators);
 
-        // The RX queue is empty.
+        // The RX queue is empty and rx.deferred_frame flag is set.
+        h.rx.deferred_frame = true;
         match h.handle_event(RX_TAP_EVENT, epoll::Events::EPOLLIN) {
             Err(DeviceError::NoAvailBuffers) => (),
             _ => panic!("invalid"),