4x2 MIMO SRSRAN OFH with RAN650 Throughput

[IbrahimBabiker87]

Hello all,

Im testing with 4x2 MIMO Srsran and RAN650 Bentel RU, Some How Im limited in DL throughput I was suspecting the CPUs utilization however there was no CPU maxing out , however I found below SDU drops in PDCP.

Why this drop is happening ? SN= 9460 & count=271604
and du you have some prametrs for RLC buffer ?
Is bellow buffer Pool settings are related ??

buffer_pool: 
  nof_segments: 524288                  # Optional UINT (524288). Sets the number of segments allocated by the buffer pool. 
  segment_size: 1024                    # Optional UINT (1024). Sets the size of each buffer pool segment in bytes. 

2023-11-28T16:45:59.871715 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871716 [PDCP    ] [I] ue=0 DRB1 DL: TX PDU. type=data pdu_len=1379 sn=9455 count=271599
2023-11-28T16:45:59.871718 [RLC     ] [I] ue=0 DRB1 DL: TX SDU. sdu_len=1379 pdcp_sn=9455 queued_sdus=3491 queued_bytes=4814089
2023-11-28T16:45:59.871721 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871722 [PDCP    ] [I] ue=0 DRB1 DL: TX PDU. type=data pdu_len=1379 sn=9456 count=271600
2023-11-28T16:45:59.871724 [RLC     ] [I] ue=0 DRB1 DL: TX SDU. sdu_len=1379 pdcp_sn=9456 queued_sdus=3492 queued_bytes=4815468
2023-11-28T16:45:59.871727 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871729 [PDCP    ] [I] ue=0 DRB1 DL: TX PDU. type=data pdu_len=1379 sn=9457 count=271601
2023-11-28T16:45:59.871730 [RLC     ] [I] ue=0 DRB1 DL: TX SDU. sdu_len=1379 pdcp_sn=9457 queued_sdus=3493 queued_bytes=4816847
2023-11-28T16:45:59.871734 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871735 [PDCP    ] [I] ue=0 DRB1 DL: TX PDU. type=data pdu_len=1379 sn=9458 count=271602
2023-11-28T16:45:59.871736 [RLC     ] [I] ue=0 DRB1 DL: TX SDU. sdu_len=1379 pdcp_sn=9458 queued_sdus=3494 queued_bytes=4818226
2023-11-28T16:45:59.871739 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871741 [PDCP    ] [I] ue=0 DRB1 DL: TX PDU. type=data pdu_len=1379 sn=9459 count=271603
2023-11-28T16:45:59.871742 [RLC     ] [I] ue=0 DRB1 DL: TX SDU. sdu_len=1379 pdcp_sn=9459 queued_sdus=3495 queued_bytes=4819605
2023-11-28T16:45:59.871744 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871746 [PDCP    ] [I] ue=0 DRB1 DL: TX PDU. type=data pdu_len=1379 sn=9460 count=271604
2023-11-28T16:45:59.871747 [RLC     ] [I] ue=0 DRB1 DL: TX SDU. sdu_len=1379 pdcp_sn=9460 queued_sdus=3496 queued_bytes=4820984
2023-11-28T16:45:59.871750 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871751 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871753 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871756 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871757 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871758 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871761 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871761 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871764 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871765 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871767 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871768 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871770 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871773 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871774 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871775 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871777 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871778 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871779 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871781 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871782 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871783 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605
2023-11-28T16:45:59.871785 [GTPU    ] [I] ue=0 DL teid=0x000001: RX SDU. sdu_len=1376 teid=0x000001 qos_flow=QFI=1
2023-11-28T16:45:59.871786 [PDCP    ] [I] ue=0 DRB1 DL: Dropping SDU to avoid overloading RLC queue. tx_trans=267509 tx_next=271605

[ismagom]

Can you set logs to warning and send console traces and logs please? What traffic are you generating?

[ismagom]

Could you share a picture that shows the entire constellation? Can you also plot the CCDF to see if there is compression? If there is no compression, then we can increase iq_scale

[IbrahimBabiker87]

Hello @ismagom
Thank you for your support
I managed to get 1.1G in DL after tuning the iq scale increased up to 4.5, However with n310 for this configuration 100Mhz and 4x1 with 256QAM I could hit 1.4G for downlink .
I have attached the gnb.log
gnb.log

         -----------------DL-----------------------|------------------UL--------------------
 pci rnti  cqi  ri  mcs  brate   ok  nok  (%)  dl_bs | pusch  mcs  brate   ok  nok  (%)    bsr
   1 4601   14   4   23   1.1G 1465  135   8%  4.81M |  16.2   20    26k    6    0   0%      0
   1 4601   12   4   23   1.1G 1457  142   8%  4.63M |  16.2   20    39k    9    0   0%      0
   1 4601   13   4   23   1.1G 1457  143   8%   4.2M |  16.2   20    57k   13    2  13%      0
   1 4601   12   4   23   1.1G 1424  176  11%  4.54M |  16.2   20    44k   10    0   0%      0
   1 4601   12   4   23   1.1G 1452  148   9%  4.51M |  16.2   20    44k   10    0   0%      0
   1 4601   13   4   23   1.1G 1417  183  11%  4.65M |  16.1   20    44k   10    1   9%      0
   1 4601   12   4   24   1.1G 1472  128   8%  4.54M |  16.2   20    30k    7    0   0%      0
   1 4601   13   4   24   1.1G 1390  210  13%  5.32M |  16.0   20    44k   10    0   0%      0
   1 4601   13   4   23   1.1G 1485  115   7%  4.16M |  16.2   20    35k    8    0   0%      0
   1 4601   13   4   24   1.1G 1416  184  11%  4.44M |  16.0   20    39k    9    3  25%      0
   1 4601   13   4   23   1.1G 1474  126   7%  4.54M |  16.1   20    44k   10    0   0%      0

           -----------------DL-----------------------|------------------UL--------------------
 pci rnti  cqi  ri  mcs  brate   ok  nok  (%)  dl_bs | pusch  mcs  brate   ok  nok  (%)    bsr
   1 4601   13   4   22   1.0G 1432  168  10%  4.84M |  16.2   20    30k    7    0   0%      0
   1 4601   13   4   24   1.1G 1411  189  11%  4.29M |  16.0   19    44k   10    1   9%      0
   1 4601   13   4   23   1.1G 1429  171  10%  4.72M |  16.1   20    48k   11    2  15%      0
   1 4601   12   4   22   1.0G 1468  132   8%  4.66M |  16.2   20    13k    3    0   0%      0
   1 4601   14   4   23   1.1G 1418  181  11%  4.94M |  16.0   20    44k   10    0   0%      0
   1 4601   12   4   24   1.1G 1453  147   9%  4.43M |  16.2   20    52k   12    0   0%      0
   1 4601   13   4   23   1.1G 1463  137   8%   4.2M |  16.2   20    52k   12    0   0%      0
   1 4601   13   4   24   1.1G 1434  166  10%  3.41M |  16.0   20    39k    9    0   0%      0
   1 4601   12   4   23   1.1G 1433  166  10%  4.56M |  16.2   20    52k   12    2  14%      0
   1 4601   14   4   23   1.0G 1423  177  11%   5.2M |  16.2   20    26k    6    1  14%      0
   1 4601   13   4   23   976M 1356  244  15%  4.59M |  16.2   20    48k   11    0   0%      0

[ismagom]

Not it seems the CQI reported by the UE is not 15. You need to improve the RF signal, options are tweaking the iq_scale, TX attenuation/gain, antenna position, etc. If you have measurement equipment, I'd recommend looking at EVM, frequency offset, constellation diagram, PAPR, etc

[IbrahimBabiker87]

@ismagom
you were right after directly connected real UE instead of Amarisoft; the max Dl throughput was reached:

        -----------------DL-----------------------|------------------UL--------------------
 pci rnti  cqi  ri  mcs  brate   ok  nok  (%)  dl_bs | pusch  mcs  brate   ok  nok  (%)    bsr
   1 4605   14   4   26   1.4G 1470  118   7%  4.01M |  20.2   28    48k   11    0   0%      0
   1 4605   14   4   26   1.4G 1467  120   7%  4.04M |  20.3   28    52k   12    0   0%      0
   1 4605   14   4   26   1.5G 1514   74   4%     4M |  20.5   28    39k    9    0   0%      0
   1 4605   15   4   27   1.5G 1532   55   3%  3.79M |  20.3   28    44k   10    0   0%      0
   1 4605   14   4   26   1.4G 1493   95   5%  3.94M |  20.1   28    43k   10    0   0%      0
   1 4605   15   4   26   1.4G 1470  117   7%  4.24M |  20.1   28    52k   12    0   0%      0
   1 4605   15   4   26   1.5G 1528   60   3%  3.83M |  19.9   28    39k    9    0   0%      0
   1 4605   15   4   26   1.4G 1465  122   7%  3.88M |  20.1   28    43k   10    0   0%      0
   1 4605   15   4   26   1.4G 1503   85   5%  3.93M |  20.1   28    35k    8    0   0%      0
   1 4605   15   4   26   1.5G 1513   73   4%  4.47M |  20.0   28    39k    9    0   0%      0
   1 4605   15   4   26   1.4G 1477  109   6%  3.92M |  20.1   28    57k   13    0   0%      0

           -----------------DL-----------------------|------------------UL--------------------
 pci rnti  cqi  ri  mcs  brate   ok  nok  (%)  dl_bs | pusch  mcs  brate   ok  nok  (%)    bsr
   1 4605   15   4   26   1.4G 1477  110   6%  4.06M |  20.1   28    52k   12    0   0%      0
   1 4605   15   4   27   1.5G 1519   69   4%  3.79M |  20.0   28    39k    9    0   0%      0
   1 4605   15   4   26   1.4G 1504   83   5%  4.38M |  19.9   28    43k   10    0   0%      0
   1 4605   15   4   26   1.4G 1468  120   7%  3.92M |  20.3   28    57k   13    0   0%      0
   1 4605   15   4   26   1.5G 1518   69   4%  3.79M |  19.9   28    39k    9    0   0%      0
   1 4605   15   4   26   1.5G 1517   71   4%  4.18M |  19.7   28    47k   11    0   0%      0
   1 4605   15   4   26   1.4G 1499   88   5%  3.79M |  20.0   28    48k   11    0   0%      0
   1 4605   15   4   26   1.4G 1495   93   5%  4.71M |  20.2   28    39k    9    0   0%      0
   1 4605   15   4   26   1.4G 1491   96   6%     4M |  19.7   28    48k   11    0   0%      0
   1 4605   15   4   26   1.5G 1530   58   3%  4.21M |  20.2   28    35k    8    0   0%      0
   1 4605   15   4   27   376M  384   95  19%  5.23M |  20.1   28    17k    4    0   0%      0

           -----------------DL-----------------------|------------------UL--------------------
 pci rnti  cqi  ri  mcs  brate   ok  nok  (%)  dl_bs | pusch  mcs  brate   ok  nok  (%)    bsr
   1 4605   15   4   23   1.0G 1245  160  11%  4.57M |  20.8   28    35k    8    0   0%      0
   1 4605   15   4   26   1.4G 1488   99   6%   3.9M |  20.2   28    39k    9    0   0%      0
   1 4605   14   4   26   1.4G 1486  101   6%  4.07M |  20.4   28    30k    7    0   0%      0
   1 4605   15   4   26   1.4G 1483  104   6%  3.82M |  20.3   28    35k    8    0   0%      0
   1 4605   15   4   26   1.4G 1484  104   6%  4.26M |  20.3   28    39k    9    0   0%      0
   1 4605   15   4   26   1.4G 1459  128   8%   4.2M |  20.3   28    35k    8    0   0%      0
   1 4605   15   4   26   1.4G 1475  113   7%  3.89M |  20.3   28    61k   14    0   0%      0
   1 4605   15   4   26   1.4G 1462  125   7%     4M |  20.4   28    61k   14    0   0%      0
   1 4605   15   4   26   1.4G 1473  115   7%  3.85M |  20.3   28    52k   12    0   0%      0
   1 4605   15   4   26   1.5G 1520   67   4%  4.25M |  19.8   28    44k   10    0   0%      0
   1 4605   15   4   26   1.4G 1480  108   6%  4.65M |  20.0   28    48k   11    0   0%      0

[ismagom]

nice! thanks for reporting. Is this with the RAN650? We haven't been able to test it ourselves yet

[andrepuschmann]

Nice work @IbrahimBabiker87! What kind of antennas are you using with the RAN650?

[IbrahimBabiker87]

its a Quectel modem RM500Q-AE directly connected to RU with rf cables

[IbrahimBabiker87]

Hello @ Srsran,

Please note that above results were reached using UDP, However the TCP Throughput is very poor compared to this its maximize only at around 150 Mbps.
Do you have special settings to optimize the TCP performance ??

[alvasMan]

Hi @IbrahimBabiker87, could you perhaps send some packet captures?
A tcpdump at the gNB's N3 interface and mac pcaps would be ideal, if possible.

To enable the mac pcaps you can append this to the config file: pcap --mac_enable=true --mac_type=dlt.
To view the pcaps with the mac-nr-framed protocol, you will need the latest wireshark from master.

[IbrahimBabiker87]

Hello @alvasMan ,

please find below,

https://drive.google.com/file/d/1M9pwZp5KeSAb0hocMsHj2tgAiSS1U7ef/view?usp=sharing

[alvasMan]

Thank you for the PCAPs, Ibrahim.

As a note though, UDP PCAPs have a size limitation of 65536 bytes due to UDP header size limitation. However, the MAC PDU when using 4x2 MIMO can grow bigger than this value. On your capture, I can see malformed packets because of this, for example on frame 373. To circumvent this, I recommend that you use use DLT type pcaps with the option pcap --mac_type=dlt when doing downlink MIMO. To view the DLT type pcaps, make sure your wireshark is built from source on the latest master. Then you can use the mac-nr-framed protocol for dissection.

Could you please re-run your experiment with the DLT type? There are many malformed packets in your capture which makes it hard to analyze the problem. Also can you please include the tcpdump at the N3 (i.e. GTP-U connection between the core and the gNB)? This is important to confirm whether losses occur between the core and the gNB or somewhere inside the gNB stack.

Regarding your TCP issues, a couple of things:

1. Did you change the RLC SDU queue value? Can you use 4096, if you are not using it already?
   Smaller values then this can cause drops of PDCP sequence numbers, thus drops and extra latency due to the PDCP reordering timer.

2. Did you change the GTP-U queue size? Are packets dropping at the GTP-U reception? Default values for this queue should be fine.

3. Can you post your qos.yml with your 5QI configs if you are using one? Or are you using defaults?

4. How is the gNB connected to the core? Is it a local interface or through Ethernet? What core are you using?
   Can you make sure that you are not losing traffic between the core and the gNB with tcpdump? We have recently had similar issues in our lab because of this.
   If the problem is losses between the core and the gnb, you might want to try increasing your NIC buffers like this: sudo ethtool -G <your_if> tx <value> rx <value> (You can lookup valid values with ethtool -g eno8603np3).

[IbrahimBabiker87]

Dear @alvasMan ,

Please find below responses,

Did you change the RLC SDU queue value? Can you use 4096, if you are not using it already?
Smaller values then this can cause drops of PDCP sequence numbers, thus drops and extra latency due to the PDCP reordering timer.

**_its 4096 already._**


Did you change the GTP-U queue size? Are packets dropping at the GTP-U reception? Default values for this queue should be fine.

**_not changed_**


Can you post your qos.yml with your 5QI configs if you are using one? Or are you using defaults?

using 5QI 9 , disable poll-byte and pdu SN increased to 18 in both RLC/PDCP " helped in UDP"

      am:
        tx:
          sn: 18
          t-poll-retransmit: 80
          max-retx-threshold: 4
          poll-pdu: -1
          poll-byte: -1
          queue-size: 4096
        rx:
          sn: 18
          t-reassembly: 80
          t-status-prohibit: 10
    pdcp:
      integrity_required: false
      tx:
        sn: 18
        discard_timer: -1
        status_report_required: false
      rx:
        sn: 18
        t_reordering: 80
        out_of_order_delivery: false
    f1u_du:
      backoff_timer: 10
    f1u_cu_up:
      backoff_timer: 10
#    mac:
#       lc_priority: 5
#       lc_group_id: 2
#       bucket_size_duration_ms: 5
#       prioritized_bit_rate_kBps: 65537
#

How is the gNB connected to the core? Is it a local interface or through Ethernet? What core are you using?

**_ehternet 10GB , Open5GS is used._**

Can you make sure that you are not losing traffic between the core and the gNB with tcpdump? We have recently had similar issues in our lab because of this.

I do have some retransmission  , I will try to increase the buffers anyways
If the problem is losses between the core and the gnb, you might want to try increasing your NIC buffers like this: sudo ethtool -G <your_if> tx <value> rx <value> (You can lookup valid values with ethtool -g eno8603np3).

attached are the logs:

https://drive.google.com/file/d/1DTty4CAWaOzT6a_EXyxb1-ZeYludCJBk/view?usp=drive_link

[alvasMan]

Thank you @IbrahimBabiker87, much appreciated. I confirm that pcaps are not malformed.
I am trying to analyze the problem now, but in the meantime a quick question.

I see that you are trying to do bidirectional iperf3, correct? Do you have similar results with unidirectional DL iperf3?

[IbrahimBabiker87]

@alvasMan
Yes, the issue is there in unidirectional also
Yes Im using iperf3

[alvasMan]

OK, a couple of things here:

1. I do not see GTP-U or PDCP drops. This issue is at the air interface.
2. I see you have losses of TCP traffic for example at TCP relative sequence number 3647689. This is initially transmitted in frame 1668 of the mac.pcap, with RLC SN=5916.
3. I see that this SN is acked by the RLC without a RLC RETX at frame 1743. That is roughly 90ms after the initial TX. This is larger than your PDCP t-Reordering.

My guess here is that the PDCP is moving on due to the low t-Reordering is. Also, the RLC did not sent many polling bits during that time. A couple of suggestions for now:

1. Try increasing the PDCP reordering timer a bit, it's on the low side. Maybe 120ms/150ms should suffice.
2. Try decreasing the t-PollRetransmit a bit, it's kind of long for your short t-Reordering. You do not have time for RLC RETX'es to kick in before the PDCP t-Reordering kicks in. Either that or use PollPDU to make sure you poll a bit more often.
3. If suggestion 1 and 2 do not work, did you try the default 5QI configs with TCP (i.e. don't provide any 5QI config)?

Let me know if that helps.

One final question, in the console what kind of bler are you seeing?
I saw in a previous run you have 5-10% on the console, just to confirm that is the same here?

[IbrahimBabiker87]

Hi @alvasMan ,

Thank you for your response,

I have tested with t-reordering time 120 ms and no impact on TCP behavior
tested with t-poll Re-transmit timer of 40 ms and no impact on TCP.
I commented out the qos to test with default settings and no impact

Yes the BLER is around 5~10% as Im using bler target of 10% it helped in UDP, however even testing with 1% bler target didn't improve the TCP throughput.

[alvasMan]

Hum... You seem to have periodic intervals with high losses.
Look at these RTT plots from the wireshark GTP-U pcap (DL stream of port 40975):

Looking at a TCP packet with a very large RTT (700ms, relative sequence number 41593889), I can see that TCP tried to transmit this packet 5 times. I can see these transmissions on the mac.pcap on frames 5912, 6021, 6118, 6245, 6372. I can see these are not ACKed at the RLC for a long time (~180ms for the first attempt).

I am not sure what is causing these losses. Could you please share your full config?
We will try replicate in our lab.

[IbrahimBabiker87]

Thank you @alvasMan

here below my Config:

gnb_id: 1                             # Optional UINT (411). Sets the numerical ID associated with the gNB.
amf:
  addr: 10.0.135.40                                               # The address or hostname of the AMF.
  bind_addr: 10.0.135.150                                            # A local IP that the gNB binds to for traffic from the AMF.

slicing:                                # Optional TEXT. Configure network slicing options. This can only be set via the configuration file.
  -
    sst: 1
    sd: 16777215
  -
    sst: 2                                    # Optional UINT (1). Sets the Slice Service Type. Supported: [0 - 255].
    sd: 16777215                                     # Optional UINT (0). Sets the Service Differentiator. Supported: [0-16777215].

cu_up: 
  gtpu_queue_size: 4096                # Optional INT (2048). Sets the GTP-U queue size, in PDUs.
#  gtpu_reordering_timer: 0             # Optional INT (0). Sets the GTP-U RX reordering timer (in milliseconds). 



ru_ofh:
  ru_bandwidth_MHz: 100                                           # RU instantaneous bandwidth.
  t1a_max_cp_dl: 500                                              # Maximum T1a on Control-Plane for Downlink in microseconds.
  t1a_min_cp_dl: 250                                              # Minimum T1a on Control-Plane for Downlink in microseconds.
  t1a_max_cp_ul: 465                                              # Maximum T1a on Control-Plane for Uplink in microseconds.
  t1a_min_cp_ul: 250                                              # Minimum T1a on Control-Plane for Uplink in microseconds.
  t1a_max_up: 250                                                 # Maximum T1a on User-Plane in microseconds.
  t1a_min_up: 80
  ta4_max: 200                                                    # Maximum Ta4 on User-Plane in microseconds.
  ta4_min: 0                                                      # Minimum Ta4 on User-Plane in microseconds.
  is_prach_cp_enabled: false                                      # Configures if Control-Plane messages should be used to receive PRACH messages.
  compr_method_ul: bfp                                            # Uplink compression method.
  compr_bitwidth_ul: 9                                            # Uplink IQ samples bitwidth after compression.
  compr_method_dl: bfp                                            # Downlink compression method.
  compr_bitwidth_dl: 9                                            # Downlink IQ samples bitwidth after compression.
  compr_method_prach: bfp                                         # PRACH compression method.
  compr_bitwidth_prach: 9                                        # PRACH IQ samples bitwidth after compression.
  enable_ul_static_compr_hdr: true                                # Configures if the compression header is present for uplink User-Plane messages (false) or not present (true).
  enable_dl_static_compr_hdr: true                                # Configures if the compression header is present for downlink User-Plane messages (false) or not present (true).
  iq_scaling: 4.5                                             # IQ samples scaling factor applied before compression, should be a positive value smaller than 10.  
  cells:                                # Optional TEXT. Sets the hardware specific cell configuration on a per cell basis.
  - network_interface: enp1s0f0             # Optional TEXT (enp1s0f0). Sets the ethernet network interface name for the RU. Format: a string, e.g. [interface_name].
    ru_mac_addr: 70:b3:d5:e1:5d:3d       # Optional TEXT (70:b3:d5:e1:5b:06). Sets the RU MAC address. Format: a string, e.g. [AA:BB:CC:DD:11:22:33].
    du_mac_addr: 7c:c2:55:79:85:e8       # Optional TEXT (00:11:22:33:00:77). Sets the DU MAC address. Format: a string, e.g. [AA:BB:CC:DD:11:22:33].
    vlan_tag: 5                             # Optional UINT (1). Sets the V-LAN tag control information field. Supported: [1 - 4094].
    prach_port_id: [4,5]                   # Optional UINT (4). Sets the RU PRACH eAxC port ID. Supported: [0 - 65535].
    dl_port_id: [0,1,2,3]                   # Optional UINT (0, 1). Sets the RU downlink eAxC port ID. Format: vector containing all DL eXaC ports, e.g. [0, ...\ , N].
    ul_port_id: [0,1]                      # Optional UINT (0). Sets the RU uplink eAxC port ID. Supported: [0 - 65535].

cell_cfg:
  dl_arfcn: 650112                                              # ARFCN of the downlink carrier (center frequency).
  band: 77                                                        # The NR band.
  channel_bandwidth_MHz: 100                                       # Bandwith in MHz. Number of PRBs will be automatically derived.
  common_scs: 30                                                  # Subcarrier spacing in kHz used for data.
  plmn: "00101"                                                   # PLMN broadcasted by the gNB.
  tac: 1                                                          # Tracking area code (needs to match the core configuration).
  pci: 1                                                          # Physical cell ID. 
  nof_antennas_dl: 4                                              # Downlink number of antennas.
  nof_antennas_ul: 2                                              # Uplink number of anntennas.
  pcg_p_nr_fr1: +23                      # Optional INT (10). Sets the maximum total TX power to be used by the UE in this NR cell group across in FR1. Supported: [-30 - +23].
  tdd_ul_dl_cfg: 
    dl_ul_tx_period: 10                     # Optional INT (10). Sets the TDD pattern periodicity in slots. The combination of this value and the chosen numerology must lead to a TDD periodicity of 0.5, 0.625, 1, 1.25, 2, 2.5, 3, 4, 5 or 10 milliseconds. Supported: [2 - 80].
    nof_dl_slots: 7                         # Optional INT (6). Number of consecutive full Downlink slots. Supported: [0-80].
    nof_dl_symbols: 6                       # Optional INT (0). Number of Downlink symbols at the beginning of the slot following full Downlink slots. Supported: [0-13].
    nof_ul_slots: 2                         # Optional INT (3). Number of consecutive full Uplink slots. Supported: [0 - 80].
    nof_ul_symbols: 4                       # Optional INT (0). Number of Uplink symbols at the end of the slot preceding the first full Uplink slot. Supported: [0-13].
    pattern2: 
      dl_ul_tx_period: 10                       # Optional INT (10). Sets the TDD pattern periodicity in slots. The combination of this value and the chosen numerology must lead to a TDD periodicity of 0.5, 0.625, 1, 1.25, 2, 2.5, 3, 4, 5 or 10 milliseconds. Supported: [2 - 80].
      nof_dl_slots: 7                           # Optional INT (6). Number of consecutive full Downlink slots. Supported: [0-80].
      nof_dl_symbols: 6                         # Optional INT (0). Number of Downlink symbols at the beginning of the slot following full Downlink slots. Supported: [0-13]
      nof_ul_slots: 2                           # Optional INT (3). Number of consecutive full Uplink slots. Supported: [0 - 80].
      nof_ul_symbols: 4                         # Optional INT (0). Number of Uplink symbols at the end of the slot preceding the first full Uplink slot. Supported: [0-13].

  prach: 
      prach_config_index: 7                   # Optional UINT (1). Sets the PRACH configuration index. Supported: [0 - 255].
      prach_root_sequence_index: 1                                  # PRACH root sequence index.
      zero_correlation_zone: 0                # Optional UINT (0). Sets the Zero Correlation Zone, which determines the size of the cyclic shift and the number of preamble sequences which can be generated from each Root Sequence Index. Supported: [0 - 15].
      prach_frequency_start: 0                                      # Offset in PRBs of lowest PRACH transmission occasion in frequency domain respective to PRB 0.


  ssb: 
     ssb_period: 20                          # Optional UINT (10). Sets the period of SSB scheduling in milliseconds. Supported: [5, 10, 20].
     ssb_block_power_dbm: -16                # Optional INT (-16). Sets the SS PBCH block power in dBm. Supported: [-60 - +50].
     pss_to_sss_epre_db: 0                   # Optional UINT (0). Sets the Synchronization Signal Block Primary Synchronization Signal to Secondary Synchronization Signal Energy Per Resource Element ratio in dB. Supported: [0, 3].
  ul_common: 
     p_max: 23                                  # Optional TEXT. Sets maximum transmit power allowed in this serving cell. Supported: [-30 - +23].
 
  csi: 
#     csi_rs_enabled: true                       # Optional BOOLEAN (1). Enables CSI-RS resources and CSI reporting. Supported: [0, 1].
     csi_rs_period: 20                       # Optional UINT (20). Sets the CSI-RS period in milliseconds. Supported: [10, 20, 40, 80].
     meas_csi_rs_slot_offset: 2              # Optional UINT (2). Sets the slot offset of first CSI-RS resource used for measurement.
     tracking_csi_rs_slot_offset: 12            # Optional UINT (12). Sets the slot offset of the first CSI-RS slot used for tracking.
     zp_csi_rs_slot_offset:                  # Optional TEXT. Sets the slot offset of the ZP CSI-RS resources.     
     pwr_ctrl_offset: 0                      # Optional INT (0). Sets the power offset of PDSCH RE to NZP CSI-RS RE in dB. Supported: [-8 - 15].

  pdsch:
     mcs_table: qam256                        # Optional TEXT (qam64). Sets the MCS table to use for PDSCH. Supported: [qam64, qam256].
     min_ue_mcs:                             # Optional UINT. Sets a minimum PDSCH MCS value to be used for all UEs. Supported: [0 - 28].
     max_ue_mcs:                             # Optional UINT. Sets a maximum PDSCH MCS value to be used for all UEs. Supported: [0 - 28].
     fixed_rar_mcs: 0                        # Optional UINT (0). Sets a fixed RAR MCS value for all UEs. Supported: [0 - 28]. 
     fixed_sib1_mcs: 5                       # Optional UINT (5). Sets a fixed SIB1 MCS for all UEs. Supported: [0 - 28].
     nof_harqs: 16                           # Optional UNIT (16). Sets the number of Downlink HARQ processes. Supported [2, 4, 6, 8, 10, 12, 16]. 
     max_consecutive_kos: 100                # Optional UINT (100). Sets the maximum number of consecutive HARQ-ACK KOs before an RLF is reported. Supported: [0 - inf]. 
     rv_sequence: [0,2,3,1]                  # Optional UINT (0,2,3,1). Sets the redundancy version sequence to use for PDSCH. Supported: any combination of [0, 1, 2, 3].
   #  mcs_table: qam64                        # Optional TEXT (qam64). Sets the MCS table to use for PDSCH. Supported: [qam64, qam256].
     min_rb_size: 1                          # Optional UINT (1). Sets the minimum RB size for the UE PDSCH resource allocation. Supported: [1 - 275].
     max_rb_size: 275                        # Optional UINT (275). Sets the maximum RB size for the UE PDSCH resource allocation. Supported: [1 - 275].
     max_pdschs_per_slot: 35                 # Optional UINT (35). Sets the maximum number of PDSCH grants per slot, including SIB, RAR, Paging and UE data grants. Supported: [1 - 35].
     max_alloc_attempts: 35                  # Optional UINT (35). Sets the maximum number of DL or UL PDCCH grant allocation attempts per slot before scheduler skips the slot. Supported: [1 - 35].
     olla_cqi_inc_step: 0.001                # Optional FLOAT (0.001). Sets the outer-loop link adaptation (OLLA) increment value. The value 0 means that OLLA is disabled. Supported: [0 - 1].
     olla_target_bler: 0.1                  # Optional FLOAT (0.01). Sets the target DL BLER set in Outer-loop link adaptation (OLLA) algorithm. Supported: [0 - 0.5].
     olla_max_cqi_offset: 4                  # Optional FLOAT (4). Sets the maximum offset that the Outer-loop link adaptation (OLLA) can apply to CQI. Supported: positive float. 
     dc_offset: center                       # Optional TEXT. Sets the direct Current (DC) Offset in number of subcarriers, using the common SCS as reference for carrier spacing, and the center of the gNB DL carrier as DC offset value 0. The user can additionally                                              # set "outside" to define that the DC offset falls outside the DL carrier or "undetermined" in the case the DC offset is unknown. Supported: [-1650 - 1649] OR [outside,undetermined,center]. 
     harq_la_cqi_drop_threshold:             # Optional UINT. Sets the link Adaptation (LA) threshold for drop in CQI of the first HARQ transmission above which HARQ retransmissions are cancelled. Set this value to 0 to disable this feature. Supported: [0 - 15]. 
     harq_la_ri_drop_threshold:              # Optional UINT. Sets the link Adaptation (LA) threshold for drop in nof. layers of the first HARQ transmission above which HARQ retransmission is cancelled. Set this value to 0 to disable this feature. Supported: [0 - 4]. 


   
  pucch:
    p0_nominal: -76                         # Optional UINT (-90). Sets the power control parameter P0 for PUCCH transmissions in dBm. Supported: multiples of 2 and within the [-202, 24] interval.
    sr_period_ms: 40                        # Optional UINT (40). Sets the SR period in milliseconds. Supported: [1,2,4,8,10,16,20,40,80,160,320].
    f1_nof_ue_res_harq: 3                   # Optional UINT (3). Sets the number of PUCCH F1 resources available per UE for HARQ. Supported: [1 - 8].
    f1_nof_cell_res_sr: 2                   # Optional UINT (2). Sets the number of PUCCH F1 resources available per cell for SR. Supported: [1 - 10].
    f1_nof_symbols: 14                      # Optional UINT (14). Sets the number of symbols for PUCCH F1 resources. Supported: [4 - 14].
    f1_enable_occ: 0                        # Optional BOOLEAN (0). Enables OCC for PUCCH F1. Supported: [0, 1].
    f1_nof_cyclic_shifts: 1                 # Optional UINT (1). Sets the number of possible cyclic shifts available for PUCCH F1 resources. Supported: [1,2,3,4,6,12].
    f1_intraslot_freq_hop: 0                # Optional BOOLEAN (0). Enables intra-slot frequency hopping for PUCCH F1. Supported: [0, 1].
    nof_cell_harq_pucch_res_sets: 1         # Optional UINT (1). Sets the number of separate PUCCH resource sets for HARQ-ACK that are available in the cell. The higher the number of sets, the lower the chances UEs have to share the same PUCCH resources. Supported: [1 - 10].
    f2_nof_ue_res_harq: 6                   # Optional UINT (6). Sets the number of PUCCH F2 resources available per UE for HARQ. Supported: [1 - 8].
    f2_nof_cell_res_csi: 1                  # Optional UINT (1). Sets the number of PUCCH F2 resources available per cell for CSI. Supported: [1 - 10].
    f2_nof_symbols: 2                       # Optional UINT (2). Sets the number of symbols for PUCCH F2 resources. Supported: [1 - 2].
    f2_max_nof_rbs: 1                       # Optional UINT (1). Sets the max number of RBs for PUCCH F2 resources. Supported: [1 - 16].
    f2_max_payload:                         # Optional INT. Sets the max number of payload bits for PUCCH F2 resources. Supported [1 - 11].
    f2_max_code_rate: dot35                 # Optional TEXT (dot35). Sets the PUCCH F2 max code rate. Supported: [dot08, dot15, dot25, dot35, dot45, dot60, dot80].
    f2_intraslot_freq_hop: 0                # Optional BOOLEAN (0). Enables intra-slot frequency hopping for PUCCH F2. Supported: [0, 1].
   # min_k1: 4                               # Optional UINT (4). Sets the minimum value of K1 (difference in slots between PDSCH and HARQ-ACK). Lower k1 values will reduce latency, but place a stricter requirement on the UE decode latency. Supported: [1 - 4].
    min_k1: 2
  pusch:
   min_k2: 2
   p0_nominal_with_grant: -60              # Optional INT (-76). Sets the P0 value for PUSCH grant (except MSG3), in dBm. Supported: multiples of 2 within the range [-202, 24].
   olla_snr_inc_step: 0.001                # Optional FLOAT (0.001). Sets the outer-loop link adaptation (OLLA) increment value. The value 0 means that OLLA is disabled. Supported: [0 - 1].
   olla_target_bler: 0.1                  # Optional FLOAT (0.01). Sets the target UL BLER set in Outer-loop link adaptation (OLLA) algorithm. sUPPORTED: [0 - 0.5]. 
   olla_max_snr_offset: 5                  # Optional FLOAT (5). Sets the maximum offset that the Outer-loop link adaptation (OLLA) can apply to estimate the UL SNR. Supported: positive float. 
   max_consecutive_kos: 100                # Optional UINT (100). Sets the maximum number of consecutive CRC KOs before an RLF is reported. Supported: [0 - inf]. 
   rv_sequence: [0]                        # Optional UINT (0). Sets the redundancy version sequence to use for PUSCH. Supported: any combination of [0, 1, 2, 3].
   mcs_table: qam64                        # Optional TEXT (qam64). Sets the MCS table to use for PUSCH. Supported: [qam64, qam256].
   msg3_delta_preamble: 6                  # Optional INT (6). Sets the MSG3 DeltaPreamble power offset between MS3 and RACH preamble transmission. Supported: [-1 - 6].
   dc_offset: 0                              # Optional TEXT. Sets the direct Current (DC) Offset in number of subcarriers, using the common SCS as reference for carrier spacing, and the center of the gNB DL carrier as DC offset value 0. The user can additionally 
   max_puschs_per_slot: 16                 # Optional UINT (16). Sets the maximum number of PUSCH grants per slot. Supprted: [1 - 16].
   b_offset_ack_idx_1: 9                   # Optional UINT (9). Sets the betaOffsetACK-Index1 part of UCI-OnPUSCH. Supported: [0 - 31].
   b_offset_ack_idx_2: 9                   # Optional UINT (9). Sets the betaOffsetACK-Index2 part of UCI-OnPUSCH. Supported: [0 - 31].
   b_offset_ack_idx_3: 9                   # Optional UINT (9). Sets the betaOffsetACK-Index3 part of UCI-OnPUSCH. Supported: [0 - 31].
   beta_offset_csi_p1_idx_1: 9             # Optional UINT (9). Sets the b_offset_csi_p1_idx_1 part of UCI-OnPUSCH. Supported: [0 - 31].
   beta_offset_csi_p1_idx_2: 9             # Optional UINT (9). Sets the b_offset_csi_p1_idx_2 part of UCI-OnPUSCH. Supported: [0 - 31].
   beta_offset_csi_p2_idx_1: 9             # Optional UINT (9). Sets the b_offset_csi_p2_idx_1 part of UCI-OnPUSCH. Supported: [0 - 31].
   beta_offset_csi_p2_idx_2: 9             # Optional UINT (9). Sets the b_offset_csi_p2_idx_2 part of UCI-OnPUSCH. Supported: [0 - 31].



  pdcch: 
#   common: 
#      coreset0_index:                           # Optional INT. Sets the CORESET 0 index. Supported: [0 - 15].
#      ss1_n_candidates: [0, 0, 1, 0, 0]         # Optional UINT ({0, 0, 1, 0, 0}). Sets the number of PDCCH candidates per aggregation level for SearchSpace#1. Supported: any 5 value array containing the following UINT values [0, 1, 2, 3, 4, 5, 6, 7, 8].
#      ss0_index: 0                              # Optional UINT (0). Sets the SearchSpace#0 index. Supported: [0 - 15].
    dedicated: 
       coreset1_rb_start: 1                      # Optional INT (0). Sets the starting common resource block (CRB) number for CORESET 1, relative to CRB0. Supported: [0 - 275].
       coreset1_l_crb: 72                           # Optional INT (Across entire BW of cell). Sets the length of CORESET 1 in number of CRBs. Supported: [0 - 275].
       coreset1_duration: 1                        # Optional INT (Max(2, Nof. CORESET#0 symbols)). Sets the duration of CORESET 1 in number of OFDM symbols. Supported: [1 - 2].
#      ss2_n_candidates: [0, 1, 1, 0, 0]         # Optional UINT ({0, 0, 0, 0, 0}). Sets the number of PDCCH candidates per aggregation level for SearchSpace#2. Supported: any 5 value array containing the following UINT values [0, 1, 2, 3, 4, 5, 6, 7, 8]. 
#      dci_format_0_1_and_1_1: 1                 # Optional BOOLEAN (1). Sets whether to use non-fallback or fallback DCI format in UE SearchSpace#2. Supported: [0, 1].
#      ss2_type: ue_dedicated                    # Optional TEXT (ue_dedicated). Sets the SearchSpace type for UE dedicated SearchSpace#2. Supported: [common, ue_dedicated].
#

qos:
  -
    five_qi: 9 # E.g. Buffered video streaming, TCP-based traffic
    rlc:
      mode: am
      am:
        tx:
          sn: 18
          t-poll-retransmit: 160
          max-retx-threshold: 8
          poll-pdu: -1
          poll-byte: -1
          queue-size: 4096
        rx:
          sn: 18
          t-reassembly: 160
          t-status-prohibit: 160
    pdcp:
      integrity_required: false
      tx:
        sn: 18
        discard_timer: -1
        status_report_required: false
      rx:
        sn: 18
        t_reordering: 160
        out_of_order_delivery: false
    f1u_du:
      backoff_timer: 10
    f1u_cu_up:
      backoff_timer: 10
#    mac:
#       lc_priority: 5
#       lc_group_id: 2
#       bucket_size_duration_ms: 5
#       prioritized_bit_rate_kBps: 65537
#
#
  -
    five_qi: 7 # E.g. Voice, Video (live streaming)
    rlc:
      mode: um-bidir
      um-bidir:
        tx:
          sn: 12
          queue-size: 4096
        rx:
          sn: 12
          t-reassembly: 50
    pdcp:
      integrity_required: false
      tx:
        sn: 18
        discard_timer: -1
        status_report_required: false
      rx:
        sn: 18
        t_reordering: 80
        out_of_order_delivery: false
    f1u_du:
      backoff_timer: 10
    f1u_cu_up:
      backoff_timer: 10
    mac:
#      lc_priority: 4
#      lc_group_id: 1
#      bucket_size_duration_ms: 5
#      prioritized_bit_rate_kBps: 65537


log:
#     filename: /tmp/gnb.log                                          # Path of the log file.
#     all_level: info                   # Optional TEXT (warning). Sets a common log level across PHY, MAC, RLC, PDCP, RRC, SDAP, NGAP and GTPU layers
#  phy_level: warning                    # Optional TEXT (warning). Sets PHY log level
#  mac_level: info                    # Optional TEXT (warning). Sets MAC log level
#  rlc_level: warning                    # Optional TEXT (warning). Sets RLC log level
#  pdcp_level: warning                   # Optional TEXT (warning). Sets PDCP log level
#  rrc_level: info                    # Optional TEXT (warning). Sets RRC log level
#  sdap_level: warning                   # Optional TEXT (warning). Sets SDAP log level
#  ngap_level: warning                   # Optional TEXT (warning). Sets NGAP log level
#  gtpu_level: warning                   # Optional TEXT (warning). Sets GTPU log level
#  radio_level: info                     # Optional TEXT (info). Sets radio log level
#  fapi_level: warning                   # Optional TEXT (warning). Sets FAPI log level
#  ofh_level: info                   # Optional TEXT (warning). Sets Open Fronthaul log level
#  f1ap_level: warning                   # Optional TEXT (warning). Sets F1AP log level
#  f1u_level: warning                    # Optional TEXT (warning). Sets F1u log level
#  du_level: debug                     # Optional TEXT (warning). Sets DU log level
#  cu_level: debug                     # Optional TEXT (warning). Sets CU log level
#  sec_level: warning                    # Optional TEXT (warning). Sets security functions level
#  lib_level: debug                    # Optional TEXT (warning). Sets generic log level
#  hex_max_size: 0                       # Optional UINT (0). Sets maximum number of bytes to print for hex messages. Supported: [0 - 1024]
#  broadcast_enabled: false              # Optional BOOL (false). Enables logging in the PHY and MAC layer of broadcast messages and all PRACH opportunities
#  phy_rx_symbols_filename:              # Optional TEXT. Print received symbols to file. Symbols will be printed if a valid path is set. Format: file path. This file can be used in the srsRAN_matlab project
#  tracing_filename: /tmp/gnb_trace.log                     # Optional TEXT. Set to a valid file name to enable tracing log.

pcap: 
#   mac_enable: true
#   mac_type: dlt
#  ngap_filename: /tmp/gnb_ngap.pcap     # Optional TEXT (/tmp/gnb_ngap.pcap). Path for NGAP PCAPs. 
#  ngap_enable: true                     # Optional BOOL (false). Enable/disable NGAP packet capture.
#  e1ap_filename: /tmp/gnb_e1ap.pcap     # Optional TEXT (/tmp/gnb_e1ap.pcap). Path for E1AP PCAPs. 
#  e1ap_enable: true                     # Optional BOOL (false). Enable/disable E1AP packet capture.
#  f1ap_filename: /tmp/gnb_f1ap.pcap     # Optional TEXT (/tmp/gnb_f1ap.pcap). Path for F1AP PCAPs. 
#  f1ap_enable: true                     # Optional BOOL (false). Enable/disable F1AP packet capture.
#    mac_filename: /tmp/gnb_mac.pcap       # Optional TEXT (/tmp/gnb_mac.pcap). Path for MAC PCAPs. 
#    mac_enable: true                     # Optional BOOL (false). Enable/disable MAC packet capture.
#  e2ap_filename: /tmp/gnb_e2ap.pcap     # Optional TEXT (/tmp/gnb_e2ap.pcap). Path for E2AP PCAPs. 
#  e2ap_enable: true                     # Optional BOOL (false). Enable/disable E2AP packet capture.
#   gtpu_filename: /tmp/gnb_gtpu.pcap     # Optional TEXT (/tmp/gnb_gtpu.pcap). Path for GTPU PCAPs. 
#   gtpu_enable: true                     # Optional BOOL (false). Enable/disable GTPU packet capture.

buffer_pool: 
  nof_segments: 524288                  # Optional UINT (524288). Sets the number of segments allocated by the buffer pool. 
  segment_size: 4096                    # Optional UINT (1024). Sets the size of each buffer pool segment in bytes. 

expert_phy: 
   max_proc_delay: 5                    # Optional INT (2). Sets the maximum allowed DL processing delay in slots. Supported: [1 - 30].
   pusch_dec_max_iterations: 6           # Optional UINT (6). Sets the number of PUSCH LDPC decoder iterations. Format: Positive integer greater than 0.
   pusch_dec_enable_early_stop: true     # Optional BOOL (true). Enables the PUSCH decoder early stopping mechanism.
   pusch_sinr_calc_method: evm          # Optional TEXT (evm). Sets the PUSCH SINR calculation method. Supported: [channel_estimator, post_equalization, evm]. 
#   pdsch_processor_type: auto            # Optional TEXT (auto). Sets the PDSCH processor type. Supported: [auto, generic, concurrent, lite]. 
#   nof_pdsch_threads: 4                 # Optional UINT (1). Sets the number of threads for encoding PDSCH. Default value of one for no concurrency acceleration in the PDSCH encoding. Format: Positive integer greater than 0.
#   nof_ul_threads: 4                     # Optional UINT (4). Sets number of upper PHY threads to process uplink. It is set to 4 by default unless the available hardware concurrency is limited in which case will use a minimum of one thread.
#   nof_dl_threads: 4                    # Optional UINT (1). Sets number of upper PHY threads to process downlinklink.
#   pusch_dec_max_iterations: 6           # Optional UINT (6). Sets the number of PUSCH LDPC decoder iterations. Format: Positive integer greater than 0.
#   pusch_dec_enable_early_stop: true     # Optional BOOL (true). Enables the PUSCH decoder early stopping mechanism.
#   pusch_sinr_calc_method: evm           # Optional TEXT (evm). Sets the PUSCH SINR calculation method. Supported: [channel_estimator, post_equalization, evm]. 

#expert: 
#  enable_tuned_affinity_profile: 1      # Optional BOOLEAN (0). Enables usage of tuned affinity profile. Supported: [0, 1].
#  number_of_threads_per_cpu: 1          # Optional UINT (2). Sets the number of threads per physcial CPU. Supported [1 - 2].
#  number_of_reserved_cores: 12         # Optional UINT (4). Sets the number of CPU cores reserved for non-priority tasks. Supported: [1 - 1024].


expert_execution:
 
 affinities: 
     l1_dl_cpus: 4,5,6,7,8,9                               # Optional TEXT. Sets the number of CPU cores assigned to L1 downlink tasks. Supported: [1 - Number of available cores].
     l1_ul_cpus: 10,11,12,13,14,15                         # Optional TEXT. Sets the number of CPU cores assigned to L1 uplink tasks. Supported: [1 - Number of available cores].
     l2_cell_cpus: 16,17,18,19,30                            # Optional TEXT. Sets the number of CPU cores assigned to L2 cells tasks. Supported: [1 - Number of available cores].
     low_priority_cpus: 20,21,22,23,31                      # Optional TEXT. Sets the number of CPU cores assigned to low priority tasks. Supported: [1 - Number of available cores].
     ru_cpus: 24,25,26,27,28,29                                 # Optional TEXT. Sets the number of CPU cores used for the Radio Unit tasks. Supported: [1 - Number of available cores].
#     l1_dl_pinning: mask                            # Optional TEXT. Sets the policy used for assigning CPU cores to L1 downlink tasks.
#     l1_ul_pinning: mask                              # Optional TEXT. Sets the policy used for assigning CPU cores to L1 uplink tasks. 
#     l2_cell_pinning: mask                            # Optional TEXT. Sets the policy used for assigning CPU cores to L2 cell tasks.
#     low_priority_pinning: mask                        # Optional TEXT. Sets the policy used for assigning CPU cores to low priority tasks.
#     ru_pinning: mask                                 # Optional TEXT. Sets the policy used for assigning CPU cores to Radio Unity tasks.
#     isolated_cpus: 4,5,6,7,8,9,10                             # Optional TEXT. Sets the CPU core(s) isolated for the gNB application. Supported: [1, 2, 3 , ..., N].     

 threads: 
    upper_phy: 
     pdsch_processor_type: auto                    # Optional TEXT (auto). Sets the PDSCH processor type. Supported: [auto, generic, concurrent, lite].
     nof_pdsch_threads: 7                          # Optional UINT (4). Sets the number of threads used to encode PDSCH.
     nof_pusch_decoder_threads: 5                          # Optional UINT (1). Sets the number of threads used to encode PUSCH.
     nof_ul_threads: 3                           # Optional UINT (1). Sets the number of upprt PHY threads to proccess uplink.
     nof_dl_threads: 5                             # Optional UINT (1). Sets the number of upprt PHY threads to proccess downlink.  
    lower_phy:
      execution_profile: quad                            # Optional TEXT. Sets the lower physical layer executor profile. Supported: [single, dual, quad].
    ofh: 
      enable_dl_parallelization: 1                  # Optional BOOLEAN. Sets the Open Fronthaul downlink parallelization flag. Supported: [0, 1].

[ninjab3s]

Hello @IbrahimBabiker87 ,
the eal parameters you have listed are not necessary. Usually, we only use the lcores parameter. Can you verify that the RU is receiving data and radiating properly? Maybe you have a spectrum analyzer or a USRP that you can use.

[IbrahimBabiker87]

Hi @ninjab3s ,
The issue was related to PTP synch, The Cell is functioning fine now, However TCP performance didn't improve, moreover, The UL BLER is high " even with out dpdk" causing poor UL throughput although that MCS in UL 28.
UDP is showing very good results hitting aximum of 1.5
TCP

Connecting to host 10.45.0.1, port 5210
Reverse mode, remote host 10.45.0.1 is sending
[  5] local 10.45.0.10 port 44069 connected to 10.45.0.1 port 5210
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  2.04 MBytes  17.1 Mbits/sec                  
[  5]   1.00-2.00   sec  6.27 MBytes  52.6 Mbits/sec                  
[  5]   2.00-3.00   sec  5.98 MBytes  50.2 Mbits/sec                  
[  5]   3.00-4.00   sec  7.06 MBytes  59.2 Mbits/sec                  
[  5]   4.00-5.00   sec  8.23 MBytes  69.0 Mbits/sec                  
[  5]   5.00-6.00   sec  8.62 MBytes  72.3 Mbits/sec                  
[  5]   6.00-7.00   sec  8.20 MBytes  68.7 Mbits/sec                  
[  5]   7.00-8.00   sec  8.79 MBytes  73.7 Mbits/sec                  
[  5]   8.00-9.00   sec  9.21 MBytes  77.2 Mbits/sec                  
[  5]   9.00-10.00  sec  9.40 MBytes  78.8 Mbits/sec                  
[  5]  10.00-11.00  sec  9.48 MBytes  79.5 Mbits/sec                  
[  5]  11.00-12.00  sec  9.44 MBytes  79.2 Mbits/sec                  
[  5]  12.00-13.00  sec  10.5 MBytes  87.7 Mbits/sec                  
[  5]  13.00-14.00  sec  9.54 MBytes  80.1 Mbits/sec                  
[  5]  14.00-15.00  sec  10.8 MBytes  90.8 Mbits/sec                  
[  5]  15.00-16.00  sec  8.62 MBytes  72.3 Mbits/sec                  
[  5]  16.00-17.00  sec  10.1 MBytes  84.4 Mbits/sec                  
[  5]  17.00-18.00  sec  6.60 MBytes  55.4 Mbits/sec                  
[  5]  18.00-19.00  sec  8.63 MBytes  72.4 Mbits/sec                  
[  5]  19.00-20.00  sec  9.05 MBytes  76.0 Mbits/sec                  
[  5]  20.00-21.00  sec  9.44 MBytes  79.2 Mbits/sec                  
[  5]  21.00-22.00  sec  9.36 MBytes  78.5 Mbits/sec                  
[  5]  22.00-23.00  sec  9.25 MBytes  77.6 Mbits/sec                  
[  5]  23.00-24.00  sec  7.12 MBytes  59.7 Mbits/sec                  
[  5]  24.00-25.00  sec  7.43 MBytes  62.3 Mbits/sec                  
[  5]  25.00-26.00  sec  8.49 MBytes  71.2 Mbits/sec                  
[  5]  26.00-27.00  sec  8.90 MBytes  74.6 Mbits/sec                  
[  5]  27.00-28.00  sec  9.56 MBytes  80.2 Mbits/sec                  
[  5]  28.00-29.00  sec  9.57 MBytes  80.3 Mbits/sec                  
[  5]  29.00-30.00  sec  10.1 MBytes  84.4 Mbits/sec                  
[  5]  30.00-31.00  sec  9.94 MBytes  83.4 Mbits/sec                  
[  5]  31.00-32.00  sec  8.99 MBytes  75.4 Mbits/sec                  
[  5]  32.00-33.00  sec  9.84 MBytes  82.5 Mbits/sec                  
[  5]  33.00-34.00  sec  10.3 MBytes  86.1 Mbits/sec                  
[  5]  34.00-35.00  sec  11.0 MBytes  92.1 Mbits/sec                  
[  5]  35.00-36.00  sec  11.2 MBytes  94.0 Mbits/sec                  
[  5]  36.00-37.00  sec  7.28 MBytes  61.1 Mbits/sec                  
[  5]  37.00-38.00  sec  6.28 MBytes  52.7 Mbits/sec                  
[  5]  38.00-39.00  sec  7.05 MBytes  59.1 Mbits/sec                  
^C[  5]  39.00-39.45  sec  3.49 MBytes  64.6 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-39.45  sec  0.00 Bytes  0.00 bits/sec                  sender
[  5]   0.00-39.45  sec   341 MBytes  72.5 Mbits/sec                  receiver
iperf3: interrupt - the client has terminated

UDP

Connecting to host 10.45.0.1, port 5210
Reverse mode, remote host 10.45.0.1 is sending
[  5] local 10.45.0.10 port 48908 connected to 10.45.0.1 port 5210
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-1.00   sec   150 MBytes  1.26 Gbits/sec  0.002 ms  77585/194552 (40%)  
[  5]   1.00-2.00   sec  86.0 MBytes   721 Mbits/sec  0.006 ms  83195/150078 (55%)  
[  5]   2.00-3.00   sec   104 MBytes   870 Mbits/sec  0.009 ms  70525/151169 (47%)  
[  5]   3.00-4.00   sec   123 MBytes  1.03 Gbits/sec  0.152 ms  50856/146401 (35%)  
[  5]   4.00-5.00   sec   138 MBytes  1.15 Gbits/sec  0.007 ms  33444/140469 (24%)  
[  5]   5.00-6.00   sec   137 MBytes  1.15 Gbits/sec  0.021 ms  46155/152408 (30%)  
[  5]   6.00-7.00   sec   160 MBytes  1.34 Gbits/sec  0.006 ms  28987/153634 (19%)  
[  5]   7.00-8.00   sec   160 MBytes  1.34 Gbits/sec  0.007 ms  18216/142860 (13%)  
[  5]   8.00-9.00   sec   166 MBytes  1.40 Gbits/sec  0.007 ms  20911/150312 (14%)  
[  5]   9.00-10.00  sec   167 MBytes  1.40 Gbits/sec  0.022 ms  20629/150372 (14%)  
[  5]  10.00-11.00  sec   163 MBytes  1.37 Gbits/sec  0.015 ms  20699/147342 (14%)  
[  5]  11.00-12.00  sec   166 MBytes  1.39 Gbits/sec  0.007 ms  19007/148329 (13%)  
[  5]  12.00-13.00  sec   162 MBytes  1.36 Gbits/sec  0.010 ms  22014/147678 (15%)  
[  5]  13.00-14.00  sec   159 MBytes  1.33 Gbits/sec  0.006 ms  20995/144734 (15%)  
[  5]  14.00-15.00  sec   163 MBytes  1.37 Gbits/sec  0.006 ms  21123/147782 (14%)  
[  5]  15.00-16.00  sec   170 MBytes  1.43 Gbits/sec  0.008 ms  21177/153637 (14%)  
[  5]  16.00-17.00  sec   162 MBytes  1.36 Gbits/sec  0.006 ms  19452/145777 (13%)  
[  5]  17.00-18.00  sec   158 MBytes  1.33 Gbits/sec  0.008 ms  22493/145480 (15%)  
[  5]  18.00-19.00  sec   166 MBytes  1.39 Gbits/sec  0.006 ms  28203/157470 (18%)  
[  5]  19.00-20.00  sec   158 MBytes  1.33 Gbits/sec  0.005 ms  21833/145101 (15%)  
[  5]  20.00-21.00  sec   159 MBytes  1.34 Gbits/sec  0.005 ms  20048/143882 (14%)  
[  5]  21.00-22.00  sec   165 MBytes  1.39 Gbits/sec  0.041 ms  22611/151259 (15%)  
[  5]  22.00-23.00  sec   164 MBytes  1.38 Gbits/sec  0.044 ms  17554/145115 (12%)  
[  5]  23.00-24.00  sec   171 MBytes  1.44 Gbits/sec  0.010 ms  18732/151812 (12%)  
[  5]  24.00-25.00  sec   170 MBytes  1.43 Gbits/sec  0.005 ms  17057/149597 (11%)  
[  5]  25.00-26.00  sec   155 MBytes  1.30 Gbits/sec  0.009 ms  20490/141077 (15%)  
[  5]  26.00-27.00  sec   168 MBytes  1.41 Gbits/sec  0.006 ms  23641/154007 (15%)  
[  5]  27.00-28.00  sec   177 MBytes  1.49 Gbits/sec  0.017 ms  16628/154555 (11%)  
[  5]  28.00-29.00  sec   155 MBytes  1.30 Gbits/sec  0.017 ms  20213/140652 (14%)  
[  5]  29.00-30.00  sec   168 MBytes  1.41 Gbits/sec  0.008 ms  19151/149889 (13%)  
[  5]  30.00-31.00  sec   161 MBytes  1.35 Gbits/sec  0.007 ms  19637/144960 (14%)  
[  5]  31.00-32.00  sec   174 MBytes  1.46 Gbits/sec  0.018 ms  18018/153071 (12%)  
[  5]  32.00-33.00  sec   159 MBytes  1.33 Gbits/sec  0.052 ms  18480/142265 (13%)  
[  5]  33.00-34.00  sec   171 MBytes  1.43 Gbits/sec  0.008 ms  21405/154067 (14%)  
[  5]  34.00-35.00  sec   162 MBytes  1.36 Gbits/sec  0.006 ms  18792/144580 (13%)  
[  5]  35.00-36.00  sec   176 MBytes  1.48 Gbits/sec  0.024 ms  16915/153969 (11%)  
[  5]  36.00-37.00  sec   156 MBytes  1.31 Gbits/sec  0.033 ms  24596/145760 (17%)  
[  5]  37.00-38.00  sec   166 MBytes  1.39 Gbits/sec  0.007 ms  22151/150998 (15%)  
[  5]  38.00-39.00  sec   164 MBytes  1.38 Gbits/sec  0.007 ms  18942/146701 (13%)  
[  5]  39.00-40.00  sec   164 MBytes  1.38 Gbits/sec  0.038 ms  19328/146956 (13%)  
[  5]  40.00-41.00  sec   165 MBytes  1.39 Gbits/sec  0.005 ms  21291/149840 (14%)  
[  5]  41.00-42.00  sec   160 MBytes  1.34 Gbits/sec  0.014 ms  20134/144411 (14%)  
[  5]  42.00-43.00  sec   168 MBytes  1.41 Gbits/sec  0.023 ms  21480/152199 (14%)  
[  5]  43.00-44.00  sec   165 MBytes  1.39 Gbits/sec  0.005 ms  17289/145909 (12%)  
[  5]  44.00-45.00  sec   165 MBytes  1.38 Gbits/sec  0.008 ms  19433/147744 (13%)  
[  5]  45.00-46.00  sec   166 MBytes  1.39 Gbits/sec  0.006 ms  18327/147418 (12%)  
[  5]  46.00-47.00  sec   161 MBytes  1.35 Gbits/sec  0.036 ms  25710/150637 (17%)  
[  5]  47.00-48.00  sec   168 MBytes  1.41 Gbits/sec  0.007 ms  20091/151082 (13%)  
[  5]  48.00-49.00  sec   164 MBytes  1.38 Gbits/sec  0.005 ms  20838/148412 (14%)  
[  5]  49.00-50.00  sec   166 MBytes  1.39 Gbits/sec  0.007 ms  16377/145243 (11%)  
[  5]  50.00-51.00  sec   165 MBytes  1.38 Gbits/sec  0.030 ms  20030/148128 (14%)  
[  5]  51.00-52.00  sec   161 MBytes  1.35 Gbits/sec  0.007 ms  20308/145478 (14%)  
[  5]  52.00-53.00  sec   167 MBytes  1.40 Gbits/sec  0.052 ms  24581/154799 (16%)  
[  5]  53.00-54.00  sec   168 MBytes  1.41 Gbits/sec  0.006 ms  18177/148880 (12%)  
[  5]  54.00-55.00  sec   153 MBytes  1.28 Gbits/sec  0.008 ms  22238/141243 (16%)  
[  5]  55.00-56.00  sec   168 MBytes  1.41 Gbits/sec  0.006 ms  25002/155995 (16%)  
[  5]  56.00-57.00  sec   163 MBytes  1.37 Gbits/sec  0.005 ms  20222/146849 (14%)  
[  5]  57.00-58.00  sec   156 MBytes  1.31 Gbits/sec  0.036 ms  24485/145763 (17%)  
^C[  5]  58.00-58.37  sec  67.1 MBytes  1.53 Gbits/sec  0.005 ms  6552/58741 (11%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
[  5]   0.00-58.37  sec  0.00 Bytes  0.00 bits/sec  0.000 ms  0/0 (0%)  sender
[  5]   0.00-58.37  sec  9.12 GBytes  1.34 Gbits/sec  0.005 ms  1444453/8709528 (17%)  receiver
iperf3: interrupt - the client has terminated

[ninjab3s]

Please increase the TCP buffers of the interfaces connected to RU and core. Also make sure that you are running latest code.

sudo ethtool -G <interface> tx 2047 rx 2047

[ismagom]

Hi @IbrahimBabiker87, I see you have closed the issue. Could you share what fixed it and which results you saw?

Thanks

[IbrahimBabiker87]

@ismagom
Thank you for your feedback, The Issue is still There TCP throughput is degraded

[andrepuschmann]

@IbrahimBabiker87 The best way to debug this is to run with gdb, set a breakpoint on the assert and run until it hits the bp. Then share the backtrace.

[IbrahimBabiker87]

@ninjab3s @ismagom ,

for the DPDK setup, How to run ptp4l and phc2sys while the NIC interface is bind to DPDK to assure that the DU machine is PTP synchronized. as for now the DU synchronization is not reliable " works occasionally ".
I have been connecting the PTP switch to other interface with in the DU machine to get synch " and it doesnt work all the time" while DPDK bind to the interface which connected to the RU Through PTP switch.
Do you have reliable way to keep the PTP synch for the DU machine while using DPDK ??

[ninjab3s]

You have two options, sharing the interface via SR-IOV by creating a Virtual Function. This approach works for low band width, for higher bandwidths you need to make sure that the PTP packets are prioritized in case the interface gets saturated by traffic. You can use TSN for this. We are currently testing this so I cannot provide complete instructions yet. Ill update you here once we have this running.

The other solution is using a second interface. I dont really understand your issue here. Can you give me more details whats actually failing when using the second interface?

[IbrahimBabiker87]

Hi @ninjab3s ,

I'm using a second interface already, so far its working find I was asking if its a proper way to work with DPDK and since its approved by you I will continue this way.

[IbrahimBabiker87]

Hello @ninjab3s @ismagom
with new build and DPDK,
srsRAN 5G gNB version 23.10.1 (dcd905c)

Inititiating TCP test will always yield in RRC Drop with cause Cause: 100 consecutive CRC KOs.

2023-12-28T11:35:33.470651 [UL-PHY  ] [I] [  298.19] PUSCH: rnti=0x4601 h_id=1 prb=[4, 271) symb=[0, 14) mod=QPSK rv=0 tbs=1026 crc=KO iter=10.0 sinr=-33.1dB t=513.0us uci_t=0.0us ret_t=144.5us
2023-12-28T11:35:33.470652 [MAC     ] [I] [   299.6] ue=0: RLF detected. Cause: 100 consecutive CRC KOs.
2023-12-28T11:35:33.470658 [DU-MNG  ] [I] ue=0: RLF detected with cause="MAC max KOs reached". Timer of 4000 msec to release UE started...
2023-12-28T11:35:33.470950 [OFH     ] [I] Dropped received Open Fronthaul message as no uplink PRACH context was found for slot '43.1' and eAxC '4'
2023-12-28T11:35:33.470987 [OFH     ] [I] Dropped received Open Fronthaul message as no uplink PRACH context was found for slot '43.1' and eAxC '5'

Attached are the logs:

gnb_mac.zip
gnb.zip