KIbana error 500 - Data too large

[3isenHeiM]

I've a distributred architecture :

• virtual manager (16Go memory, ES heap at 10G)
• 2 search nodes (1Tb memory, ES heap at 25G)

I regularly have errors 500 in when listing alerts:

[2023-01-27T15:10:26.734+00:00][WARN ][plugins.monitoring.monitoring.kibana-monitoring] ResponseError: circuit_breaking_exception: [circuit_breaking_exception] Reason: [parent] Data too large, data for [<http_request>] would be [10222000972/9.5gb], which is larger than the limit of [10200547328/9.5gb], real usage: [10221996576/9.5gb], new bytes reserved: [4396/4.2kb], usages [eql_sequence=0/0b, fielddata=3567/3.4kb, request=0/0b, inflight_requests=12668/12.3kb, model_inference=0/0b]
    at KibanaTransport.request (/usr/share/kibana/node_modules/@elastic/transport/lib/Transport.js:476:27)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at KibanaTransport.request (/usr/share/kibana/node_modules/@kbn/core-elasticsearch-client-server-internal/target_node/create_transport.js:58:16)
    at Monitoring.bulk (/usr/share/kibana/node_modules/@elastic/elasticsearch/lib/api/api/monitoring.js:53:16)
    at sendBulkPayload (/usr/share/kibana/x-pack/plugins/monitoring/server/kibana_monitoring/lib/send_bulk_payload.js:21:10)
    at BulkUploader._onPayload (/usr/share/kibana/x-pack/plugins/monitoring/server/kibana_monitoring/bulk_uploader.js:187:12)
    at BulkUploader._fetchAndUpload (/usr/share/kibana/x-pack/plugins/monitoring/server/kibana_monitoring/bulk_uploader.js:173:9)
[2023-01-27T15:10:26.735+00:00][WARN ][plugins.monitoring.monitoring.kibana-monitoring] Unable to bulk upload the stats payload to the local cluster
[2023-01-27T15:10:26.736+00:00][ERROR][plugins.taskManager] Failed to poll for work: [parent] Data too large, data for [<http_request>] would be [10222007284/9.5gb], which is larger than the limit of [10200547328/9.5gb], real usage: [10221996576/9.5gb], new bytes reserved: [10708/10.4kb], usages [eql_sequence=0/0b, fielddata=3567/3.4kb, request=0/0b, inflight_requests=18980/18.5kb, model_inference=0/0b]

The data is too large for the heap. I'm viewing alerts for the last 24h.

What are my options ? Increasing the memory and the heap ?

Looking at the other discussions on the topic, I feat that this is a never-ending loop :
data too larger => increase heap => data volume increases too => data too large => increase heap

[cm-ops]

How many open indices/shards do you have?

[3isenHeiM]

180 shards and 153 open indices.

health status index                         uuid                   pri rep docs.count docs.deleted store.size pri.store.size
green  open   elastalert_status             kPOuyaprRlK1AbAftnlIDg   1   0  107476769            0     77.5gb         77.5gb
green  open   elastalert_status_error       MxYO_yzZRUSyIJ2BXajj5A   1   0     514986            0    288.5mb        288.5mb
green  open   elastalert_status_past        cQUi1fwkRFOdpII3Vd6Ygw   1   0          0            0       225b           225b
green  open   elastalert_status_silence     PnYZdQzSTDKlTdTJ4ySINg   1   0          0            0       225b           225b
green  open   elastalert_status_status      ome16Q5sSjmbwzRwGbNEbw   1   0   95787408            0     13.8gb         13.8gb
green  open   so-case                       TwWeW8r7SFia4E6Um7g-ew   1   0         44            6     26.7mb         26.7mb
green  open   so-casehistory                Z5gEiWJHTIqZak1a2J_GqA   1   0         84            0     26.7mb         26.7mb
green  open   so-playbook-alerts-2022.09.01 J3E2MtRMTnaLq8Fw5ynn7Q   1   0     321688            0      378mb          378mb
green  open   so-playbook-alerts-2022.09.02 3S87hyFdTG6tI1ASgdu7lg   1   0     246164            0    317.3mb        317.3mb
green  open   so-playbook-alerts-2022.09.03 PBhm8SSASr-uKHp8KcbEbQ   1   0      44438            0    130.4mb        130.4mb
green  open   so-playbook-alerts-2022.09.04 Umk8RtQ6Rlmr_CR0UliiwA   1   0      10626            0       35mb           35mb
green  open   so-playbook-alerts-2022.09.05 DkjBd2F5Sj-5kw-mChMVdg   1   0     698925            0    937.9mb        937.9mb
green  open   so-playbook-alerts-2022.09.06 zhISqKOERZGnVpCFmxAVRA   1   0      15102            0     36.6mb         36.6mb
green  open   so-playbook-alerts-2022.09.07 aLHsBzToR_mbrTXvNMczqA   1   0     627437            0    813.2mb        813.2mb
green  open   so-playbook-alerts-2022.09.08 XRMI--v2Qj-WIHFt1HPyvg   1   0     781572            0   1011.1mb       1011.1mb
green  open   so-playbook-alerts-2022.09.09 ZfS4EobGT6GxzewG26Q4Rg   1   0     162438            0    235.6mb        235.6mb
green  open   so-playbook-alerts-2022.09.10 q6XNdH6JQ9ij-az0ti9KFQ   1   0      82023            0    156.9mb        156.9mb
green  open   so-playbook-alerts-2022.09.11 o983FDw9TdKSd5QHTfLT_w   1   0      41887            0     91.4mb         91.4mb
green  open   so-playbook-alerts-2022.09.12 Yie1aPGDSuGiQnnYMKow8A   1   0     313904            0    373.7mb        373.7mb
green  open   so-playbook-alerts-2022.09.13 ppJAdjIHRIG_rpgMNc-4Tw   1   0     202019            0    268.9mb        268.9mb
green  open   so-playbook-alerts-2022.09.14 b7N773jQRheNJ5jyxqLGNA   1   0     198281            0    352.3mb        352.3mb
green  open   so-playbook-alerts-2022.09.15 bZWXPLUzRZm8QPq_qeSBTQ   1   0    2686245            0      3.3gb          3.3gb
green  open   so-playbook-alerts-2022.09.16 9o3m-x-cQFiaqVO8Td2dmg   1   0    2592300            0      3.3gb          3.3gb
green  open   so-playbook-alerts-2022.09.17 YhwpounZTg2YCieBtw5suw   1   0    2328542            0      2.6gb          2.6gb
green  open   so-playbook-alerts-2022.09.18 9yjOoiHrReqiTqaKkUto1A   1   0     105285            0    220.2mb        220.2mb
green  open   so-playbook-alerts-2022.09.19 40KEtTfJR7CQ1uETs20xpA   1   0    2448899            0      2.9gb          2.9gb
green  open   so-playbook-alerts-2022.09.20 glUY0AoMQS-3EopRQOCCtA   1   0    2405810            0      2.9gb          2.9gb
green  open   so-playbook-alerts-2022.09.21 knb_zo9zS92Z9Mhqzv3k6Q   1   0    2495036            0      3.2gb          3.2gb
green  open   so-playbook-alerts-2022.09.22 1p_jlj7cSDiycJ3REcFNTw   1   0    2588163            0      3.5gb          3.5gb
green  open   so-playbook-alerts-2022.09.23 qEJmBH11Qo2fwPtRq3aKHw   1   0    2337940            0      2.8gb          2.8gb
green  open   so-playbook-alerts-2022.09.24 JtilsLgXQ2me9LO9Kkzpzg   1   0    2429845            0      2.9gb          2.9gb
green  open   so-playbook-alerts-2022.09.25 uI0NELR8Rge4pI3ycvf3AQ   1   0    2416491            0        3gb            3gb
green  open   so-playbook-alerts-2022.09.26 lPuykfh4T9GOXoFsJbqtCw   1   0    2581199            0      3.7gb          3.7gb
green  open   so-playbook-alerts-2022.09.27 ibkJOqVITDC-Cmro4ZgZzQ   1   0    2502776            0      3.4gb          3.4gb
green  open   so-playbook-alerts-2022.09.28 YDdlu_IRSjK51BDwk8Ucmg   1   0    2252164            0      2.6gb          2.6gb
green  open   so-playbook-alerts-2022.09.29 TyDrNNyIQfC8lun4izXCsA   1   0    2423017            0        3gb            3gb
green  open   so-playbook-alerts-2022.09.30 0Mue_4zMQg-B-6FuWh9oZw   1   0    2149113            0      2.4gb          2.4gb
green  open   so-playbook-alerts-2022.10.01 GKuxELWOQ0WS76sn-_57qQ   1   0    2406530            0      2.8gb          2.8gb
green  open   so-playbook-alerts-2022.10.02 JYn3YYi-QuKF7RzXRnv2rA   1   0    2413954            0        3gb            3gb
green  open   so-playbook-alerts-2022.10.03 PfaMbPLfSfGjfNBAG3fC1w   1   0    2316289            0      2.5gb          2.5gb
green  open   so-playbook-alerts-2022.10.04 OmXxD0MCTwmGlf50LP85bA   1   0    2518071            0        3gb            3gb
green  open   so-playbook-alerts-2022.10.05 bTghX1rBTkmHlr_6URbhLQ   1   0    2505742            0      3.1gb          3.1gb
green  open   so-playbook-alerts-2022.10.06 l-ZBf3-sRmK-CqFhms4w3Q   1   0    2327677            0      2.7gb          2.7gb
green  open   so-playbook-alerts-2022.10.07 BJJCUEHzS5GrYgJYsqdWBQ   1   0    2434944            0      2.9gb          2.9gb
green  open   so-playbook-alerts-2022.10.08 3PnVDbiMTcSyg0uaxE2NHQ   1   0    2451265            0      2.8gb          2.8gb
green  open   so-playbook-alerts-2022.10.09 FyMcLyzhSnqjdQ75MbjcLA   1   0    2443163            0      2.9gb          2.9gb
green  open   so-playbook-alerts-2022.10.10 EhHr3fg1S06abA89KjGElg   1   0    2509899            0        3gb            3gb
green  open   so-playbook-alerts-2022.10.11 yyBY4O4pRdeMK1s_eaJmKQ   1   0    2520956            0        3gb            3gb
green  open   so-playbook-alerts-2022.10.12 _5A3rWftTfaafO1-KD6Kvg   1   0    2445959            0      2.8gb          2.8gb
green  open   so-playbook-alerts-2022.10.13 jRImRHA7To-s4zxDGCFHZg   1   0    2340952            0      2.9gb          2.9gb
green  open   so-playbook-alerts-2022.10.14 Gy9AVVDgTciBmuD7cpiqIw   1   0    1976291            0      2.1gb          2.1gb
green  open   so-playbook-alerts-2022.10.15 KOwx_j5HScS__cFMUh_Iaw   1   0    2326483            0      2.6gb          2.6gb
green  open   so-playbook-alerts-2022.10.16 OFgLofOOQ2Sx_11spuHa6A   1   0    2313902            0      2.6gb          2.6gb
green  open   so-playbook-alerts-2022.10.17 ZX8gL_OcR4mMzlKx1i16BQ   1   0    2395662            0      2.8gb          2.8gb
green  open   so-playbook-alerts-2022.10.18 dj7-wYHsRVqkCDyUvH7A7Q   1   0    2562169            0      3.1gb          3.1gb
green  open   so-playbook-alerts-2022.10.19 A-2PG7fkQMOI1tHWKGI0YA   1   0    2375117            0      2.8gb          2.8gb
green  open   so-playbook-alerts-2022.10.20 gAQfKwXrRR2Rb2X9_9FTIQ   1   0    2345945            0      2.7gb          2.7gb
green  open   so-playbook-alerts-2022.10.21 LaUI3BpTT1K1H0KtQYkv_A   1   0    2321791            0      2.8gb          2.8gb
green  open   so-playbook-alerts-2022.10.22 v0cI0FLKRKOg_691KLrK1w   1   0    2277633            0      2.5gb          2.5gb
green  open   so-playbook-alerts-2022.10.23 AGWbK-hpTLig5p-y2bDEnQ   1   0    2328810            0      2.5gb          2.5gb
green  open   so-playbook-alerts-2022.10.24 UazTbCgTTOyTe7kVDHq9Aw   1   0    1331215            0      1.6gb          1.6gb
green  open   so-playbook-alerts-2022.10.25 BPM-dYyBRfavW8sYg1MfGg   1   0    1222214            0      1.4gb          1.4gb
green  open   so-playbook-alerts-2022.10.26 p6IcxmLuTBSbP2HKuVobHQ   1   0    2179635            0      2.6gb          2.6gb
green  open   so-playbook-alerts-2022.10.27 -0gPKRZnTbGjxzZ9ibgAMA   1   0    2238751            0      2.6gb          2.6gb
green  open   so-playbook-alerts-2022.10.28 aP8MRLUTThOzYv2WCH9sXQ   1   0    1865841            0      2.3gb          2.3gb
green  open   so-playbook-alerts-2022.10.29 ycOHvhDfQCyri5ZM80ujLg   1   0      74848            0    131.8mb        131.8mb
green  open   so-playbook-alerts-2022.10.30 mKpIobYlRzO-BPZjNnQPfg   1   0    2480757            0      2.9gb          2.9gb
green  open   so-playbook-alerts-2022.10.31 2oqS3WNTRSifkdkbD3h4oA   1   0    2496780            0      3.1gb          3.1gb
green  open   so-playbook-alerts-2022.11.01 R017MKRESUuO0p3ZJUKOtQ   1   0    1105804            0      1.3gb          1.3gb
green  open   so-playbook-alerts-2022.11.02 mtTjeR8cTP25wVg2wu2xfA   1   0       7599           21     19.3mb         19.3mb
green  open   so-playbook-alerts-2022.11.03 rS6pNXpxSZ6oOIqNZlQcgQ   1   0     451669           46    526.1mb        526.1mb
green  open   so-playbook-alerts-2022.11.04 uvUtBp1pR3SAVAuO9FY_uw   1   0    1725102            0      1.9gb          1.9gb
green  open   so-playbook-alerts-2022.11.05 7cxI4SE4R3usoB5-c_FROg   1   0    1992591            0      2.3gb          2.3gb
green  open   so-playbook-alerts-2022.11.06 OAhQbyKJSxePMnLBWoFnbw   1   0    1146439            0      1.5gb          1.5gb
green  open   so-playbook-alerts-2022.11.07 kVXeAMWuR_GRvHQOV74MqQ   1   0      27515            0     33.4mb         33.4mb
green  open   so-playbook-alerts-2022.11.08 mxHXp8jCQbW_c-pKEdo4qA   1   0     960569        14656        1gb            1gb
green  open   so-playbook-alerts-2022.11.09 t9maEmgbRy-h9Wc4s1fFog   1   0    1373427            0      1.5gb          1.5gb
green  open   so-playbook-alerts-2022.11.10 Pqwa6qGSQoquxd0BjbayMQ   1   0      12216            0     22.2mb         22.2mb
green  open   so-playbook-alerts-2022.11.11 Y0-olUEkRZuzYtofx_XZbA   1   0       9351            0     23.7mb         23.7mb
green  open   so-playbook-alerts-2022.11.12 wB_EjpzKTFydaNjNTCkskw   1   0      13051            0     33.9mb         33.9mb
green  open   so-playbook-alerts-2022.11.13 N9Mn-LdkSdug5LI0tymdoA   1   0      10163            0       29mb           29mb
green  open   so-playbook-alerts-2022.11.14 qpAQRo61TBCfm-pRz3cQgg   1   0      15821            0     31.6mb         31.6mb
green  open   so-playbook-alerts-2022.11.15 Fh2E8q0MSSWED7pHEf6Y_Q   1   0      21318            0       51mb           51mb
green  open   so-playbook-alerts-2022.11.16 MGx5F9R3ST--pvPgqMOVgQ   1   0      21672            1     56.1mb         56.1mb
green  open   so-playbook-alerts-2022.11.17 G1yhiACDQGm9nn3WHX43oQ   1   0      24132           56     64.9mb         64.9mb
green  open   so-playbook-alerts-2022.11.18 Csexq-5NRXSIP1BhV38TrA   1   0      14392            0     29.7mb         29.7mb
green  open   so-playbook-alerts-2022.11.19 -v84xc4wQl2eUpImnVsS2A   1   0      13201           32     25.5mb         25.5mb
green  open   so-playbook-alerts-2022.11.20 1WAVKK2PSvWsS62cujpuJw   1   0       8700           51     19.1mb         19.1mb
green  open   so-playbook-alerts-2022.11.21 jKRjxnyjTsC-nZq_FwnsyQ   1   0      21028          108     49.8mb         49.8mb
green  open   so-playbook-alerts-2022.11.22 rICPAg7RRqaH8WlJMeJzqQ   1   0      20836           77     49.8mb         49.8mb
green  open   so-playbook-alerts-2022.11.23 Fpr8I5XKQhSlsqvqee-y7Q   1   0      21624          244     52.1mb         52.1mb
green  open   so-playbook-alerts-2022.11.24 J8mGraT7SSS7kkHQs8OsSA   1   0      13500          419     28.1mb         28.1mb
green  open   so-playbook-alerts-2022.11.25 hvtq1Ij6Rjm2wCclmyjP8g   1   0      21959          540     60.8mb         60.8mb
green  open   so-playbook-alerts-2022.11.26 CI02iVLXQ6mTnYVDeTc-TQ   1   0      14114          150     35.1mb         35.1mb
green  open   so-playbook-alerts-2022.11.27 i7xwhja5TMCn9iF48vvcYw   1   0      16926          211     38.7mb         38.7mb
green  open   so-playbook-alerts-2022.11.28 7ujffcadTlm3ZUhr14UWgQ   1   0      27045         8221     83.4mb         83.4mb
green  open   so-playbook-alerts-2022.11.29 ksbOzs0oQ0OXL0k1318Wfg   1   0      15299         4368     45.3mb         45.3mb
green  open   so-playbook-alerts-2022.11.30 YF5UbrniSEKZA9ev5giOMQ   1   0      27005         6574     74.2mb         74.2mb
green  open   so-playbook-alerts-2022.12.01 ypbUQaS_RnGU4YJdNZ4iWw   1   0      22866            0       50mb           50mb
green  open   so-playbook-alerts-2022.12.02 mE5hYrMhQOeJ3yrWW087nA   1   0      20969          193     50.9mb         50.9mb
green  open   so-playbook-alerts-2022.12.03 Gq8vy2w8QTi1EFE-xHzIhA   1   0      14744         1632     38.4mb         38.4mb
green  open   so-playbook-alerts-2022.12.04 XBBE9dG5SrC-09_pAeJKig   1   0       9254         4248     31.8mb         31.8mb
green  open   so-playbook-alerts-2022.12.05 1xA4IDO_S36pp7qmrY5raw   1   0      23598        10793     83.5mb         83.5mb
green  open   so-playbook-alerts-2022.12.06 hdTrKSZkTDWmclzZ3W4pDw   1   0      19959         5331     48.4mb         48.4mb
green  open   so-playbook-alerts-2022.12.07 rJkW6MBmTIiM8RuIbt3biA   1   0      32709         9098      111mb          111mb
green  open   so-playbook-alerts-2022.12.08 pSCyvMpxSQuEEjx3EBofaw   1   0      40636         1181     67.9mb         67.9mb
green  open   so-playbook-alerts-2022.12.09 3N9cg6SnSHql43SNISPIUQ   1   0     687718        90045      1.9gb          1.9gb
green  open   so-playbook-alerts-2022.12.10 7Bx9WmoGTymwZxRRACXLlw   1   0      21197          419     42.2mb         42.2mb
green  open   so-playbook-alerts-2022.12.11 cMLXQqrPQyysrA1qtOK2Fw   1   0      26135            0     76.7mb         76.7mb
green  open   so-playbook-alerts-2022.12.12 m8Akz38WRq2wwBQyTDy1cg   1   0      49765        12812     91.6mb         91.6mb
green  open   so-playbook-alerts-2022.12.13 01JpYOb3TbO6wu-pCz4XkQ   1   0      94179         1197    242.7mb        242.7mb
green  open   so-playbook-alerts-2022.12.14 MZn2n6lFQ0Gr69bI6t7KTg   1   0      32202            0       47mb           47mb
green  open   so-playbook-alerts-2022.12.15 y9eDRXjCQLeV7k3r9N6tsQ   1   0     102189         1055    261.6mb        261.6mb
green  open   so-playbook-alerts-2022.12.16 eJt0CEqqS3aHY3ch2q8Grw   1   0      42314            0     51.3mb         51.3mb
green  open   so-playbook-alerts-2022.12.17 euEpZ8dGSfK9zpGSBU62QQ   1   0      38476         3676    106.1mb        106.1mb
green  open   so-playbook-alerts-2022.12.18 ABMssoHqQ7WXVRpWVBtgew   1   0      30940         3693     96.6mb         96.6mb
green  open   so-playbook-alerts-2022.12.19 Q8RRVJs2Qv2umo8A1qPXLA   1   0      62795            0    137.6mb        137.6mb
green  open   so-playbook-alerts-2022.12.20 oRNXcIZLQC-QbehzbyIiUQ   1   0      94013          366    251.3mb        251.3mb
green  open   so-playbook-alerts-2022.12.21 E311mXDVRu2JR8m2bYUFdw   1   0      26039            0     39.3mb         39.3mb
green  open   so-playbook-alerts-2022.12.22 eCBQYHQoS_KYJ6H4VD4whw   1   0     106321            0    254.7mb        254.7mb
green  open   so-playbook-alerts-2022.12.23 3ahOioXDSlefNmIbrGucLQ   1   0     101193            0    237.9mb        237.9mb
green  open   so-playbook-alerts-2022.12.24 8en0610ERwmS6gYMApfrPw   1   0     133293            0    331.9mb        331.9mb
green  open   so-playbook-alerts-2022.12.25 lOSnsuT6TJqMwcKjdbJgvw   1   0      85164            0    136.6mb        136.6mb
green  open   so-playbook-alerts-2022.12.26 gF4na2ZQRESrt8__dG-A6g   1   0     184684            0      443mb          443mb
green  open   so-playbook-alerts-2022.12.27 vQSh6nprQZO9gA6qHyy90A   1   0      65271            0      103mb          103mb
green  open   so-playbook-alerts-2022.12.28 EKNT4deNQbCt6EaY12hIGA   1   0     111360            0    252.4mb        252.4mb
green  open   so-playbook-alerts-2022.12.29 vw6KFXEFS8O1moqvBvvANA   1   0     115579            0    214.3mb        214.3mb
green  open   so-playbook-alerts-2022.12.30 etRsYBx3SaSc1RrNZl_BFA   1   0     188144            0    385.8mb        385.8mb
green  open   so-playbook-alerts-2022.12.31 NjVz0WZWRzSPiKODpodi9w   1   0     110671            0    245.4mb        245.4mb
green  open   so-playbook-alerts-2023.01.01 uhKymFXhQm-Qi8AB1m_yVQ   1   0     118557            0    262.7mb        262.7mb
green  open   so-playbook-alerts-2023.01.02 _v7zE9y-RrmY-8SNt_Ahvw   1   0      74376            0    134.4mb        134.4mb
green  open   so-playbook-alerts-2023.01.03 aAYp23GuR2eSaXsQKXuwew   1   0     231260            0    462.1mb        462.1mb
green  open   so-playbook-alerts-2023.01.04 gBGNl_yrQpWzQuIDdwG3TA   1   0     320624            0    705.7mb        705.7mb
green  open   so-playbook-alerts-2023.01.05 hsEoMc-pRFWtzZOVDVx8BQ   1   0     398960         1225    951.3mb        951.3mb
green  open   so-playbook-alerts-2023.01.06 NH1-3vgvRhyUiKf63uehAA   1   0     348666         1241    847.5mb        847.5mb
green  open   so-playbook-alerts-2023.01.07 NAiEVjG7QmajYHAS9xc1ww   1   0      41488            0     54.4mb         54.4mb
green  open   so-playbook-alerts-2023.01.08 WL7lnW_rThyEjGzGvWjgjw   1   0     193773            0      400mb          400mb
green  open   so-playbook-alerts-2023.01.09 OlVB0KkSTw-ocUyO1zBKEA   1   0      26294            0     91.3mb         91.3mb
green  open   so-playbook-alerts-2023.01.10 CZE6_oxoTFihAplPPxo13w   1   0     116200            0      190mb          190mb
green  open   so-playbook-alerts-2023.01.11 vqS3TAMERpaVFfpITzwu8w   1   0     219037            0    395.2mb        395.2mb
green  open   so-playbook-alerts-2023.01.12 ikKwL6-fQ06cBVll-Xp13A   1   0     266224            0    490.9mb        490.9mb
green  open   so-playbook-alerts-2023.01.13 WFKkQ8zDQ4a7TQSFpBSp7Q   1   0     337846            0    761.2mb        761.2mb
green  open   so-playbook-alerts-2023.01.14 mhFCMtuRQFCZFjhNjZDv9A   1   0     324022            0    771.7mb        771.7mb
green  open   so-playbook-alerts-2023.01.15 6A6GpAEMQ2u4cgZTz8bL8w   1   0     276181            0    641.3mb        641.3mb
green  open   so-playbook-alerts-2023.01.16 hH-ncxW1TYO2xyrFLuobzQ   1   0     402975            0      979mb          979mb
green  open   so-playbook-alerts-2023.01.17 lSr3SigsQMWMNKg7xrxgrQ   1   0     420595            0   1004.3mb       1004.3mb
green  open   so-playbook-alerts-2023.01.18 1XdmQ4ybTo-nTwLDfTUTKQ   1   0     328826            0    562.4mb        562.4mb
green  open   so-playbook-alerts-2023.01.19 vZq3cV2ZSYSQYKh1keUx5Q   1   0    2020954            0      4.1gb          4.1gb
green  open   so-playbook-alerts-2023.01.20 xgZdL6XYRXeQM15kVb0zMw   1   0    1494712            0      2.9gb          2.9gb
green  open   so-playbook-alerts-2023.01.23 Q2SMFuD5QLKUjtNoy2oyrw   1   0    1253434            0        2gb            2gb
green  open   so-playbook-alerts-2023.01.24 ddH25xgfTS6w51Za6sD97g   1   0    3058226            0      5.6gb          5.6gb
green  open   so-playbook-alerts-2023.01.25 78ASN0KlSPGAo2VvcZOGww   1   0    3047523            0      5.2gb          5.2gb
green  open   so-playbook-alerts-2023.01.26 RDXOaSGdQpqPyDmQKu8UGQ   1   0    2763324            0      5.2gb          5.2gb
green  open   so-playbook-alerts-2023.01.27 5aJ-kfKLRkezsaZvPm_e7A   1   0    2651578            0      4.9gb          4.9gb
green  open   so-playbook-alerts-2023.01.28 3oFauRv0R1ydqaYJ5OrIvA   1   0    2952883            0      5.4gb          5.4gb
green  open   so-playbook-alerts-2023.01.29 rpfQAKJtSre38WiT0IrR6w   1   0    2762108            0        5gb            5gb
green  open   so-playbook-alerts-2023.01.30 7uMs3nPWSKa2NewUAvWI7Q   1   0    1857737            0      3.4gb          3.4gb

[cm-ops]

How may open on the search nodes as well? If you are not routinely searching data back past a certain timeframe, you can close the older ones to increase performance.