scrambled text / pixels, sometimes

[tilchl]

I got this peculiar error, that most of the time I start the MCU the text is scrambled. But sometimes it isn't
This seems to affect fonts and also some draw methods of TFT_eSPI.
The pictures below show text being written and a Wi-Fi symbol being drawn, once with smoothArc and one by my older custom implementation. My method of drawing the symbol seems to be unaffected by the error.

I have tried different SPI frequencies without any luck.

The Display is a kmrtm28028-spi with the ILI9341 hooked up to an ESP32

This is my setup.h

#define USER_SETUP_INFO "User_Setup"
#define ILI9341_2_DRIVER
#define TFT_HEIGHT 320
#define TFT_MISO 19
#define TFT_MOSI 23
#define TFT_SCLK 18
#define TFT_CS   15
#define TFT_DC    2
#define TFT_RST   4
#define LOAD_FONT2
#define LOAD_FONT4
#define SPI_FREQUENCY  40000000

This is my constructor

Display::Display()
{
    tft.init();
    tft.setRotation(rotation);

    tft.setTextSize(1);
    tft.setTextWrap(false);
    tft.fillScreen(TFT_BLACK);

    tft.setSwapBytes(true);
    tft.setTextDatum(6);
    tft.fillScreen(TFT_BLACK);
}

This is how it's supposed to look. 1/10 times I reboot the ESP32

Sometimes the first "row" of pixels is scrambled

Sometimes everything is scrambled

[tilchl]

Tried a different display with the same controller.
Same result