Use Rich Loghandler in combination with other handlers

[xmatthias]

I'd like to use RichHandler for output of log messages.
However, i also need to use different handlers (like the RotatingFileHandler) to log data to disk.

So far, i've been using a regular StreamHandler - which looks pretty OK with the logformat selected - and the same format works fine for both screen and file logging.

i think understand how rich want's me to configure the format - but using the "rich" desired format breaks file output, while using the "file-output-compatible" format will break how rich looks (or rather - duplicate all information in rich).

import logging
from rich.progress import track
from rich.console import Console
from rich.logging import RichHandler
import time

from logging.handlers import  RotatingFileHandler
LOGFORMAT = '%(asctime)s - %(name)s - %(levelname)s - %(message)s'
LOGFORMAT_RICH = '%(message)s'

error_console = Console(stderr=True)

logging.basicConfig(
    level=logging.INFO,
    # format=LOGFORMAT, 
    format=LOGFORMAT_RICH,
    handlers=[
        # logging.StreamHandler(sys.stderr),
        RichHandler(console=error_console),
        RotatingFileHandler('xxx.log',
                            maxBytes=1024 * 1024 * 10,  # 10Mb
                            backupCount=10)
    ]
    )
log = logging.getLogger('somefancyname')
for n in range(5)   :
    log.info(f"logging .. {n}")
    time.sleep(0.2)

# Output using the specified Logformat and StreamHandler
2021-10-13 20:22:55,002 - somefancyname - INFO - logging .. 0
2021-10-13 20:22:55,203 - somefancyname - INFO - logging .. 1
2021-10-13 20:22:55,403 - somefancyname - INFO - logging .. 2
2021-10-13 20:22:55,604 - somefancyname - INFO - logging .. 3
2021-10-13 20:22:55,804 - somefancyname - INFO - logging .. 4

# Output using RIch with specified logformat (notice that most information is now duplicated)
[10/13/21 20:23:41] INFO     2021-10-13 20:23:41,263 - somefancyname - INFO - logging .. 0                              rich_tests.py:27
                    INFO     2021-10-13 20:23:41,468 - somefancyname - INFO - logging .. 1                              rich_tests.py:27
                    INFO     2021-10-13 20:23:41,672 - somefancyname - INFO - logging .. 2                              rich_tests.py:27
                    INFO     2021-10-13 20:23:41,874 - somefancyname - INFO - logging .. 3                              rich_tests.py:27
[10/13/21 20:23:42] INFO     2021-10-13 20:23:42,077 - somefancyname - INFO - logging .. 4                              rich_tests.py:27

# Output with rich_handler and LOGFORMAT_RICH (this is how it should look like)

[10/13/21 20:24:38] INFO     logging .. 0                                                                               rich_tests.py:29
                    INFO     logging .. 1                                                                               rich_tests.py:29
[10/13/21 20:24:39] INFO     logging .. 2                                                                               rich_tests.py:29
                    INFO     logging .. 3                                                                               rich_tests.py:29
                    INFO     logging .. 4                                                                               rich_tests.py:29

# Output in file:
logging .. 0
logging .. 1
logging .. 2
logging .. 3
logging .. 4

Now obviously the output in the file is no longer usable, as it's lacking almost all information (like date, ...).

While i did see #1309 - it's no longer showing the log-messages in the console, and i'm heavily concerned about the handling of files - as i assume rich will not take care to rotate the files when they grow too big?

[xmatthias]

Answering my own question here, it's pretty simple to use setFormatter on the Instance of the Loghandler, forcing it to use a different handler.

This way, Rich get's "nice" outputs, while other handlers are not impacted.

Full sample:

import logging
from logging import Formatter
from rich.progress import track
from rich.console import Console
from rich.logging import RichHandler
import time

from logging.handlers import  RotatingFileHandler
LOGFORMAT = '%(asctime)s - %(name)s - %(levelname)s - %(message)s'
LOGFORMAT_RICH = '%(message)s'

error_console = Console(stderr=True)

rh = RichHandler(console=error_console)

rh.setFormatter(Formatter(LOGFORMAT_RICH))

logging.basicConfig(
    level=logging.INFO,
    # format=LOGFORMAT,python
    format=LOGFORMAT,
    handlers=[
        rh,
        # logging.StreamHandler(sys.stderr),
        RotatingFileHandler('xxx.log',
                            maxBytes=1024 * 1024 * 10,  # 10Mb
                            backupCount=10)
    ]
    )
log = logging.getLogger('somefancyname')
for n in range(5)   :
    log.info(f"logging .. {n}")
    time.sleep(0.2)