I've fixed several USB HID devices at upstream Linux kernel with HID_QUIRK_ALWAYS_POLL (0x00000400) already.
So please let me know if your mouse or USB HID device disconnects every x seconds or every minute when no user-space driver is running and nothing polls it this way (usually mice on a virtual terminal [VT] without gpm running).
Please test if the kernel boot option
usbhid.quirks=0xaaaa:0xbbbb:0x00000400
fixes the issue while aaaa is the USB vendor ID and bbbb is the USB product ID in hex from lsusb or lsusb -vvv output.
If this fixes your issue, please let me know the USB IDs, your mouse or device model, your kernel version, and which distro you use.
I will check if it has been fixed at the latest upstream kernel already and prepare the kernel patch if needed.
Thanks in advance!