Bizarre complete "washed out" brightness that randomly happens on game launch

[lolDayus]

(Sorry I guess it's too late to edit the title now but this is concerning NvTrueHDR)

Hey so I'm almost positive it's this (or at least has something to do with my HDR coming on via something other than Auto-HDR) but I keep randomly getting, only on HDR monitors/TVs, this "brightness way too high" washed out effect over the entire screen that I can very temporarily "almost" get rid of by performing some system action that affects Fullscreen status like taking a screenshot with default Print Screen or by holding "alt" as if to alt-tab out and the preview/"peak" windows look almost normal.

But then I go back into game (Full Screen Exclusive, Borderless Fullscreen, Windowed, doesn't matter), if it's an HDR game it's screwed. Has happened to me with both BG3 and FF7 Rebirth now, both of which I end up launching quite often to do testing mods and such so it's not like it's happening every other time but maybe there's maybe like, a 5% chance that this thing will "activate" on game start and I can't get rid of it no matter what I do involving display/HDR/NVtrueHDR settings. Only thing that fixes it is a complete reboot.

The other dead giveaway that's more reproducible is my RTSS window having this almost fluorescent red text color when everything's working that changes to either just orange very temporarily (when screenshotting) or an even more faded orange when I'm 100% back in-game. So I know I'm not imagining it. Any idea what can be done about this or if this has happened to anyone else? Specs are:

Processor 12th Gen Intel(R) Core(TM) i7-12700K 3.60 GHz
Installed RAM 32.0 GB (31.7 GB usable)
System type 64-bit operating system, x64-based processor

Edition Windows 11 Pro
Version 24H2
OS build 26100.3194
Experience Windows Feature Experience Pack 1000.26100.48.0

and I obviously have Windows settings HDR "On" and Auto-HDR "Off". I use Low settings for the Base profile as well as the custom profiles of any game I play. I'll upload a comparison of both states if that'll help

EDIT: Actually due to the nature of the issue (Print Screen puts everything temporarily into "not HDR but not the totally F'd brightness" state), screenshots are useless because they both show that "middle orange" text for RTSS.