Thoughts on e-prop variant for forward AD instead of backward AD

[ryancinsight]

Have you thought of using e-prop/ES-D-RTRL variant for online forward AD to prevent the OOM. I was able to use thread local storage for eligibility traces over multiple passes and it seems to work well in my case with TRM architecture.