Offline CQL Performance on Atari

[b-hahn]

Thanks a lot for the CQL implementation! I wanted to run the offline CQL-SAC for Atari environments and saw your offline training code is for continuous environments only. Have you run any offline experiments on Atari? If so, could you share what level of performance you achieved when compared to online runs? Thanks a lot!

[BY571]

Hey @b-hahn !

Thank you for your comment, indeed I haven't tried (out of personal interest) the discrete action space environments yet. But I think it would be interesting to see. However, currently, I do have not that much time. Maybe over the weekend, I could try and update you here.
If you are interested in experimenting with it yourself I have also a discrete SAC implementation. You only had to combine both implementations.

Hope that helps for now! :)