Frame stacking implementation

[lvjonok]

Hello!

I have been wondering whether it is on the timeline of this repository to introduce FrameStackingObservationWrapper similar to gymnasium.

What do you think? Should this be implemented as a wrapper for this repository?

[kevinzakka]

Hi Lev, no plans to implement this ourselves. We do have obs_history implemented directly in some of the manipulation environments, e.g., see push_cube.py. That being said, it would be nice to have these common components consolidated into 1 module and shared across the envs. I haven't really decided if that should be in the form of a wrapper or not..

[lvjonok]

Thanks for the response! Indeed having something shareable is good, but there is catch of trying to overcomplicate things too early.

I will be looking forward to see how this repository evolves!