Possibly related to deepcopy of Gym.Env or GymState objects as this issue is absent for the boardgames.