https://github.com/ChenglongChen/pytorch-madrl/blob/44b8f082ffb054c6dabead8971b66a7be4c1f9ff/A2C.py#L56 should add one more line: self.critic.cuda(). Also could you provide some example for running the multi-agent case? Thanks!