Fix unit1 bug#651

YuxiangZhuang wants to merge 2 commits intohuggingface:mainhuggingface/deep-rl-class:mainfrom

YuxiangZhuang:fix-unit1-bugYuxiangZhuang/deep-rl-class:fix-unit1-bugCopy head branch name to clipboard