PPO - Use multi-processing & vectorized environments to speed-up the learning process

[roeey777]

Take a look at PPO implementation details, bullet #1.
There even a support in pytorch for multiprocessing.