Hi,
I just want to thank you for the great work. I have been trying to combine tf with gym these days, but so far no success. I didn't even build the gym dockerfile successfully.
This repo is really helpful. The VNC support is also very helpful.
As stated in the title, you may consider adding openai/baselines in the image as well.
Finally, just a quick note, you mentioned cudnn v7 in the README file but it is still cudnn v6 in the dockerfile.