This repository was archived by the owner on Dec 28, 2023. It is now read-only.

Description
Some time around ae03039 we regressed and the example code in gym_client.cpp doesn't converge any more. Presumably because of some difference in our observation normalization compared to the OpenAI Baselines one.
I'll look in more detail this weekend and confirm if it's that exact commit causing the problem.