@claudio1212 The RL example has been updated, and it should run without issues. The LSTM policy is indeed not available any more from SB3, but it is implemented in sb3-contrib. There is also an ...

git clone https://github.com/latentghost/PTGM-Sample-Efficient-RL cd PTGM-Sample-Efficient-RL pip install setuptools==65.5.0 pip==21 pip install wheel==0.38.0 pip ...