RL Water Tank example by MATLAB does not converge

11 Ansichten (letzte 30 Tage)
Alp
Alp vor etwa 17 Stunden
Bearbeitet: Alp vor etwa 15 Stunden
I am following the RL water tank control tutorial by MATLAB: https://www.mathworks.com/help/reinforcement-learning/ug/control-water-level-using-ddpg-agent.html (MATLAB R2025b)
However, even the model is learning at the beginning, towards the end of the training, Q0 value explodes and the reward drops from almost maximum to below zero. I need to obtain stable and good results with the official DDPG water tank control to use it as a baseline in my research, and hence, I prefer not to modify hyperparameters of the network, the reward function and the stopping criteria.
Is anyone able to reproduce good results using the given RL water tank example? Or is it okay if it is not stable in its default configuration?=
Here are my results:
And this is the start of the training, before Q value explodes:
Thank you.

Antworten (0)

Produkte


Version

R2025b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by