Reinforcement learning agent does not perform any action in simulation after train

9 Ansichten (letzte 30 Tage)
Data store memory blocks were added to prevent algebraic loop errors:
2019-10-06_00-01-42.png
While training process, the scope shows active action signal (yellow):
2019-10-06_00-08-01.png
But after training, in simulation, or running simulink model, the action or rl agent stay idle. Non zero, but constant:
2019-10-06_00-12-32.png
What can be the cause?
How can i enable actions, when run simulink model?

Antworten (1)

Alexey J
Alexey J am 8 Okt. 2019
Bearbeitet: Alexey J am 8 Okt. 2019
Solved with multiplication x2 reward and x10 action signal.
There is no hidden settings.
The cause is somewhere in reward algorithm.
Next time i advice to play with action and reward signals, to fill all provided space, while training.
  1 Kommentar
Anh Tran
Anh Tran am 21 Feb. 2020
I can totally relate with you Alexey. Reward shaping plays a big role in the design of an RL agent. It would be great if you could share what reward function did you come up with to solve the task and how did you iterate to get a better function.

Melden Sie sich an, um zu kommentieren.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by