my DDPG agent starts applying one single action

1 Ansicht (letzte 30 Tage)
Mokhtar
Mokhtar am 12 Sep. 2022
Kommentiert: nick am 16 Nov. 2023
Hello, i am new i Deep Reinforcement learning
using RL Toolbox i am trying to train a DDPG agent to go to a position and stay there (start position = 0 , target position = 5), if he goes above 5 or under 0 he will get a big penalty. the agent starts learning and trying different actions for the first 20~30 episodes and then starts to implement the extreme action (+1) (action space[-1 1]) for the next 100 episodes, it is like he found the optimal action to take each step, which is weird because if he keeps applying the action (+1) he gets to the penalty quickly which doesn't make any sense. even if i let it for +1000 Episodes he comes back to the action (+1) everytime. my reward function for now is:
(-0,1*(reference position - actual position)^2) - 100 *( if X <0 or X>5)
  1 Kommentar
nick
nick am 16 Nov. 2023
Hi Mokhtar,
Kindly specify the environment of the agent. Also what is meant by reference position? Are the start and stop position refering to X coordinates? It would be better if you can share the code.

Melden Sie sich an, um zu kommentieren.

Antworten (0)

Kategorien

Mehr zu Deep Learning Toolbox finden Sie in Help Center und File Exchange

Produkte


Version

R2022a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by