MATLAB Answers

Model Based Reinforcement Learning

13 views (last 30 days)
Rafael Basso
Rafael Basso on 10 Sep 2019
Answered: Neuropragmatist on 10 Sep 2019
I'm trying to implement model based reinforcement learning with matlab. I have a directed graph and i want to travel from origin to destination. Using the function createMDP would be possible to create a very simple graph. The main problem is because the actions are generic. What i would like to do is to allow only a subset of actions depending on the current state. A solution is to implement a good reward function to penalize undesired/invalid actions, but that means a lot more training. So i'd like to speed up the learning by only allowing specific actions depending on the current state. Is it possible to do that?

Answers (1)

Neuropragmatist on 10 Sep 2019
Your agent shouldn't be able to make 'invalid' actions at all. For undesired actions, as you say the correct reward function with time should lead to the correct learning and this unconstrained approach would certianly be the most convincing.
You can of course restrict the actions of the agent in specific circumstances, but I think you would have to have good reason to implement those and be able to show that you are not just initialising your model with the parameters you expect at the end.
Hope this helps,

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by