I believe the RL environment template creator has an error in the reset function but I'm not sure
4 Ansichten (letzte 30 Tage)
Ältere Kommentare anzeigen
Cecilia S.
am 14 Jun. 2021
Kommentiert: Cecilia S.
am 22 Jun. 2021
when using rlCreateEnvTemplate("MyEnvironment") to create a custom template I came across this line in the reset function:
% Line 123
InitialObservation = [T0;Td0;X0;Xd0];
Initial states seem to be reversed, I believe they should be [X0;Xd0;T0;Td0]?
the same seems to apply to the example loaded with openExample('rl/MATLABCartPoleDQNExample'), although I cannot see the reset function, the example gives the same results as the template and when I tried validating these two against the environments created with openExample('rl/CreateMATLABEnvironmentUsingCustomFunctionsExample') they yield different initial states.
but I'm still kinda new to this and I'm afraid to be missing something here. Could you please clarify?
0 Kommentare
Akzeptierte Antwort
Emmanouil Tzorakoleftherakis
am 22 Jun. 2021
Hello,
You are correct the order is wrong. That being said, the order of states depends on your dynamics and how you set up the state vector in the step function.
Hope that helps
Weitere Antworten (0)
Siehe auch
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!