I want to know how to understand the sampling time ts of the agent in reinforcement learning, and how its value will affect the training and results?
1 Ansicht (letzte 30 Tage)
Ältere Kommentare anzeigen
嘻嘻
am 6 Nov. 2023
Kommentiert: Emmanouil Tzorakoleftherakis
am 9 Nov. 2023
I want to know how to understand the sampling time ts of the agent in reinforcement learning, and how its value will affect the training and results?
0 Kommentare
Akzeptierte Antwort
Emmanouil Tzorakoleftherakis
am 8 Nov. 2023
Think of it as how often you need the agent to make decisions. Sometimes you need to make decisions very frequently (e.g. if your system dynamics are fast) and sometimes not. Could be viewed as the equivalent of a controller rate.
The smaller ts is, the more frequently the agent will make decisions, but that will make training much slower. On the other hand, if ts is large, training may progress faster, but depending on your system it may not converge.
Hope this helps
3 Kommentare
Emmanouil Tzorakoleftherakis
am 9 Nov. 2023
You should be able to use a single agent for this application. However, since you already have a model of the system, I would first try with a model-based controller like MPC.
Weitere Antworten (0)
Siehe auch
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!