Emmanouil Tzorakoleftherakis

Last seen: 4 Tage ago

MathWorks

258 total contributions since 2018

Emmanouil Tzorakoleftherakis's Badges

Answered
RL in dynamic environment
The following example seems relevant, please take a look: https://www.mathworks.com/help/robotics/ug/avoid-obstacles-using-rein...

4 Tage ago | 0

Answered
MPC Controller giving nice performance during designing but fails on testing
Hello, It sounds to me that the issue is with the linearized model. When you are exporting the controller from MPC Designer, yo...

6 Tage ago | 0

Answered
What is in a reinforcement learning saved agent .mat file
Why don't you load the file and check? When you saved the agen tin the .mat file, did you save anything else with it? Are you m...

16 Tage ago | 0

Answered
reinforcement learning PMSM-code
You can find the example here.

16 Tage ago | 0

| accepted

Answered
How to deal with a large number of state and action spaces?
Even if the NX3 inputs are scalars, I would reorganize them into an "image" and use imageInput layer for the first layer as oppo...

16 Tage ago | 0

Answered
Q learning algorithm in image processing using matlab.
Hello, Finding an example that exactly matches what you need to do may be challenging. If you are looking for the "deep learnin...

24 Tage ago | 0

| accepted

Answered
Need help with Model based RL
Hello, If you want to use the existing C code to train with Reinforcement Learning Toolbox, I would use the C caller block to b...

26 Tage ago | 0

| accepted

Answered
How to set the reinforcement learning block in Simulink to output 9 actions
Hello, the example you are referring to does not output 3 values for the pid gains. The PID gains are "integrated" into the neu...

27 Tage ago | 0

Answered
Where to update actions in environment?
Reinforcement Learning Toolbox agents expect a static action space, so fixed number of options at each time step. To create a dy...

etwa ein Monat ago | 0

Answered
How to check the weight and bias which taked by getLearnableParameters?
Can you provide some more details? What does 'wrong answer' mean? How do you know the weights you are seeing are not correct? Ar...

etwa ein Monat ago | 0

Answered
Gradient in RL DDPG Agent
If you put a break point right before 'gradient' is called in this example, you can step in and see the function implementation....

etwa ein Monat ago | 0

| accepted

Answered
Soft Actor Critic deploy mean path only
Hello, Please take a look at this option here which was added in R2021a to allow exactly the behavior you mentioned. Hope this...

etwa ein Monat ago | 0

| accepted

Answered
How to pretrain a stochastic actor network for PPO training?
Hello, Since you already have a dataset, you will have to use Deep Learning Toolbox to get your initial policy. Take a look at ...

etwa ein Monat ago | 1

Answered
Failure in training of Reinforcement Learning Reinforcement Learning Onramp
Hello, We are aware and working to fix this issue. In the meantime, can you take a look at the following answere? https://www....

etwa ein Monat ago | 0

Answered
DQN Agent with 512 discrete actions not learning
I would initially revisit the critic architecture for 2 reasons: 1) Network seems a little simple for a 3->512 mapping 2) This...

etwa ein Monat ago | 0

Answered
How does the Q-Learning update the qTable by using the reinforcement learning toolbox?
Can you try critic.Options.L2RegularizationFactor=0; This parameter is nonzero by default and likely the reason for the discre...

etwa ein Monat ago | 0

Answered
File size of saved reinforcement learning agents
Hello, Is this parameter set to true? If yes, then it makes sense that mat files are growing in size as the buffer is being pop...

etwa ein Monat ago | 0

| accepted

Answered
Saving Trained RL Agent after Training
Setting the IsDone flag to 1 does not erase the trained agent - it actually makes sense that the sim was not showing anything be...

etwa ein Monat ago | 0

| accepted

Answered
How to Train Multiple Reinforcement Learning Agents In Basic Grid World? (Multiple Agents)
Training multiple agents simultaneously is currently only supported in Simulink. The predefined Grid World environments in Reinf...

etwa ein Monat ago | 0

| accepted

Answered
How to create a neural network for Multiple Agent with discrete and continuous action?
If you want to specify the neural network structures yourself, there is nothing specific you need to do - simply create two acto...

etwa 2 Monate ago | 0

| accepted

Answered
Is it possible apply Reinfocrement Learning to classify data?
If you already have a labeled dataset, supervised learning is the way to go. Reinforcement learning is more for cases where data...

etwa 2 Monate ago | 0

| accepted

Answered
Combining two deep neural networks to train simultaneously
Hello, You can do this in Simulink - see the following examples for reference. https://www.mathworks.com/help/reinforcement-l...

etwa 2 Monate ago | 1

| accepted

Answered
DQN learns at first but then worsens.
To confirm that this is an exploration issue, can you try setting the EpsilonMin param to a high value? e.g. 0.99. If after doin...

etwa 2 Monate ago | 0

Answered
How to resume train a trained agent?about Q learning agents.
Hello, To see how to iew the table values, take a look at the answer here. Also, you don't have to do anything specific to con...

etwa 2 Monate ago | 0

| accepted

Answered
Reinforcement learning action getting saturated at one range of values
Your scaling layer is not set up correctly. You want to scale to (upper limit-lower limit) and then shift accordingly. scaling...

etwa 2 Monate ago | 0

| accepted

Answered
How can I provide constraints to the actions provided by the Reinforcement Learning Agent?
Hard constraints are not typically supported during training in RL. You can specify limits/constraints as you mention above, but...

2 Monate ago | 0

| accepted

Answered
Exporting data only works as pdf. Axis labels are getting small and unreadable
You cannot save as .fig from the episode manager plot. If you have the training data though (it's good practice to save this dat...

2 Monate ago | 1

| accepted

Answered
Reinforcement Learning multiple agent validation: Can I have a Simulink model host TWO agents and test them
That should be possible. Did you follow the multi-agent examples? Since the agents are trained already you may want to check the...

2 Monate ago | 0

| accepted

Answered
Do the actorNet and criticNet share the parameter if the layers have the same name?
No, each network has its own parameters. Shared layers are not supported out of the box, you would have to implement custom trai...

2 Monate ago | 0

| accepted

Answered
Any RL Toolbox A3C example?
Hello, To get an idea of what an actor/critic architecture may look like, you can use the 'default agent' feature that creates ...

2 Monate ago | 0

| accepted