Training Quadrotor using PPO agent

22 Ansichten (letzte 30 Tage)
Mahmoud Chick Zaouali
Mahmoud Chick Zaouali am 27 Apr. 2022
Kommentiert: SALMAN IJAZ am 3 Dez. 2024 um 13:16
So I am trying to control a quadrotor model using Reinforcement learning. My agent will control my quadrotor and make it navigating to a desired position or following a path. Right now I am trying to train my PPO agent to hover the quadrotor. I built a dynamical model of the quadrotor with 6DOF block. After that I built the observation and reward function of my agent.
I coded the actor critic network and set my parameters.The problem is my reward function is always equals to 0 and my agent is not learning and I am suspuscious that I didn't build the environment correctly. I have been working on my model for long period and couldn't make my agent learn a little. I will really be glad if someone can support me on this issue.
I attached my quadrotor Reinforcement learning model with actor and critic codes.

Antworten (1)

Emmanouil Tzorakoleftherakis
Bearbeitet: Emmanouil Tzorakoleftherakis am 28 Apr. 2022
Hello,
There are multiple things not set up properly, including:
1) The isdone flag seems to be 1 all the time leading to episodes terminating early, after a single step
2) The reward signal is often not a scalar real number. One reason is that you are trying to calculate the sq root of a negative number
3) Your Simulink model has a lot of algebraic loops - I would get rid of those to make sure they don't interfere with training.
Hope that helps
  2 Kommentare
Unmanned Aerial and Space Systems
Hi, like this problem, I shared my model:
https://www.mathworks.com/matlabcentral/answers/1708930-reinforcement-learning-based-quadrotor-control-using-soft-actor-critic-the-reward-is-not-converging?s_tid=prof_contriblnk
SALMAN IJAZ
SALMAN IJAZ am 3 Dez. 2024 um 13:16
Hello. is your issue resolved?

Melden Sie sich an, um zu kommentieren.

Produkte


Version

R2021a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by