How to implement YOLO in unreal scene(customized USCityBlock) in Simulink?

I create a customized scene in unreal engine by adding some cars in the USCityBlock scene, and I want to achieve a car detection by using YOLO detector with the camera mounted on a fixedwing UAV.

This is part of my model.

In the "object detect" function I tried to use the 'vehicleDetectorYOLOv2'

But when I run my model, it doesn't show the bounding box when there is a car. And the speed of running become really slow.

Here is the scene:

What should I do?

Answer 1

[Birju Patel]

The vehicleDetectorYOLOv2 does not support vehicle detection from a bird's-eye-view. It only supports vehicle detection from cameras mounted inside ground vehicles as shown in this example:

https://au.mathworks.com/help/driving/ref/vehicledetectoryolov2.html#mw_365cc1c0-d714-4d11-8015-366955fd2b0d

For UAV applications, I suggest training a custom YOLO v2 object detector.

With regards the performance being slow, your object detection function is loading the detector from disk for every frame. Make your detector persistent to ensure that data is only loaded once:

persistent detector;

if isempty(detector)

detector = vehicleDetectorYOLOv2();

end

[SHICHEN HU]

Thank you!