Using the temporal Interpolator algorithm for my sublabels

Hello mathworks community,

i hope you guys can help me.

So basically i would like to use the Video Labeling to annotate a assembly process. I would like to label this in modules

Like:

Module 1 (Label) : 6 different sublabels

Module 2 (Label) : 5 different sublabels

This whole process is around 50 seconds. Therefore i would like to interpolate the frames over the time.

But I'm not able to frame the sublabels by using the "Temporal Interpolator" algorithm.

I already tried to annotate the sublabels within the mainlabel but there is not chance either.

Is there any possibility to manage this problem?

If i have to label frame by frame without using the interpolation it will be a big problem.

Thanks in advance

Greetings

Phil

Answer 1

[Kartik]

Hi,

It sounds like you are having trouble using the Temporal Interpolator algorithm in the Video Labeler app to label your assembly process data in modules and sublabels. If you are not able to achieve the labeling you need using the Temporal Interpolator algorithm, you might need to consider a workaround.

Here are a couple of suggestions to manage this problem:

1. If the assembly process can be easily split into segments corresponding to the different modules and sublabels, you might consider splitting the video into segment files and labeling each segment separately. Then, you can concatenate the labeled segments to reconstitute the labeled video.
2. If the assembly process can't be easily split into segments, you can try modifying your labeling process to make it easier to interpolate the sublabels over time. For example, you could record timestamps in the video frames and use the timestamp information to interpolate the sublabels between frames.
3. One way to work around this issue is to label each sub-label as a separate label in the app, and then use a separate interpolation or extrapolation algorithm for each sub-label.

Here is the documentation for the Video Labeler app in MATLAB, including details on how to use the Temporal Interpolator and other algorithms:

https://www.mathworks.com/help/vision/ref/videolabeler-app.html?searchHighlight=video%20labeler&s_tid=srchtitle_video%2520labeler_1