How to group motion vectors pointing in similar direction as one whole object using Euclidean distance?

Bascialay I am trying to implement a vehicle detection algorithm using the block matching algorithm. So far I have an array of 35x25x2 and I would like to group neighbouring motion vectors with each other in order to form one object which represents the vehicle.

Do you have any idea or hints how this could be done?