Depth Image Segmentation Using Depth Threshold

Depth threshold can be used to extract a foreground (e.g a hand) when there's a gap between a foreground and it's background. In some cases where the foreground goes "deeper" than its background, or being "buried" in the background, how can the extraction/segmentation be done?

Answer 1

[Yves Daoust]

This isn't really possible using the depth information alone, especially if the hand touches the sheet. There is no difference between a finger and a fold. (Unless you deploy an elastic 3D model of a hand and fingers and fit it to the data.)

In this particular case, you can probably work by first segmenting the skin from the visible image.