Depth camera mapping to OBS layer height

[tnwood]

I use this excellent plugin to create scenes during video conferences with depth.

This is generally no more complex than

1. a background
2. a foreground object
3. a kinect green screen person

by using OBS object layering, I can make me appear part of the screen. This morning I had the Millenium Falcon backdrop, but the foreground object was the chess table, so I could make it look like I was sitting behind it, simple by placing the table at the top of the layers, then the kinect source, then the background. Later on I added a few more layers so I could walk behind the seat upright, but I had to manually alter the layers to do so.

Imagine if the layer height was altered in realtime by depth camera input! A scene could have 3 layers and the height of the kinect source could change depending on how close the user was to the camera, giving the sense of 3d!

[SirLynix]

This is a really great idea, I'm just not sure how a source can affect the render order of other sources. The must would be to be able to set a depth to each source so you can have down to pixel accuracy on render order.