Full mouse control

[zeroxoneafour]

Is your feature request related to a problem? Please describe.
When I use noVNC for remote gaming, games that require mouse control (such as first-person games like Minecraft) cannot interpret the mouse input correctly, most likely because the application in question is not given full mouse control.

Describe the solution you'd like
It would be great if noVNC was able to fully immerse the mouse in the VNC using mouse control. First-person games online are able to "take control of your pointer" and it would be nice if there was a setting to allow that in the options.

Describe alternatives you've considered
I tried reconfiguring Minecraft's settings, but nothing works.

Additional context
When mouse control is fully taken, it would also probably be a good idea to make a keybind (such as esc) to give mouse control back to the client computer.

[CendioOssman]

We're only a client so there is limits to what extra features we can add. Do you know of any VNC client/server combination where this already works?

[zeroxoneafour]

RealVNC seems to support this, or something like this, as Minecraft Pi Edition seems to work over their VNC (see here). I know that RealVNC is proprietary, though, and I think it requires their client as well.

[CendioOssman]

Unfortunately the fact that they are proprietary does mean it doesn't help us that they have that functionality. We need to know how the extension works, either through documentation or source code.

[zeroxoneafour]

x11vnc has a option called -pipeinput that can throw the mouse input directly into uinput. It seems to work, but I am met by the limitation of the mouse exiting the area of effect of the vnc client. You might be able to take advantage of the feature for exclusively x11vnc as a server.

[lhchavez]

This could in theory be achieved through the Pointer Lock API (demo). Are patches welcome for this? If so, I can maybe cook something up.

[mteam88]

Would really love this functionality! Any updates @lhchavez @samhed @CendioOssman @zeroxoneafour @jswanner ?

[Frontesque]

I'm also looking for a fix for this. I use noVNC as a remote desktop for while im out and it causes some issues with programs that require relative mouse movement.