I'm hoping to try this approach with a digital piano keyboard. Will it be usable if I can see the keys but not see my hands? I'll find out. (I'm not a very good player, I can play without looking at the keys but I still need to glance at them, e.g. when changing position or playing a wide chord)
edit to note: I do have a Leap Motion, and I'll try that, too, but right now my plan is to use it above the keyboard as a gesture controller rather than facing down at the keys. Lots of experiments to try. :)
A leap motion integrated into this to show your hands might work really well. At some point we'll know what's required for a good environment like this, and have software that supports it all. For now, it's new territory.
Doing virtual tracking would be ideal but neither the Lighthouse or Constellation protocols have been published (you could tape a Vive controller to the keyboard if you wanted to simulate that)
Yeah, something that tried to do a visual mathcing of keyboard and hands and only showed those when you looked down would be idea for data entry (but looking down to see reality has other uses).
edit to note: I do have a Leap Motion, and I'll try that, too, but right now my plan is to use it above the keyboard as a gesture controller rather than facing down at the keys. Lots of experiments to try. :)