Question: Can optical hand recognition replace this electrical glove thumb texting system?

[Rhward3rd]

Digitouch research.

Use thumbs to text, like with smartphone.

But... Replace smartphone with palm of gloves

https://youtu.be/4d_RMTVn9eQ

[EloiStree]

Yes and no.

https://youtu.be/4d_RMTVn9eQ

Basically, this design has already been created to Leap Motion and Hololens in my memory. Need to find the video.

Those interface will be the first kind that will be implemented by the community in the coming month. They are obvious.

The part where where we can't do like this video:

• Thumb in the Quest (from what I have try) is very raw/imprecise. Won't allow to use one hand.
• If you use the other hand to type, it means that you need to watch. And so to type under 20 words/ minutes. Perfect to type name and number but not for sentence.

(Other part of the answers, here )

---

The positive part

We can't do a perfect state like the video. But... We can do better ^^.
Because in the Oculus Quest, we have the position and rotation tracked very well.
Plus we can use the gaz to win some speed.

It all depends of what you want to do with it ?
And for who it is design.

Is it a question without aim or do you need this kind of feature ?

Fart idea

Something that could be done is that:

Use the Smartphone way to write words. On a panel that open when we open the hands in specific way. And use the thumb to just validate / cancel / space / return while typing with the gaze.
(Switch panels for special character with position in space or with finger pinch)

"Complexe" tu code. But would seem efficient and easy enough to be understood. (Under 30 w/m)

[Rhward3rd]

I'll only answer here to keep thread consistent.

• glove with buttons. Yes, that would be an electromechanical way to do the same.

• words per minute. I don't know about you, but I spend 90% of my tone thumb tapping put messages on a 3 inch wide piece of glass, and not that fast. If I could have roughly the same wpm in VR tapping my thumbs on my finger joints... It would be the same as what I have now. So I'll take it.

• looking at "hands" or not... I'm looking at the phone keyboard now, and my thumbs... Replicate the same. But I do believe you can learn to do this without looking. I drew the keys on my hands and 'practiced' and did pretty well.

• the first interface. The first interface is a full qwerty keyboard and people 'air typing' withdrawal one finger. I want better than that.

• question without aim or desired feature. Its a research question and a hypothesis about the future. No specific application/game in mind

I asked you because it appears you have 90% of this in place and are prototyping/testing these types of things.

What's your thoughts on if it can be done and how functional it would be?

[Rhward3rd]

I've gone and googled multiple leap motion, hololens and VR keyboard/text entry queries, and none of them are doing this.