Meta details a haptic glove prototype that uses air pockets to simulate touching objects in VR and has been in development for seven years

A new sci-fi interface for the metaverse — You cannot pet a dog in Meta's new, high-tech virtual reality gloves. But researchers are getting closer.

The Verge 2021-11-17 Adi Robertson

Context & Ripple Effects

Meta’s glove work arrived alongside a challenge from HaptX, which said the prototype was substantively identical to technology it had shown Facebook executives. That claim makes the prototype consequential not only as a Reality Labs research demonstration, but also as a potential point of contention in VR haptics.

Later Reality Labs demonstrations broadened the interaction stack, from a Direct Touch setting for Quest to neural-wristband and 3D-audio demos. The glove represents the tactile-output layer in that wider effort to make virtual interaction feel less controller-dependent.

First-order effects

Meta can test localized tactile feedback as a complement to its existing VR interaction research, rather than limiting immersion to visuals, audio, and conventional hand controls.
HaptX’s public allegation puts the provenance of Meta’s air-pocket glove approach under immediate scrutiny among VR and robotics haptics developers.

Second-order effects

Meta’s later Direct Touch work makes hand interaction a design choice across hardware and software; a glove-based feedback system would raise the value of experiences designed around direct manipulation rather than pinch gestures.
The HaptX allegation increases the strategic importance of demonstrable technical differentiation for specialist haptics suppliers competing around tactile interfaces.

Third-order effects

If Meta combines tactile output with its later wrist-based input and touch interfaces, VR interaction would increasingly be defined by an integrated sensing-and-feedback stack rather than by standalone controllers.
The related coverage points to Reality Labs treating touch as a shared capability across immersive computing and robotics, as shown by its later work to commercialize tactile sensors for AI.

The trend: Meta’s interface research is moving toward multimodal, hands-first computing that combines direct input, muscle sensing, and tactile feedback.

Discussion

@boztank Boz on x
Bringing touch and sensation to the metaverse will unlock an even greater sense of presence, but achieving this demands numerous advances in technology. Here's a look at one of the long term research challenges we're exploring in the field of haptics: https://tech.fb.com/... http…
@tsoh_investing Alex Morris on x
“The tech draws on the relatively new field of soft robotics... Meta has been working on it nearly since it acquired the Oculus VR startup in 2014. It developed its first prototype - one finger with a single actuator - in 2015.” https://www.theverge.com/... h/t @Matt_Cochrane7
@fbrealitylabs @fbrealitylabs on x
Here's a look at our haptic glove research and the advances in soft robotics, microfluidics, hand tracking, haptic rendering, and perceptual science that that work entails: https://tech.fb.com/... https://twitter.com/...
@jetscott Scott Stein on x
Haptic gloves filled with air bladders: Meta's research team talked to me about the future of where prototype gloves and EMG intersect https://www.cnet.com/...
@rabovitz Rony Abovitz on x
Anyone not taking FB/Meta seriously needs to be nervous: https://about.fb.com/...
@davionthedk Davion on x
@Meta Cute I guess, and yeah research in some physical feedback sure, why not. But I wish you had at least the hand-VR interaction at least half as good as @DennysKuhnert has already today... even without any gloves https://twitter.com/...
@ericpresidentvr Eric For President on x
Haptics change everything in a VR experience. Prove me Wrong https://twitter.com/...
@alexisweill Alexis Weill on x
Adding touch is definitely a big step forward to help make VR more immersive - I really liked how mixed reality approach from The Void https://twitter.com/...
@meta @meta on x
How do we touch the virtual world? Our Reality Labs team is working to create the technology to make it possible. Today we shared some progress in researching and developing haptic gloves to bring the sense of touch to the metaverse. Check it out https://about.fb.com/... https://…
@starfire2258 Sean Hollister on x
Soft robotics + VR gloves = yes please https://www.theverge.com/...
@sadlyitsbradley Brad Lynch on x
They estimate 10-15 years before this stuff reaches mass consumer level I'm glad they say that because the disconnection of Sci Fi fans saying “WHY NOT MAKE VR GLOVES INSTEAD” will be less spammy Gloves truly add a lot of issues you might not think about for mass users
@ian_infosec Ian Anderson on x
100% chance this gets real weird and real gross https://twitter.com/...
@neuroecology Adam J Calhoun on x
this is pretty cool - a glove that lets you “feel” virtual objects using pockets of air https://twitter.com/...
@nnnnicholas Nnnnicholas.Eth⛱👘 on x
haptic tech is so cyberpunk https://twitter.com/...
@schrep Mike Schroepfer on x
Being able to use your hands in VR with no controllers has been a huge step forward. Now our researchers are exploring the next frontier: creating a realistic sense of touch in the virtual world https://tech.fb.com/... https://twitter.com/...
@alexisweill Alexis Weill on x
Of course it made it less scalable too as opposed to @SandboxVR
@ocramius @ocramius on x
Just imagine if this wasn't built by one of the worst companies on the planet... https://twitter.com/...
@samc0hen Sam Cohen on x
VR is going to be SO much more immersive with haptics in the picture. I imagine this opens the door to many more commercial applications as well (i.e factory floor training programs where you can more-fully interact with components on the assembly line etc) https://twitter.com/..…
@kumarsachi Zeitgeist on x
This is surely the next frontier in VR. Each object has its own characteristics. Imagine the science of physics behind this. Wow! https://twitter.com/...
@jamesemleyitf @jamesemleyitf on x
This is why the “Metaverse” could be a game-changer with the inclusion of haptics for 3/5 full sensory immersion. https://twitter.com/...
@katienotopoulos Katie Notopoulos on x
i will think about the moment he smashes over the jenga tower and the engineer chuckles and goes “nice nice” for the next 3-5 years https://twitter.com/...
@russellbrandom Russell Brandom on x
It's not yet at “pet the dog” levels of sophistication, but closer than I would have thought! https://twitter.com/...
@shiraovide Shira Ovide on x
Facebook's (erm, Meta's) “haptic glove” has strong Nintendo Power Glove vibes. https://about.fb.com/... https://twitter.com/...
@davidclinchnews David Clinch on x
The metaverse looks complicated https://twitter.com/...
@kentbye Kent Bye VoicesOfVR on x
Some forward-looking research on Haptics just released by @Meta's Reality Labs. I usually have somewhat of an uncanny experience whenever I've tested out the latest haptic technologies, but it keeps incrementally getting better. Glad to see Meta continue to experiment with it. ht…
@mcwm Mike Murphy on x
I don't need any new tech to experience these advances in haptic technology I just need this app called Outside https://twitter.com/...
HaptX Andrew Mitrak on x
HaptX Statement on Meta Microfluidic Glove Prototype
@jonvirtual Jon on x
So.. real talk entrepreneurs: Don't demo to Facebook. Not even at shows. What are you thinking they will do? They don't buy products. They buy users. Go get users. Keep them in the dark about your plans. There's no golden acquisition for products there. https://twitter.com/...
@haptx @haptx on x
@boztank ... Please read this statement: https://haptx.com/... We welcome interest and competition in the field of microfluidic haptics; however, competition must be fair for the industry to thrive.
@andrewmitrak Andrew Mitrak on x
@kentbye ... Meta's photo from today vs. HaptX photo from 4 years ago. https://www.roadtovr.com/... https://twitter.com/...
@drgbuckingham Gavin Buckingham on x
Having played with the HaptX glove, I'd be surprised if Meta is aiming for the level of detail (and high cost) with any consumer haptics. Their focus will presumably be on keeping the device wireless and low-weight so that people actually use it. 1/2 https://twitter.com/...
@joemich Joe Michaels on x
@Meta C'mon @Meta... HaptX has secured a strong patent portfolio to protect the work we've done on this product over the last decade. We welcome competition, but competition must be fair for the industry to thrive. Read this https://haptx.com/...

Chronicles