Meta Develops Wristband To Control Computers Using Hand Gestures

Meta released a paper in the scientific journal Nature with its latest breakthrough: a wristband that enables users to control computers using hand gestures.

According to the official announcement published on Wednesday, Meta has been working for years on new ways to interact with computers, leveraging machine learning and AI in a non-invasive technique that collects data through sensitive sensors placed on the skin.

“Based on our findings, we believe that surface electromyography (sEMG) at the wrist is the key to unlocking the next paradigm shift in human-computer interaction (HCI),” wrote Meta.

Meta explained that sEMG allows interaction with the company’s devices and works for people with different abilities and physical characteristics. The researchers also tested the wristband with other hardware.

“We successfully prototyped an sEMG wristband with Orion, our first pair of true augmented reality (AR) glasses, but that was just the beginning,” said Meta. “Our teams have developed advanced machine learning models that are able to transform neural signals controlling muscles at the wrist into commands that drive people’s interactions with the glasses, eliminating the need for traditional—and more cumbersome—forms of input.”

The new technology allows people to engage with digital content without the hardware. For example, to type without a keyboard or navigate without a mouse.

Meta’s sEMG recognizes gestures such as tapping, pinching, and swiping, and includes a handwriting recognition technology that allows users to use any hard surface to write a message that can be registered by the device.

“We believe this technology is the best that’s been developed by anyone to let you control your devices in a seamless, intuitive, and adaptable way that can be used by most people,” wrote Meta.

The company believes that the new device could revolutionize the way we interact with devices in the near future.

In addition to this innovation, Meta has been working on developing multiple tech devices, including its own graphics processing units (GPUs) and smartglasses.