İstanbul Gelisim Vocational School - myo@gelisim.edu.tr
For your satisfaction and complaints   İGÜMER
 İstanbul Gelisim Vocational School - myo@gelisim.edu.tr

Computer Programming








 A New Step in Human Computer Interaction: Wrist Interaction


Facebook Reality Labs (FRL) announced that they have developed a new interaction tool for augmented reality (AR - Augmented Reality) glasses. They mention that this tool is an intuitive and natural way of interaction for AR, and that this interaction will change the interpersonal connections.


In the article and video published on March 18, they mention that as the starting point of this technology, first of all, our view of the world in AR glasses is not through screens like mobile devices, but in the form of seeing nature as it is with our own eyes. Interaction with this world takes place in a three-dimensional way. It was also mentioned that the future of human-computer interaction should provide an extremely easy, reliable and personal interface.
 
In order to meet this requirement, they argued that an advanced artificial intelligence should receive commands in accordance with different environment and context, but we are still quite far from this artificial intelligence. However, from human interactions, it has been noticed that the wrist adapts to the environment and the individual, albeit partially.
 
Another answer to the question of why the wrist is that sound has come to the fore as an individual interaction method, but it will be difficult to use in areas with common or loud background noise. Devices such as phones and remotes should also be stored somewhere. Considering such situations, it has been said that they are moving towards designing a wristband that will detect wrist movements by referring to the watches traditionally used on the wrist in natural life.
 
How does this technology work?
 
The signals from the brain to the hand movement pass through the wrist. In order to translate these signals passing through the wrist, the electromyography (EMG) method, which is widely used in the medical field, was preferred. Based on these signals, any finger or hand movements will be detected.
 
Although FRL mentioned that limited movement commands can be detected in the first stage, he also mentioned that more advanced gestures can be used in the interaction of objects in the future, and even a superpower simulation like Force can be applied.
 
What can this technology alone change?
 
“We see our wristband products as a low-friction, always-on data input for AR glasses, but they are not a stand-alone solution – just as the mouse is part of a graphical interface,” said Hrvoje Benko, FRL Research Science Manager on wrist interaction. He also continued with the statement that “these should also be supported by intent estimation and user modeling to suit you and your specific real-life context”.
 
Learning the music played while jogging, “play the playlist?” in the next runs. Suggestions for applications or applications that offer a personalized keyboard / suggestions according to the words written on a virtual keyboard / mistakes made are among some application suggestions that can be enriched with wrist movements.
 
Designed by FRL and prototyped integrated with the science of touch, this wrist interaction is at a level that can open new avenues for AR and even augmented reality (XR) technology. It is a candidate to show itself as a new title in the field of information technologies and software development.