Interaction with Platform Games Using Smartwatches and Continuous Gesture Recognition: A Case Study

Abstract

This work proposes the development of a method for smartwatches that allows to control platform games using continuous recognition of gestures and conducts a case study as the game Super Mario World. Uses a set of gestures based on geometric shapes to send actions to the game. Gesture recognition is performed by the algorithm of continuous gesture recognition, as it is able to recognize a gesture before being finalized, allows an action to be performed quickly, improving feedback. The recognition process was paralleled to improve performance. A technique has been developed that allows the execution of several gestures in sequence, without the need for a signaling that a gesture has been finalized or initiated. It was also created a technique that allows the sending of special commands to the game using the pressure applied on the screen by the player. A prototype for smartwatches was developed that communicates with an emulation platform installed on a Raspberry PI 3. A user experiment was performed as well as usability and experience tests. The results show that the method has the potential to be used effectively and effectively by players.

Publication
In Proceedings of 42nd IEEE International Conference on Computers, Software & Applications (COMPSAC 2018)
Thamer Nascimento
Thamer Nascimento
PhD Student
and former Master’s Student

Fabrizzio Soares is bla bla bla.

Fabrizzio Soares
Fabrizzio Soares
Associate Professor and CS Chair

Fabrizzio Soares is a professor of Computer Science, Information Systems and Software Engineering at INF/UFG. His research interests include Computer Vision, Human Computer Interaction, Machine Learning and Programming topics. He is the leader of the Pixellab group, which develops solutions for accesibilty, Precision Agriculture, and Interactive Systems.

Mateus Luna
Mateus Luna
Master’s and Undergraduate Thesis Student

Fabrizzio Soares is bla bla bla.

Related