Using Smartwatches as an Interactive Movie Controller - A Case Study with the Bandersnatch Movie

Abstract

This work proposes the development of a method that allows the use of smartwatch as a control for interactive films using continuous recognition of gestures and conducts a case study with the film ”Black Mirror: Bandersnatch”. We developed two prototypes to interact with interactive movies. The first one uses gesture recognition on the smartwatch screen. Thus, we created a set of gestures composed of straight lines that represent the actions in the interactive movie. In this prototype, the recognition of gestures is performed by the algorithm of continuous recognition of gestures, in this way, a gesture can be recognized before the user finalize, and action is sent quickly to the movie. The second prototype uses a touch of pressure in the smartwatch to control the film. Thus, the actions to be performed in the smartwatch that represents the actions in the interactive film is proposed, the recognition of the gestures is determined by the change of the values obtained by the accelerometer. The prototypes communicate with a simulation service responsible for running the movie. The prototypes were used in a study with users, as well as in usability and experience tests, and the results show that the method has the potential to be used in everyday users to control interactive films efficiently and effectively.

Publication
In Proceedings of IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC 2019)
Thamer Nascimento
Thamer Nascimento
PhD Student
and former Master’s Student

Fabrizzio Soares is bla bla bla.

Fabrizzio Soares
Fabrizzio Soares
Associate Professor and CS Chair

Fabrizzio Soares is a professor of Computer Science, Information Systems and Software Engineering at INF/UFG. His research interests include Computer Vision, Human Computer Interaction, Machine Learning and Programming topics. He is the leader of the Pixellab group, which develops solutions for accesibilty, Precision Agriculture, and Interactive Systems.

Jaline Mombach
Jaline Mombach
PhD Student

Jaline Mombach received the Bachelor's degree in Computer Science and the Master's degree in Electrical Engineering from the Federal University of Pampa in 2013 and 2015, respectively. She is currently a Ph.D. candidate at the Federal University of Goiás and a professor at the Federal Institute of Brasília. Her research project explores Emergent Literacy and Child Computer Interaction.

Welington Galvao
Welington Galvao
Master’s Student

Fabrizzio Soares is bla bla bla.

Related