Virtual environment manipulated by recognition of poses using kinect: A study to help blind locomotion in unfamiliar surroundings


This paper proposes a method to aid blind persons in skill development to walk in unfamiliar environments. The method aims to use the human ability in construct of spatial cognitive maps. Thus, we developed a system that uses the Virtual Reality and Kinect R. Two-dimensional and three-dimensional virtual environments modeling are allowed. It is possible to reproduce real environments such as schools, universities and other places of interest. The interaction with the virtual environment works with pose recognition. Recognized poses are interpreted as an action such as left and right turn or walk. Experiments were carried out to verify the pose recognition algorithms and to identify the optimal parameters. The results were satisfactory and demonstrated that the proposed method can be quite promising. Thus, it can be indicated as an aid to skill development of locomotion in real environments.

In Proceedings of 15th Symposium on Virtual and Augmented Reality (SVR)

Text in Portuguese, with English title and abstract.

Fabrizzio Soares
Fabrizzio Soares
Associate Professor and CS Chair

Fabrizzio Soares is a professor of Computer Science, Information Systems and Software Engineering at INF/UFG. His research interests include Computer Vision, Human Computer Interaction, Machine Learning and Programming topics. He is the leader of the Pixellab group, which develops solutions for accesibilty, Precision Agriculture, and Interactive Systems.