Tecnologia assistiva para reconhecimento de cartas de baralho utilizando aprendizado profundo

Abstract

We present in this paper an inclusive application that allows visually impaired people to interact socially with other individuals in leisure activities such as card games. For this, we built a generalizable model that was trained for the detection and recognition of playing cards by using convolutional neural network through deep learning. A system called Smart Assistant was designed and implemented based on TensorFlow’s object detection API. At a predefined location, a digital camera is used to detect cards in real-time. Then, these detected cards are sent to the classifier. After the classification, the SAPI Text to Speech Synthesis API (TTS) is used to convert the labels of recognized cards (in text format) to speech output. Experiments show that in real game situations, the application can identify and classify cards with high assertiveness.

Publication
In Proceedings of XXXII Conference on Graphics, Patterns and Images (SIBGRAPI 2019)
Fabrizzio Soares
Fabrizzio Soares
Associate Professor and CS Chair

Fabrizzio Soares is a professor of Computer Science, Information Systems and Software Engineering at INF/UFG. His research interests include Computer Vision, Human Computer Interaction, Machine Learning and Programming topics. He is the leader of the Pixellab group, which develops solutions for accesibilty, Precision Agriculture, and Interactive Systems.

Gabriel Vieira
Gabriel Vieira
PhD Student
and former Master’s Student

Fabrizzio Soares is bla bla bla.

Related