Item


Gamification and Virtual Reality for Tongue Rehabilitation

Purpose: Lingual exercises based on tongue movements are common in speech therapy. These exercises can be tedious for patients, but gamification and virtual reality (VR) with head-mounted displays (HMD) can serve as effective strategies to enhance their motivation and engagement. However, the use of these technologies can be challenging for therapists due to a lack of technological skills. Material and Methods: A new system to support HMD-based VR for gamified tongue rehabilitation exercises is proposed. The system offers a variety of games that challenge users to achieve their goals through tongue movements and sound interaction. These games support different interaction actions that can be set by therapists using easy-to-use editors. The system also provide functionalities for patient follow-up. The system has been implemented and tested considering different technologies such as mobile devices, personal computers, and HMD complemented with an external camera to properly capture the tongue movements. Results: The therapists found the system to be user-friendly, requiring no additional support for effective utilization. The system’s versatility allows it to be used on mobile devices, as well as with augmented and virtual reality techniques, resulting in more engaging rehabilitation sessions. However, the sensibility of device movements to face detection strategies is a limiting factor of this configuration. In the case of using personal computers with HMD, better results are obtained and especially when virtual reality is considered. In this last case, it is better to consider illuminated scenarios to ensure the proper detection of facial movements. Conclusion: HMD-based VR for gamified tongue rehabilitation with ease to use editors to prepare sessions is a good strategy to improve patient engagement in tongue rehabilitation sessions

This work was supported in part by Ministerio de Ciencia e Innovación (MICIN) (Ayudas a proyectos de I+D+i paralarealización de pruebas de concepto 2021) under Grant PDC2021-120997-C32, and in part by MICIN under Grant PID2019-106426RB-C31

info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020/PID2019-106426RB-C31/ES/TECNOLOGIAS INTERACTIVAS PARA MEJORAR LOS JUEGOS SERIOS PARA LA EDUCACION, LA SALUD Y LA INDUSTRIA - UDG/

IEEE

Manager: Agencia Estatal de Investigación
Author: Rodríguez Benítez, Antonio
Chover, Miguel
Boada, Imma
Date: 2023 November 6
Abstract: Purpose: Lingual exercises based on tongue movements are common in speech therapy. These exercises can be tedious for patients, but gamification and virtual reality (VR) with head-mounted displays (HMD) can serve as effective strategies to enhance their motivation and engagement. However, the use of these technologies can be challenging for therapists due to a lack of technological skills. Material and Methods: A new system to support HMD-based VR for gamified tongue rehabilitation exercises is proposed. The system offers a variety of games that challenge users to achieve their goals through tongue movements and sound interaction. These games support different interaction actions that can be set by therapists using easy-to-use editors. The system also provide functionalities for patient follow-up. The system has been implemented and tested considering different technologies such as mobile devices, personal computers, and HMD complemented with an external camera to properly capture the tongue movements. Results: The therapists found the system to be user-friendly, requiring no additional support for effective utilization. The system’s versatility allows it to be used on mobile devices, as well as with augmented and virtual reality techniques, resulting in more engaging rehabilitation sessions. However, the sensibility of device movements to face detection strategies is a limiting factor of this configuration. In the case of using personal computers with HMD, better results are obtained and especially when virtual reality is considered. In this last case, it is better to consider illuminated scenarios to ensure the proper detection of facial movements. Conclusion: HMD-based VR for gamified tongue rehabilitation with ease to use editors to prepare sessions is a good strategy to improve patient engagement in tongue rehabilitation sessions
This work was supported in part by Ministerio de Ciencia e Innovación (MICIN) (Ayudas a proyectos de I+D+i paralarealización de pruebas de concepto 2021) under Grant PDC2021-120997-C32, and in part by MICIN under Grant PID2019-106426RB-C31
Format: application/pdf
Document access: http://hdl.handle.net/10256/23997
Language: eng
Publisher: IEEE
Collection: info:eu-repo/semantics/altIdentifier/doi/10.1109/ACCESS.2023.3330689
info:eu-repo/semantics/altIdentifier/eissn/2169-3536
PID2019-106426RB-C31
PDC2021-120997-C32
info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020/PDC2021-120997-C32/ES/AVANCES EN LA CREACIÓN E INTERACCIÓN DE CONTENIDOS PARA JUEGOS DE FITNESS - FITGAMES (NextGenerationEU)/
Is part of: info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020/PID2019-106426RB-C31/ES/TECNOLOGIAS INTERACTIVAS PARA MEJORAR LOS JUEGOS SERIOS PARA LA EDUCACION, LA SALUD Y LA INDUSTRIA - UDG/
Rights: Reconeixement-NoComercial-SenseObraDerivada 4.0 Internacional
Rights URI: http://creativecommons.org/licenses/by-nc-nd/4.0
Subject: Ludificació
Logopèdia
Gamification
Speech therapy
Realitat virtual en la medicina
Virtual reality in medicine
Title: Gamification and Virtual Reality for Tongue Rehabilitation
Type: info:eu-repo/semantics/article
Repository: DUGiDocs

Subjects

Authors