A method to develop virtual reality platforms for the medical rehabilitation of severe memory loss after brain stroke

The paper presents a method to develop Virtual Reality (VR) platforms based on serious games for the rehabilitation of severe memory loss. In particular, it is related to retrograde amnesia, a condition affecting patient's quality of life usually caused by brain stroke. Nowadays, the standard rehabilitation process consists in showing pictures of patient's familiar environments in order to recover the memory. Past research works have investigated the use of 3D scanners for the virtualization of real environment and virtual reality for the generation of more immersive interaction to design serious games for neurocognitive rehabilitation. Reached results highlighted a time-consuming development process to interface each new environment with the game logic specifically developed for the serious games. Furthermore, a complete VR platform must also consider the medical monitoring and the data management oriented to a more objective medical assessment. The proposed method allows the design of VR platforms based on patient-specific serious games for memory loss starting from the 3D scanning acquisition of familiar environments. The 3D acquisition is performed using the Occipital Structure Sensor and the Skanect application. A modular procedure has been designed to interface the virtual objects of each acquired environment with the modules of the game-logic developed with Unity. The immersive Virtual Reality is based on the use of the HTC Vive Pro head mounted display. Furthermore, the method permits to associate the patient-specific serious game to a set of software modules for the medical monitoring and the data management for the generation of reports useful for the evaluation. The solution has been evaluated by measuring the time needed to develop a whole VR platform for two different familiar environments. Less than 5 hours are required to complete the design process.