Fast mental states decoding in mixed reality

De Massari, Daniele and Pacheco, Daniel and Malekshahi, Rahim and Betella, Alberto and Verschure, Paul F. M. J. and Birbaumer, Niels and Caria, Andrea (2014) Fast mental states decoding in mixed reality. Frontiers in Behavioral Neuroscience, 8. ISSN 1662-5153

[thumbnail of pubmed-zip/versions/1/package-entries/fnbeh-08-00415/fnbeh-08-00415.pdf] Text
pubmed-zip/versions/1/package-entries/fnbeh-08-00415/fnbeh-08-00415.pdf - Published Version

Download (1MB)

Abstract

The combination of Brain-Computer Interface (BCI) technology, allowing online monitoring and decoding of brain activity, with virtual and mixed reality (MR) systems may help to shape and guide implicit and explicit learning using ecological scenarios. Real-time information of ongoing brain states acquired through BCI might be exploited for controlling data presentation in virtual environments. Brain states discrimination during mixed reality experience is thus critical for adapting specific data features to contingent brain activity. In this study we recorded electroencephalographic (EEG) data while participants experienced MR scenarios implemented through the eXperience Induction Machine (XIM). The XIM is a novel framework modeling the integration of a sensing system that evaluates and measures physiological and psychological states with a number of actuators and effectors that coherently reacts to the user's actions. We then assessed continuous EEG-based discrimination of spatial navigation, reading and calculation performed in MR, using linear discriminant analysis (LDA) and support vector machine (SVM) classifiers. Dynamic single trial classification showed high accuracy of LDA and SVM classifiers in detecting multiple brain states as well as in differentiating between high and low mental workload, using a 5 s time-window shifting every 200 ms. Our results indicate overall better performance of LDA with respect to SVM and suggest applicability of our approach in a BCI-controlled MR scenario. Ultimately, successful prediction of brain states might be used to drive adaptation of data representation in order to boost information processing in MR.

Item Type: Article
Subjects: OA STM Library > Biological Science
Depositing User: Unnamed user with email support@oastmlibrary.com
Date Deposited: 11 Mar 2023 11:02
Last Modified: 11 Jul 2024 09:37
URI: http://geographical.openscholararchive.com/id/eprint/292

Actions (login required)

View Item
View Item