Rapid serial visual presentation-brain computer interface (RSVP-BCI) is the most popular technology in the early discover task based on human brain. This algorithm can obtain the rapid perception of the environment by human brain. Decoding brain state based on single-trial of multichannel electroencephalogram (EEG) recording remains a challenge due to the low signal-to-noise ratio (SNR) and nonstationary. To solve the problem of low classification accuracy of single-trial in RSVP-BCI, this paper presents a new feature extraction algorithm which uses principal component analysis (PCA) and common spatial pattern (CSP) algorithm separately in spatial domain and time domain, creating a spatial-temporal hybrid CSP-PCA (STHCP) algorithm. By maximizing the discrimination distance between target and non-target, the feature dimensionality was reduced effectively. The area under the curve (AUC) of STHCP algorithm is higher than that of the three benchmark algorithms (SWFP, CSP and PCA) by 17.9%, 22.2% and 29.2%, respectively. STHCP algorithm provides a new method for target detection.
Brain-computer interaction (BCI) is a transformative human-computer interaction, which aims to bypass the peripheral nerve and muscle system and directly convert the perception, imagery or thinking activities of cranial nerves into actions for further improving the quality of human life. Magnetoencephalogram (MEG) measures the magnetic field generated by the electrical activity of neurons. It has the unique advantages of non-contact measurement, high temporal and spatial resolution, and convenient preparation. It is a new BCI driving signal. MEG-BCI research has important brain science significance and potential application value. So far, few documents have elaborated the key technical issues involved in MEG-BCI. Therefore, this paper focuses on the key technologies of MEG-BCI, and details the signal acquisition technology involved in the practical MEG-BCI system, the design of the MEG-BCI experimental paradigm, the MEG signal analysis and decoding key technology, MEG-BCI neurofeedback technology and its intelligent method. Finally, this paper also discusses the existing problems and future development trends of MEG-BCI. It is hoped that this paper will provide more useful ideas for MEG-BCI innovation research.
Brain-computer interface (BCI) systems based on steady-state visual evoked potential (SSVEP) have become one of the major paradigms in BCI research due to their high signal-to-noise ratio and short training time required by users. Fast and accurate decoding of SSVEP features is a crucial step in SSVEP-BCI research. However, the current researches lack a systematic overview of SSVEP decoding algorithms and analyses of the connections and differences between them, so it is difficult for researchers to choose the optimum algorithm under different situations. To address this problem, this paper focuses on the progress of SSVEP decoding algorithms in recent years and divides them into two categories—trained and non-trained—based on whether training data are needed. This paper also explains the fundamental theories and application scopes of decoding algorithms such as canonical correlation analysis (CCA), task-related component analysis (TRCA) and the extended algorithms, concludes the commonly used strategies for processing decoding algorithms, and discusses the challenges and opportunities in this field in the end.
Motor imagery electroencephalogram (EEG) signals are non-stationary time series with a low signal-to-noise ratio. Therefore, the single-channel EEG analysis method is difficult to effectively describe the interaction characteristics between multi-channel signals. This paper proposed a deep learning network model based on the multi-channel attention mechanism. First, we performed time-frequency sparse decomposition on the pre-processed data, which enhanced the difference of time-frequency characteristics of EEG signals. Then we used the attention module to map the data in time and space so that the model could make full use of the data characteristics of different channels of EEG signals. Finally, the improved time-convolution network (TCN) was used for feature fusion and classification. The BCI competition IV-2a data set was used to verify the proposed algorithm. The experimental results showed that the proposed algorithm could effectively improve the classification accuracy of motor imagination EEG signals, which achieved an average accuracy of 83.03% for 9 subjects. Compared with the existing methods, the classification accuracy of EEG signals was improved. With the enhanced difference features between different motor imagery EEG data, the proposed method is important for the study of improving classifier performance.
Brain-computer interface (BCI) can establish a direct communications pathway between the human brain and the external devices, which is independent of peripheral nerves and muscles. Compared with invasive BCI, non-invasive BCI has the advantages of low cost, low risk, and ease of operation. In recent years, using non-invasive BCI technology to control devices has gradually evolved into a new type of human-computer interaction manner. Moreover, the control strategy for BCI is an essential component of this manner. First, this study introduced how the brain control techniques were developed and classified. Second, the basic characteristics of direct and shared control strategies were thoroughly explained. And then the benefits and drawbacks of these two strategies were compared and further analyzed. Finally, the development direction and application prospects for non-invasive brain control strategies were suggested.
Neurofeedback (NF) technology based on electroencephalogram (EEG) data or functional magnetic resonance imaging (fMRI) has been widely studied and applied. In contrast, functional near infrared spectroscopy (fNIRS) has become a new technique in NF research in recent years. fNIRS is a neuroimaging technology based on hemodynamics, which has the advantages of low cost, good portability and high spatial resolution, and is more suitable for use in natural environments. At present, there is a lack of comprehensive review on fNIRS-NF technology (fNIRS-NF) in China. In order to provide a reference for the research of fNIRS-NF technology, this paper first describes the principle, key technologies and applications of fNIRS-NF, and focuses on the application of fNIRS-NF. Finally, the future development trend of fNIRS-NF is prospected and summarized. In conclusion, this paper summarizes fNIRS-NF technology and its application, and concludes that fNIRS-NF technology has potential practicability in neurological diseases and related fields. fNIRS can be used as a good method for NF training. This paper is expected to provide reference information for the development of fNIRS-NF technology.
The effective classification of multi-task motor imagery electroencephalogram (EEG) is helpful to achieve accurate multi-dimensional human-computer interaction, and the high frequency domain specificity between subjects can improve the classification accuracy and robustness. Therefore, this paper proposed a multi-task EEG signal classification method based on adaptive time-frequency common spatial pattern (CSP) combined with convolutional neural network (CNN). The characteristics of subjects' personalized rhythm were extracted by adaptive spectrum awareness, and the spatial characteristics were calculated by using the one-versus-rest CSP, and then the composite time-domain characteristics were characterized to construct the spatial-temporal frequency multi-level fusion features. Finally, the CNN was used to perform high-precision and high-robust four-task classification. The algorithm in this paper was verified by the self-test dataset containing 10 subjects (33 ± 3 years old, inexperienced) and the dataset of the 4th 2018 Brain-Computer Interface Competition (BCI competition Ⅳ-2a). The average accuracy of the proposed algorithm for the four-task classification reached 93.96% and 84.04%, respectively. Compared with other advanced algorithms, the average classification accuracy of the proposed algorithm was significantly improved, and the accuracy range error between subjects was significantly reduced in the public dataset. The results show that the proposed algorithm has good performance in multi-task classification, and can effectively improve the classification accuracy and robustness.
Aiming at the problem of low recognition accuracy of motor imagery electroencephalogram signal due to individual differences of subjects, an individual adaptive feature representation method of motor imagery electroencephalogram signal is proposed in this paper. Firstly, based on the individual differences and signal characteristics in different frequency bands, an adaptive channel selection method based on expansive relevant features with label F (ReliefF) was proposed. By extracting five time-frequency domain observation features of each frequency band signal, ReliefF algorithm was employed to evaluate the effectiveness of the frequency band signal in each channel, and then the corresponding signal channel was selected for each frequency band. Secondly, a feature representation method of common space pattern (CSP) based on fast correlation-based filter (FCBF) was proposed (CSP-FCBF). The features of electroencephalogram signal were extracted by CSP, and the best feature sets were obtained by using FCBF to optimize the features, so as to realize the effective state representation of motor imagery electroencephalogram signal. Finally, support vector machine (SVM) was adopted as a classifier to realize identification. Experimental results show that the proposed method in this research can effectively represent the states of motor imagery electroencephalogram signal, with an average identification accuracy of (83.0±5.5)% for four types of states, which is 6.6% higher than the traditional CSP feature representation method. The research results obtained in the feature representation of motor imagery electroencephalogram signal lay the foundation for the realization of adaptive electroencephalogram signal decoding and its application.
Control at beyond-visual ranges is of great significance to animal-robots with wide range motion capability. For pigeon-robots, such control can be done by the way of onboard preprogram, but not constitute a closed-loop yet. This study designed a new control system for pigeon-robots, which integrated the function of trajectory monitoring to that of brain stimulation. It achieved the closed-loop control in turning or circling by estimating pigeons’ flight state instantaneously and the corresponding logical regulation. The stimulation targets located at the formation reticularis medialis mesencephali (FRM) in the left and right brain, for the purposes of left- and right-turn control, respectively. The stimulus was characterized by the waveform mimicking the nerve cell membrane potential, and was activated intermittently. The wearable control unit weighted 11.8 g totally. The results showed a 90% success rate by the closed-loop control in pigeon-robots. It was convenient to obtain the wing shape during flight maneuver, by equipping a pigeon-robot with a vivo camera. It was also feasible to regulate the evolution of pigeon flocks by the pigeon-robots at different hierarchical level. All of these lay the groundwork for the application of pigeon-robots in scientific researches.
Steady-state visual evoked potential (SSVEP) has been widely used in the research of brain-computer interface (BCI) system in recent years. The advantages of SSVEP-BCI system include high classification accuracy, fast information transform rate and strong anti-interference ability. Most of the traditional researches induce SSVEP responses in low and middle frequency bands as control signals. However, SSVEP in this frequency band may cause visual fatigue and even induce epilepsy in subjects. In contrast, high-frequency SSVEP-BCI provides a more comfortable and natural interaction despite its lower amplitude and weaker response. Therefore, it has been widely concerned by researchers in recent years. This paper summarized and analyzed the related research of high-frequency SSVEP-BCI in the past ten years from the aspects of paradigm and algorithm. Finally, the application prospect and development direction of high-frequency SSVEP were discussed and prospected.