Medical image fusion realizes advantage integration of functional images and anatomical images. This article discusses the research progress of multi-model medical image fusion at feature level. We firstly describe the principle of medical image fusion at feature level. Then we analyze and summarize fuzzy sets, rough sets, D-S evidence theory, artificial neural network, principal component analysis and other fusion methods' applications in medical image fusion and get summery. Lastly, we in this article indicate present problems and the research direction of multi-model medical images in the future.
Brain-computer interaction (BCI) is a transformative human-computer interaction, which aims to bypass the peripheral nerve and muscle system and directly convert the perception, imagery or thinking activities of cranial nerves into actions for further improving the quality of human life. Magnetoencephalogram (MEG) measures the magnetic field generated by the electrical activity of neurons. It has the unique advantages of non-contact measurement, high temporal and spatial resolution, and convenient preparation. It is a new BCI driving signal. MEG-BCI research has important brain science significance and potential application value. So far, few documents have elaborated the key technical issues involved in MEG-BCI. Therefore, this paper focuses on the key technologies of MEG-BCI, and details the signal acquisition technology involved in the practical MEG-BCI system, the design of the MEG-BCI experimental paradigm, the MEG signal analysis and decoding key technology, MEG-BCI neurofeedback technology and its intelligent method. Finally, this paper also discusses the existing problems and future development trends of MEG-BCI. It is hoped that this paper will provide more useful ideas for MEG-BCI innovation research.
Feature extraction is a very crucial step in P300-based brain-computer interface (BCI) and independent component analysis (ICA) is a suitable P300 feature extraction method. But at present the convergence performance of the general ICA iteration methods are not very satisfactory. In this paper, a method based on quantum particle swarm optimizer (QPSO) algorithm and ICA technique is put forward for P300 extraction. In this method, quantum computing is used to impel ICA iteration to globally converge faster. It achieved the purpose of extracting P300 rapidly and efficiently. The method was tested on two public datasets of BCI Competition Ⅱ and Ⅲ, and a simple linear classifier was employed to classify the extracted P300 features. The recognition accuracy reached 94.4% with 15 times averaged. The results showed that the proposed method could extract P300 rapidly and the extraction effect did not reduce. It provides an experimental basis for further study of real-time BCI system.
Inferior myocardial infarction is an acute ischemic heart disease with high mortality, which is easy to induce life-threatening complications such as arrhythmia, heart failure and cardiogenic shock. Therefore, it is of great clinical value to carry out accurate and efficient early diagnosis of inferior myocardial infarction. Electrocardiogram is the most sensitive means for early diagnosis of inferior myocardial infarction. This paper proposes a method for detecting inferior myocardial infarction based on densely connected convolutional neural network. The method uses the original electrocardiogram (ECG) signals of serially connected Ⅱ, Ⅲ and aVF leads as the input of the model and extracts the robust features of the ECG signals by using the scale invariance of the convolutional layers. The characteristic transmission of ECG signals is enhanced by the dense connectivity between different layers, so that the network can automatically learn the effective features with strong robustness and high recognition, so as to achieve accurate detection of inferior myocardial infarction. The Physikalisch Technische Bundesanstalt diagnosis public ECG database was used for verification. The accuracy, sensitivity and specificity of the model reached 99.95%, 100% and 99.90%, respectively. The accuracy, sensitivity and specificity of the model are also over 99% even though the noise exists. Based on the results of this study, it is expected that the method can be introduced in the clinical environment to help doctors quickly diagnose inferior myocardial infarction in the future.
The feature extraction and feature selection are the important issues in pattern recognition. Based on the geometric algebra representation of vector, a new feature extraction method using blade coefficient of geometric algebra was proposed in this study. At the same time, an improved differential evolution (DE) feature selection method was proposed to solve the elevated high dimension issue. The simple linear discriminant analysis was used as the classifier. The result of the 10-fold cross-validation (10 CV) classification of public breast cancer biomedical dataset was more than 96% and proved superior to that of the original features and traditional feature extraction method.
Takayasu arteritis (TA) is a chronic nonspecific inflammation that commonly occurs in the aorta and its main branches. Most patients with TA are lack of clinical manifestations, leading to misdiagnosis. When the TA is correctly diagnosed, the patients may already have stenosis or occlusion in the involved arteries, resulting in arterial ischemia and hypoxia symptoms, and in severe cases it will be life-threatening. Contrast-enhanced ultrasonography (CEUS) is an emerging method for assessing TA, but the assessment relies heavily on experiences of radiologists performing manual and qualitative analyses, so the diagnostic results are often not accurate. To overcome this limitation, this paper presents a computer-assisted quantitative analysis of TA carotid artery lesions based on CEUS. First, the TA lesion was outlined on the carotid wall, and one homogeneous rectangle and one polygon were selected as two reference regions in the carotid lumen. The temporal and spatial features of the lesion region and the reference regions were then calculated. Furthermore, the difference and ratio of the features between the lesion and the reference regions were computed as new features (to eliminate interference factors). Finally, the correlation was analyzed between the CEUS features and inflammation biomarkers consisting of erythrocyte sedimentation rate (ESR) and C-reactive protein (CRP). The data in this paper were collected from 34 TA patients in Zhongshan Hospital undergoing CEUS examination with a total of thirty-seven carotid lesions, where two patients were with two lesions before and after treatment and one patient was with left and right bilateral lesions. Among these patients, 13 were untreated primary patients with a total of 14 lesions, where one patient was with bilateral lesions. The results showed that for all patients, the neovascularization area ratio in the 1/3 inner region of a lesion (ARi1/3) achieved a correlation coefficient (r) of 0.56 (P=0.001) with CRP, and for the primary patients, the neovascularization area ratio in the 1/2 inner region of a lesion (ARi1/2) had an r-value of 0.76 (P=0.001) with CRP. This study indicates that the proposed computer-assisted method can objectively and semi-automatically extract quantitative features from CEUS images, so as to reduce the effect on diagnosis due to subjective experiences of the radiologists, and thus it is expected to be used for clinical diagnosis and severity evaluation of TA carotid lesions.
Brain-computer interface (BCI) provides a direct communicating and controlling approach between the brain and surrounding environment, which attracts a wide range of interest in the fields of brain science and artificial intelligence. It is a core to decode the electroencephalogram (EEG) feature in the BCI system. The decoding efficiency highly depends on the feature extraction and feature classification algorithms. In this paper, we first introduce the commonly-used EEG features in the BCI system. Then we introduce the basic classical algorithms and their advanced versions used in the BCI system. Finally, we present some new BCI algorithms proposed in recent years. We hope this paper can spark fresh thinking for the research and development of high-performance BCI system.
Emotion plays an important role in people's cognition and communication. By analyzing electroencephalogram (EEG) signals to identify internal emotions and feedback emotional information in an active or passive way, affective brain-computer interactions can effectively promote human-computer interaction. This paper focuses on emotion recognition using EEG. We systematically evaluate the performance of state-of-the-art feature extraction and classification methods with a public-available dataset for emotion analysis using physiological signals (DEAP). The common random split method will lead to high correlation between training and testing samples. Thus, we use block-wise K fold cross validation. Moreover, we compare the accuracy of emotion recognition with different time window length. The experimental results indicate that 4 s time window is appropriate for sampling. Filter-bank long short-term memory networks (FBLSTM) using differential entropy features as input was proposed. The average accuracy of low and high in valance dimension, arousal dimension and combination of the four in valance-arousal plane is 78.8%, 78.4% and 70.3%, respectively. These results demonstrate the advantage of our emotion recognition model over the current studies in terms of classification accuracy. Our model might provide a novel method for emotion recognition in affective brain-computer interactions.
The clinical manifestations of patients with schizophrenia and patients with depression not only have a certain similarity, but also change with the patient's mood, and thus lead to misdiagnosis in clinical diagnosis. Electroencephalogram (EEG) analysis provides an important reference and objective basis for accurate differentiation and diagnosis between patients with schizophrenia and patients with depression. In order to solve the problem of misdiagnosis between patients with schizophrenia and patients with depression, and to improve the accuracy of the classification and diagnosis of these two diseases, in this study we extracted the resting-state EEG features from 100 patients with depression and 100 patients with schizophrenia, including information entropy, sample entropy and approximate entropy, statistical properties feature and relative power spectral density (rPSD) of each EEG rhythm (δ, θ, α, β). Then feature vectors were formed to classify these two types of patients using the support vector machine (SVM) and the naive Bayes (NB) classifier. Experimental results indicate that: ① The rPSD feature vector P performs the best in classification, achieving an average accuracy of 84.2% and a highest accuracy of 86.3%; ② The accuracy of SVM is obviously better than that of NB; ③ For the rPSD of each rhythm, the β rhythm performs the best with the highest accuracy of 76%; ④ Electrodes with large feature weight are mainly concentrated in the frontal lobe and parietal lobe. The results of this study indicate that the rPSD feature vector P in conjunction with SVM can effectively distinguish depression and schizophrenia, and can also play an auxiliary role in the relevant clinical diagnosis.
Due to the sparsity of brain encoding, the neural ensemble signals recorded by microelectrode arrays contain a lot of noise and redundant information, which could reduce the stability and precision of decoding of motion intent. To solve this problem, we proposed a decoding method based on partial least squares (PLS) feature extraction in our study. Firstly, we extracted the features of spike signals using the PLS, and then classified them with support vector machine (SVM) classifier, and decoded them for motion intent. In this study, we decoded neural ensemble signals based on plus-maze test. The results have shown that the proposed method had a better stability and higher decoding accuracy, due to the PLS combined with classification model which overcame the shortcoming of PLS regression that was easily affected by accumulated effect of noise. Meanwhile, the PLS method extracted fewer features with more useful information in comparison with common feature extraction method. The decoding accuracy of real data sets were 93.59%, 84.00% and 83.59%, respectively.