An Event-Related Potential Recognition Method Based on Convolutional Neural Network and Support Vector Machine[J]. 2021, 55(12): 47-54.
DOI:
An Event-Related Potential Recognition Method Based on Convolutional Neural Network and Support Vector Machine[J]. 2021, 55(12): 47-54.DOI: 10.7652/xjtuxb202112006.
An Event-Related Potential Recognition Method Based on Convolutional Neural Network and Support Vector Machine
In view of the difficulties in identifying the event-related potential(ERP)signals due to their characteristics of strong individual differences
and the overfitting problem of traditional convolutional neural network(CNN)for small samples
based on a fusion model of CNN and support vector machine(SVM)
a CNN and SVM combined classifier for ERP signal classification and recognition is proposed. This method takes the filtered original multi-channel ERP signals as input. Firstly
a one-dimensional time convolution kernel is used to convolve the time domain of the signals
then the spatial convolution is performed by using a one-dimensional spatial convolution kernel to learn features from temporal and spatial information of signals. Finally
the training of the CNN model is accomplished by such operations as down-sampling and full connection. After that
the signals are imported into the trained model again to extract the down-sampling layer features of the signals
and SVM is finally used to classify and identify the features. Classification results show that the proposed combined classifier can effectively recognize the P300 signal component under a small number of repeated visual stimuli. The average recognition accuracy of the proposed method is 94.08% after the repetition of more than four times of visual stimuli
and it has an average accuracy improvement of 4.36% compared with the traditional CNN method. Compared with the classical algorithms of stepwise linear discriminant analysis(SWLDA)and Bayesian linear discriminant analysis(BLDA)
the average recognition accuracy of the combined classifier is improved by 6.83% and 4.16%
respectively. The combined classifier only needs a small number of repeated experiments to obtain higher target recognition accuracy
and effectively improves the recognition effect of ERP signals.
关键词
Keywords
references
MCFARLAND D J, WOLPAW J R. Brain-computer interfaces for communication and control [J]. Communications of the ACM, 2011, 54(5): 60-66.
WANG Yijun, NAKANISHI M, ZHANG Dan. EEG-based brain-computer interfaces [J]. Advances in Experimental Medicine and Biology, 2019, 1101: 41-65.
CHEN Zelong, XIE Kangning. Analysis and classification method based on EEG signal [J]. Chinese Medical Equipment, 2019, 16(12): 151-158.
KUNDU S, ARI S. P300 based character recognition using convolutional neural network and support vector machine [J]. Biomedical Signal Processing and Control, 2020, 55: 1-7.
MA Ye, JIANG Guangping, CHANG Tanqing, et al. Research on feature extraction and classification of P300 EEG signals [EB/OL]. [2021-01-10]. https:∥www.atlantis-press.com/proceedings/eame-17/25875 750.
KAPER M, MEINICKE P, LINGNER T, et al. Support vector machines for the P300 speller paradigm [J]. IEEE Transactions on Biomedical Engineering, 2004, 51(6): 1073-1076.
ORALHAN Z. 2 Stages-region-based P300 speller in brain-computer interface [J]. IEEE Journal of Research, 2019, 65(6): 740-748.
LABIB E, FOUAD I A, MAI S M, et al. Multiple classify-cation techniques toward a robust and reliable P300 BCI system [J]. Biomedical Engineering: Applications, Basis and Communications, 2020, 32(2): 63-71.
CAO Shuai, WU Wei. Event related potential classifi-cation based on xDAWN and noise reduction self-encoder [J]. Chinese Scientific Paper, 2018, 13(24): 2829-2833.
WANG Z, HEALY G, SMEATON A F, et al. Spatial filtering pipeline evaluation of cortically coupled computer vision system for rapid serial visual presentation [J]. Brain Computer Interfaces, 2018, 5(4): 132-145.
DU Guangjing, XIE Jun, ZHANG Yubin, et al. A deep learning method for target recognition in steady-state visual evoked potential-based brain-computer interface [J]. Journal of Xi'an Jiaotong University, 2019, 53(11): 42-48.
CECOTTI H, GRASER A. Convolutional neural net-works for P300 detection with application to brain computer interfaces [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(3): 433-445.
LIU Mingfei, WU Wei, GU Zhenghui, et al. Deep learning based on batch normalization for P300 signal detection [J]. Neurocomputing, 2017, 275: 288-297.
SZEGEDY C, VANHOUCKE V, IOFFE S, et al. Rethinking the inception architecture for computer vision [C]∥Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, NJ, USA: IEEE, 2016: 2818-2826.
HUANG Xiaoxi, LI Hanyu, WANG Rongbo, et al. Metaphor recognition based on convolutional neural network and SVM classifier [J]. Data Analysis and Knowledge Discovery, 2018, 2(10): 77-83.
LECUN Y, BOTTOU L, BENGIO Y, et al. Gradient-based learning applied to document recognition [J]. Proceedings of the IEEE, 1998, 86(11): 2278-2324.
SAMUEL S, PATRICIA T, JOSEPH Z, et al. Infor-mation delivery and the sensory evoked potential [J]. Science, 1967, 155(3768): 1436-1439.
BLANKERTZ B. BCI competition III webpage [EB/OL]. [2021-01-10]. http: ∥www.bbci.de/competition/iii/desc_II.pdf.
BLANKERTZ B. BCI competition II webpage [EB/OL]. [2020-12-15]. http: ∥www.bbci.de/competition/ii/albany_desc/abbany_desc_ii.pdf.
CLERC M. Brain computer interfaces, principles and practise [J]. Biomedical Engineering Online, 2013, 12(1): 1-4.