Volume 16 Number 3
June 2019
Article Contents
Bing-Tao Zhang, Xiao-Peng Wang, Yu Shen and Tao Lei. Dual-modal Physiological Feature Fusion-based Sleep Recognition Using CFS and RF Algorithm. International Journal of Automation and Computing, vol. 16, no. 3, pp. 286-296, 2019. doi: 10.1007/s11633-019-1171-1
Cite as: Bing-Tao Zhang, Xiao-Peng Wang, Yu Shen and Tao Lei. Dual-modal Physiological Feature Fusion-based Sleep Recognition Using CFS and RF Algorithm. International Journal of Automation and Computing, vol. 16, no. 3, pp. 286-296, 2019. doi: 10.1007/s11633-019-1171-1

Dual-modal Physiological Feature Fusion-based Sleep Recognition Using CFS and RF Algorithm

Author Biography:
  • Bing-Tao Zhang received the M. Sc. degree in computer software and theory from Lanzhou University of Technology, China in 2011. He is currently a Ph. D. degree candidate in computer application at Lanzhou University. Since 2014, he has been a lecturer with the School of Electronic and Information Engineering, Lanzhou Jiaotong University, China. His research interests include the intersection between computer science and sleep staging, data mining, ontology-based knowledge base modeling of multimodal physiological signals. E-mail: zhangbingtao321@163.com (Corresponding author) ORCID iD: 0000-0003-3643-3580

    Xiao-Peng Wang received the Ph. D. degree in signal and information processing from Northwestern Polytechnical University, China in 2005. He has published about 80 papers in peer reviewed journals and conferences. His research interests include intelligent information processing and computer application.E-mail: wangxiaopeng@mail.lzjtu.cn

    Yu Shen received the Ph. D. degree in intelligent transportation and information system engineering from Lanzhou Jiaotong University, China in 2017. She has published about 40 papers in peer reviewed journals and conferences. Her research interests include digital image processing and communication and information system engineering. E-mail: 52588090@qq.com

    Tao Lei received the Ph. D. degree in information and communication engineering from Northwestern Polytechnical University, China in 2011. He has published about 70 papers in peer reviewed journals and conferences including Image and Vision Computing, IET Image Processing, Science China Information Sciences, Multimedia Tools and Applications, etc. His research interests include pattern recognition and artificial intelligence. E-mail: leitao@sust.edu.cn  

  • Received: 2018-04-10
  • Accepted: 2019-01-19
  • Published Online: 2019-03-11
  • Research has demonstrated a significant overlap between sleep issues and other medical conditions. In this paper, we consider mild difficulty in falling asleep (MDFA). Recognition of MDFA has the potential to assist in the provision of appropriate treatment plans for both sleep issues and related medical conditions. An issue in the diagnosis of MDFA lies in subjectivity. To address this issue, a decision support tool based on dual-modal physiological feature fusion which is able to automatically identify MDFA is proposed in this study. Special attention is given to the problem of how to extract candidate features and fuse dual-modal features. Following the identification of the optimal feature set, this study considers the correlations between each feature and class and evaluates correlations between the inter-modality features. Finally, the recognition accuracy was measured using 10-fold cross validation. The experimental results for our method demonstrate improved performance. The highest recognition rate of MDFA using the optimal feature set can reach 96.22%. Based on the results of current study, the authors will, in projected future research, develop a real-time MDFA recognition system.
  • 加载中
  • [1] K. J. Horsley, C. R. Rouleau, S. N. Garland, C. Samuels, S. G. Aggarwal, J. A. Stone, R. Arena, T. S. Campbell.  Insomnia symptoms and heart rate recovery among patients in cardiac rehabilitation[J]. Journal of Behavioral Medicine, 2016, 39(4): 642-651. doi: 10.1007/s10865-016-9725-y
    [2] M. W. Johns.  A new method for measuring daytime sleepiness: The Epworth sleepiness scale[J]. Sleep, 1991, 14(6): 540-545. doi: 10.1093/sleep/14.6.540
    [3] A. J. Stunkard, M. S. Faith, K. C. Allison.  Depression and obesity[J]. Biological Psychiatry, 2003, 54(3): 330-337. doi: 10.1016/S0006-3223(03)00608-5
    [4] E. E. Tripoliti, D. I. Fotiadis, M. Argyropoulou.  A supervised method to assist the diagnosis and monitor progression of Alzheimer′s disease using data from an fMRI experiment[J]. Artificial Intelligence in Medicine, 2011, 53(1): 35-45. doi: 10.1016/j.artmed.2011.05.005
    [5] T. P. Exarchos, A. T. Tzallas, D. Baga, D. Chaloglou, D. I. Fotiadis, S. Tsouli, M. Diakou, S. Konitsiotis.  Using partial decision trees to predict Parkinson′s symptoms: A new approach for diagnosis and therapy in patients suffering from Parkinson′s disease[J]. Computers in Biology and Medicine, 2012, 42(2): 195-204. doi: 10.1016/j.compbiomed.2011.11.008
    [6] M. M. Ohayon.  Epidemiology of insomnia: What we know and what we still need to learn[J]. Sleep Medicine Reviews, 2002, 6(2): 97-111. doi: 10.1053/smrv.2002.0186
    [7] A. Ylikoski, K. Martikainen, M. Sieminski, M. Partinen.  Sleeping difficulties and health-related quality of life in Parkinson′s disease[J]. Acta Neurologica Scandinavica, 2017, 135(4): 459-468. doi: 10.1111/ane.12620
    [8] A. Bellatorre, K. Choi, D. Lewin, D. Haynie, B. Simons-Morton. Relationships between smoking and sleep problems in black and white adolescents. Sleep, vol. 40, no. 1, Article number zsw031, 2017.
    [9] A. A. Gamaldo, J. C. Allaire, K. E. Whitfield.  The relationship between reported problems falling asleep and cognition among African American elderly[J]. Research on Aging, 2008, 30(6): 752-767. doi: 10.1177/0164027508322576
    [10] W. C. Choo, W. W. Lee, V. Venkatraman, F. S. Sheu, M. W. L. Chee.  Dissociation of cortical regions modulated by both working memory load and sleep deprivation and by sleep deprivation alone[J]. Neuroimage, 2005, 25(2): 579-587. doi: 10.1016/j.neuroimage.2004.11.029
    [11] L. Leigh, I. L. Hudson, J. E. Byles.  Sleeping difficulty, disease and mortality in older women: A latent class analysis and distal survival analysis[J]. Journal of Sleep Research, 2015, 24(6): 648-657. doi: 10.1111/jsr.12324
    [12] O. P. Almeida, H. Alfonso, B. B. Yeap, G. Hankey, L. Flicker.  Complaints of difficulty to fall asleep increase the risk of depression in later life: The health in men study[J]. Journal of Affective Disorders, 2011, 134(1–3): 208-216. doi: 10.1016/j.jad.2011.05.045
    [13] J. D. Edinger, M. H. Bonnet, R. R. Bootzin, K. Doghramji, C. M. Dorsey, C. A. Espie, A. O. Jamieson, W. V. McCall, C. M. Morin, E. J. Stepanski.  Derivation of research diagnostic criteria for insomnia: Report of an American academy of sleep medicine work group[J]. Sleep, 2004, 27(8): 1567-1596. doi: 10.1093/sleep/27.8.1567
    [14] C. M. Jung, J. M. Ronda, C. A. Czeisler, K. P. Jr.  Wright. Comparison of sustained attention assessed by auditory and visual psychomotor vigilance tasks prior to and during sleep deprivation[J]. Journal of Sleep Research, 2011, 20(2): 348-355. doi: 10.1111/j.1365-2869.2010.00877.x
    [15] S. W. Lockley, E. E. Evans, F. A. Scheer, G. C. Brainard, C. A. Czeisler, D. Aeschbach.  Short-wavelength sensitivity for the direct effects of light on alertness, vigilance, and the waking electroencephalogram in humans[J]. Sleep, 2006, 29(2): 161-168. doi: 10.1093/sleep/29.2.161
    [16] B. T. Zhang, T. Lei, H. Liu, H. S. Cai. EEG-based automatic sleep staging using ontology and weighting feature analysis. Computational and Mathematical Methods in Medicine, vol. 2018, Article number 6534041, 2018.
    [17] S. Kinreich, I. Podlipsky, S. Jamshy, N. Intrator, T. Hendler.  Neural dynamics necessary and sufficient for transition into pre-sleep induced by EEG neurofeedback[J]. Neuroimage, 2014, 97(): 19-28. doi: 10.1016/j.neuroimage.2014.04.044
    [18] W. Dement, N. Kleitman.  Cyclic variations in EEG during sleep and their relation to eye movements, body motility, and dreaming[J]. Electroencephalography and Clinical Neurophysiology, 1957, 9(4): 673-690. doi: 10.1016/0013-4694(57)90088-3
    [19] S. F. Liang, C. E. Kuo, F. Z. Shaw, Y. H. Chen, C. H. Hsu, J. Y. Chen.  Combination of expert knowledge and a genetic fuzzy inference system for automatic sleep staging[J]. IEEE Transactions on Biomedical Engineering, 2016, 63(10): 2108-2118. doi: 10.1109/TBME.2015.2510365
    [20] O. Tsinalis, P. M. Matthews, Y. K. Guo.  Automatic sleep stage scoring using time-frequency analysis and stacked sparse autoencoders[J]. Annals of Biomedical Engineering, 2016, 44(5): 1587-1597. doi: 10.1007/s10439-015-1444-y
    [21] B. Sen, M. Peker, A. Cavusoglu, F. V. Celebi.  A comparative study on classification of sleep stage based on EEG signals using feature selection and classification algorithms[J]. Journal of Medical Systems, 2014, 38(3): 667-687. doi: 10.1007/s10916-014-0018-0
    [22] Y. L. Hsu, Y. T. Yang, J. S. Wang, C. Y. Hsu.  Automatic sleep stage recurrent neural classifier using energy features of EEG signals[J]. Neurocomputing, 2013, 104(): 105-114. doi: 10.1016/j.neucom.2012.11.003
    [23] S. F. Liang, C. E. Kuo, Y. H. Hu, Y. H. Pan, Y. H. Wang.  Automatic stage scoring of single-channel sleep EEG by using multiscale entropy and autoregressive models[J]. IEEE Transactions on Instrumentation and Measurement, 2012, 61(6): 1649-1657. doi: 10.1109/TIM.2012.2187242
    [24] H. Akaike.  Fitting autoregressive models for prediction[J]. Annals of the Institute of Statistical Mathematics, 1969, 21(1): 243-247. doi: 10.1007/BF02532251
    [25] I. J. Rampil.  A primer for EEG signal processing in anesthesia[J]. Anesthesiology, 1998, 89(4): 980-1002. doi: 10.1097/00000542-199810000-00023
    [26] T. Cecchin, R. Ranta, L. Koessler, O. Caspary, H. Vespignani, L. Maillard.  Seizure lateralization in scalp EEG using Hjorth parameters[J]. Clinical Neurophysiology, 2010, 121(3): 290-300. doi: 10.1016/j.clinph.2009.10.033
    [27] Z. Y. Huang, H. Y. Zhu, J. T. Zhou, X. Peng. Multiple marginal fisher analysis. IEEE Transactions on Industrial Electronics, to be published.
    [28] T. Lei, X. H. Jia, Y. N. Zhang, L. F. He, H. Y. Meng, A. K. Nandi.  Significantly fast and robust fuzzy C-means clustering algorithm based on morphological reconstruction and membership filtering[J]. IEEE Transactions on Fuzzy Systems, 2018, 26(5): 3027-3041. doi: 10.1109/TFUZZ.2018.2796074
    [29] M. A. Hall. Correlation-based Feature Selection for Machine Learning, Ph. D. dissertation, The University of Waikato, New Zealand, 1999.
    [30] A. Cutler, D. R. Cutler, J. R. Stevens. Random forests. In Ensemble Machine Learning, C. Zhang, Y. Q. Ma, Eds., Boston, USA: Springer, pp. 157–176, 2004.
    [31] S. Lee. Using Weka in Matlab, [Online], Available: https://cn.mathworks.com/matlabcentral/fileexchange/50120-using-weka-in-matlab, January 20, 2019.
    [32] L. Fraiwan, K. Lweesy, N. Khasawneh, H. Wenz, H. Dickhaus.  Automated sleep stage identification system based on time-frequency analysis of a single EEG channel and random forest classifier[J]. Computer Methods and Programs in Biomedicine, 2012, 108(1): 10-19. doi: 10.1016/j.cmpb.2011.11.005
    [33] A. L. Goldberger, L. A. N. Amaral, L. Glass, J. M. Hausdorff, P. C. Ivanov, R. G. Mark, J. E. Mietus, G. B. Moody, C. K. Peng, H. E. Stanley.  PhysioBank, physiotoolkit, and physionet: Components of a new research resource for complex physiologic signals[J]. Circulation, 2000, 101(23): E215-E220.
    [34] L. Zoubek, S. Charbonnier, S. Lesecq, A. Buguet, F. Chapotot.  Feature selection for sleep/wake stages classification using data driven methods[J]. Biomedical Signal Processing and Control, 2007, 2(3): 171-179. doi: 10.1016/j.bspc.2007.05.005
    [35] S. A. Imtiaz, Z. Jiang, E. Rodriguez-Villegas.  An ultralow power system on chip for automatic sleep staging[J]. IEEE Journal of Solid-State Circuits, 2017, 52(3): 822-833. doi: 10.1109/JSSC.2017.2647923
    [36] M. Diykh, Y. Li.  Complex networks approach for EEG signal sleep stages classification[J]. Expert Systems with Applications, 2016, 63(): 241-248. doi: 10.1016/j.eswa.2016.07.004
    [37] J. A. Hobson. A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects: A. Rechtschaffen and A. Kales (Editors). Electroencephalography and Clinical Neurophysiology, vol. 26, no. 6, Article number 644, 1969.
    [38] C. Iber, S. Ancoli-Israel, A. L. Jr. Chesson, S. F. Quan. The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications, Westchester, USA: American Academy of Sleep Medicine, 2007.
    [39] I. Kononenko. Estimating attributes: Analysis and extensions of RELIEF. In Proceedings of European Conference on Machine Learning on Machine Learning, Springer, Catania, Italy, pp. 171–182, 1994.
    [40] J. Tang, S. Alelyani, H. Liu.  Feature selection for classification: A review[J]. Data Classification: Algorithms and Applications, 2014, 98(7): 313-334.
    [41] M. Schwartz, M. Park, J. H. Phan, M. D. Wang. Integration of multimodal RNA-seq data for prediction of kidney cancer survival. In Proceedings of IEEE International Conference on Bioinformatics and Biomedicine, Washington, USA, pp. 1591–1595, 2015.
    [42] M. Goudjil, M. Koudil, M. Bedda, N. Ghoggali.  A novel active learning method using SVM for text classification[J]. International Journal of Automation and Computing, 2018, 15(3): 290-298. doi: 10.1007/s11633-015-0912-z
    [43] C. L. Zhang, Y. P. Xu, Z. J. Xu, J. He, J. Wang, J. H. Adu.  A fuzzy neural network based dynamic data allocation model on heterogeneous multi-GPUs for large-scale computations[J]. International Journal of Automation and Computing, 2018, 15(2): 181-193. doi: 10.1007/s11633-018-1120-4
    [44] M. L. Green, P. D. Karp. A Bayesian method for identifying missing enzymes in predicted metabolic pathway databases. BMC Bioinformatics, vol. 5, Article number 76, 2004.
    [45] A. A. B. Subramanian, S. Pramala, B. Rajalakshmi, R. Rajaram.  Improving decision tree performance by exception handling[J]. International Journal of Automation and Computing, 2010, 7(3): 372-380. doi: 10.1007/s11633-010-0517-5
    [46] X. W. Zhang, B. Hu, X. Ma, L. X. Xu.  Resting-state whole-brain functional connectivity networks for MCI classification using L2-regularized logistic regression[J]. IEEE Transactions on Nanobioscience, 2015, 14(2): 237-247. doi: 10.1109/TNB.2015.2403274
    [47] H. Y. Zhu, R. Vial, S. J. Lu, X. Peng, H. Z. Fu, Y. H. Tian, X. B. Cao.  Yotube: Searching action proposal via recurrent and static regression networks[J]. IEEE Transactions on Image Processing, 2018, 27(6): 2609-2622. doi: 10.1109/TIP.2018.2806279
    [48] M. Shahin, B. Ahmed, S. T. B. Hamida, F. L. Mulaffer, M. Glos, T. Penzel.  Deep learning and insomnia: Assisting clinicians with their diagnosis[J]. IEEE Journal of Biomedical and Health Informatics, 2017, 21(6): 1546-1553. doi: 10.1109/JBHI.2017.2650199
    [49] M. Shahin, L. Mulaffer, B. Ahmed. Two Stages Approach for Automatic Detection of Sleep Insomnia, [Online], Available: https://www.researchgate.net/publication/ 324330830_Two_Stages_Approach_for_Automatic_Detection_of_Sleep_Insomnia, 2018.
    [50] B. Hu, D. Majoe, M. Ratcliffe, Y. B. Qi, Q. L. Zhao, H. Peng, D. P. Fan, F. Zheng, M. Jackson, P. Moore.  EEG-based cognitive interfaces for ubiquitous applications: Developments and challenges[J]. IEEE Intelligent Systems, 2011, 26(5): 46-53. doi: 10.1109/MIS.2011.58
  • 加载中
  • [1] Senuri De Silva, Sanuwani Dayarathna, Gangani Ariyarathne, Dulani Meedeniya, Sampath Jayarathna, Anne M. P. Michalek. Computational Decision Support System for ADHD Identification . International Journal of Automation and Computing, 2020, 17(): 1-23.  doi: 10.1007/s11633-020-1252-1
    [2] Snehasis Banerjee, Tanushyam Chattopadhyay, Utpal Garain. A Wide Learning Approach for Interpretable Feature Recommendation for 1-D Sensor Data in IoT Analytics . International Journal of Automation and Computing, 2019, 16(6): 800-811.  doi: 10.1007/s11633-019-1185-8
    [3] Deepanshu Srivastava, Venkateswara Rao Komma. Development of STEP AP224 Extractor for Interfacing Feature Based CAPP to STEP-NC (AP238) . International Journal of Automation and Computing, 2019, 16(5): 655-670.  doi: 10.1007/s11633-018-1144-9
    [4] Ao-Xue Li, Ke-Xin Zhang, Li-Wei Wang. Zero-shot Fine-grained Classification by Deep Feature Learning with Semantics . International Journal of Automation and Computing, 2019, 16(5): 563-574.  doi: 10.1007/s11633-019-1177-8
    [5] Huan Liu, Gen-Fu Xiao, Yun-Lan Tan, Chun-Juan Ouyang. Multi-source Remote Sensing Image Registration Based on Contourlet Transform and Multiple Feature Fusion . International Journal of Automation and Computing, 2019, 16(5): 575-588.  doi: 10.1007/s11633-018-1163-6
    [6] Bitla Venu, Venkateswara Rao Komma, Deepanshu Srivastava. STEP-based Feature Recognition System for B-spline Surface Features . International Journal of Automation and Computing, 2018, 15(4): 500-512.  doi: 10.1007/s11633-018-1116-0
    [7] Zhi-Heng Wang, Chao Guo, Hong-Min Liu, Zhan-Qiang Huo. MFSR: Maximum Feature Score Region-based Captions Locating in News Video Images . International Journal of Automation and Computing, 2018, 15(4): 454-461.  doi: 10.1007/s11633-015-0943-5
    [8] Qi-Guo Rong,  Shuang Ren,  Qi-Hong Li. Numerical Study on the Effect of Nerve Control on Upper Airway Collapse in Obstructive Sleep Apnea . International Journal of Automation and Computing, 2016, 13(2): 117-124.  doi: 10.1007/s11633-015-0933-7
    [9] Zhi-Heng Wang, Qin-Feng Song, Hong-Min Liu, Zhan-Qiang Huo. Absence Importance and Its Application to Feature Detection and Matching . International Journal of Automation and Computing, 2016, 13(5): 480-490.  doi: 10.1007/s11633-015-0925-7
    [10] De-Rong Liu,  Hong-Liang,  Li Ding Wang. Feature Selection and Feature Learning for High-dimensional Batch Reinforcement Learning: A Survey . International Journal of Automation and Computing, 2015, 12(3): 229-242.  doi: 10.1007/s11633-015-0893-y
    [11] Danasingh Asir Antony Gnana Singh,  Subramanian Appavu Alias Balamurugan,  Epiphany Jebamalar Leavline. An Unsupervised Feature Selection Algorithm with Feature Ranking for Maximizing Performance of the Classifiers . International Journal of Automation and Computing, 2015, 12(5): 511-517.  doi: 10.1007/s11633-014-0859-5
    [12] Nongnuch Poolsawad,  Lisa Moore,  Chandrasekhar Kambhampati. Issues in the Mining of Heart Failure Datasets . International Journal of Automation and Computing, 2014, 11(2): 162-179.  doi: 10.1007/s11633-014-0778-5
    [13] Huan Liu,  Ying Xiao,  Wei-Dong Tang,  Yan-Hui Zhou. Illumination-robust and Anti-blur Feature Descriptors for Image Matching in Abdomen Reconstruction . International Journal of Automation and Computing, 2014, 11(5): 469-479.  doi: 10.1007/s11633-014-0829-y
    [14] Li Wang,  Rui-Feng Li,  Ke Wang,  Jian Chen. Feature Representation for Facial Expression Recognition Based on FACS and LBP . International Journal of Automation and Computing, 2014, 11(5): 459-468.  doi: 10.1007/s11633-014-0835-0
    [15] R. I. Minu,  K. K. Thyagharajan. Semantic Rule Based Image Visual Feature Ontology Creation . International Journal of Automation and Computing, 2014, 11(5): 489-499.  doi: 10.1007/s11633-014-0832-3
    [16] Alamelu Mangai, Santhosh Kumar, S. Appavu alias Balamurugan. A Novel Feature Selection Framework for Automatic Web Page Classification . International Journal of Automation and Computing, 2012, 9(4): 442-448.  doi: 10.1007/s11633-012-0665-x
    [17] Subramanian Appavu Alias Balamurugan, Ramasamy Rajaram. Effective and Efficient Feature Selection for Large-scale Data Using Bayes’ Theorem . International Journal of Automation and Computing, 2009, 6(1): 62-71.  doi: 10.1007/s11633-009-0062-2
    [18] Xiang-Yang Wang, Jun Wu. A Feature-based Robust Digital Image Watermarking Against Desynchronization Attacks . International Journal of Automation and Computing, 2007, 4(4): 428-432.  doi: 10.1007/s11633-007-0428-2
    [19] Eng Siong Chng, Sheng Chen. Determining the Optimal Decision Delay Parameter for a Linear Equalizer . International Journal of Automation and Computing, 2005, 2(1): 20-24.  doi: 10.1007/s11633-005-0020-6
    [20] Alexander Ferworn,  Ankit Arora,  Muhammad Jaseemuddin. IP Mobility Issues for a Mobile Tele-Robotic System-NEPWAK . International Journal of Automation and Computing, 2004, 1(1): 10-16.  doi: 10.1007/s11633-004-0010-0
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Figures (6)  / Tables (6)


Abstract Views (938) PDF downloads (26) Citations (0)

Dual-modal Physiological Feature Fusion-based Sleep Recognition Using CFS and RF Algorithm

Abstract: Research has demonstrated a significant overlap between sleep issues and other medical conditions. In this paper, we consider mild difficulty in falling asleep (MDFA). Recognition of MDFA has the potential to assist in the provision of appropriate treatment plans for both sleep issues and related medical conditions. An issue in the diagnosis of MDFA lies in subjectivity. To address this issue, a decision support tool based on dual-modal physiological feature fusion which is able to automatically identify MDFA is proposed in this study. Special attention is given to the problem of how to extract candidate features and fuse dual-modal features. Following the identification of the optimal feature set, this study considers the correlations between each feature and class and evaluates correlations between the inter-modality features. Finally, the recognition accuracy was measured using 10-fold cross validation. The experimental results for our method demonstrate improved performance. The highest recognition rate of MDFA using the optimal feature set can reach 96.22%. Based on the results of current study, the authors will, in projected future research, develop a real-time MDFA recognition system.

Bing-Tao Zhang, Xiao-Peng Wang, Yu Shen and Tao Lei. Dual-modal Physiological Feature Fusion-based Sleep Recognition Using CFS and RF Algorithm. International Journal of Automation and Computing, vol. 16, no. 3, pp. 286-296, 2019. doi: 10.1007/s11633-019-1171-1
Citation: Bing-Tao Zhang, Xiao-Peng Wang, Yu Shen and Tao Lei. Dual-modal Physiological Feature Fusion-based Sleep Recognition Using CFS and RF Algorithm. International Journal of Automation and Computing, vol. 16, no. 3, pp. 286-296, 2019. doi: 10.1007/s11633-019-1171-1
    • Difficulties in falling asleep (DFA) are the most common form of insomnia[1, 2] and can seriously impact general health and may be accompanied by other medical conditions such as mental health disorders (e.g., depression)[3], Alzheimer′s disease (the most common cause of dementia)[4], and Parkinson′s disease (a progressive neurological condition causing brain issues which get worse over time)[5]. The prevalence of such medical conditions represents a global healthcare crisis and the control and cure of DFA is an important component in the treatment plans.

      Significant research efforts have been made globally to address the healthcare crisis including efforts to develop effective pharmacological and behavioral treatment options for DFA. Currently, mild difficulty in falling asleep (MDFA) has often been considered as a transition phase between normal control subjects (NCs) and insomnia symptoms, especially DFA. MDFA refers to a clinical state in which individuals find difficulty in falling asleep (generally occasionally), however because this state does not significantly influence individuals′ daily lives, it is below the threshold clinical criteria for insomnia.

      DFA is experienced by approximately 33% in the general population[6]. Moreover, due to the prevalence of DFA and the distress caused to individuals, new DFA research results[7, 8] continue to emerge on a regular basis. For example, the research results of Gamaldo et al.[9] demonstrate that self-reporting of DFA may be a unique predictor of cognitive performance. Several studies (see [10]) have also suggested that DFA is negatively associated with cognition performance. Leigh et al.[11] suggest that DFA, as measured by the simple four-item Nottingham health profile (NHP) questionnaire, could be useful in clinical or nursing home settings as a simple indicator for mortality. Leigh et al.[11] also show that women (who were troubled sleepers) are at a higher risk of death than untroubled sleepers. Almeida et al.[12] have observed that DFA increases the risk of depression in older men.

      While there have been a large number of studies investigating DFA, few studies have addressed in detail the transition phase of DFA, i.e., MDFA. Since MDFA is a symptom of DFA, early accurate and effective discrimination of MDFA is crucial to warn potential patients and guide them through appropriate treatment plans to delay (or even prevent) the onset of DFA. Traditionally, clinicians diagnose MDFA by judging whether individuals meet research diagnostic criteria (RDC) of MDFA.

      The RDC for MDFA, as formulated by an American Academy of Sleep Medicine (AASM) work group, are as follows[1315]:

      1) Falling asleep takes more than 30 minutes.

      2) Complaints of daytime impairment or distress.

      3) Difficulty in falling asleep at least 2 times a week.

      4) Difficulty in falling asleep for at least 2 months.

      As can be seen from the above, clinicians diagnose MDFA are mainly based on their observation results and patient's subjective reports. Therefore, there may be difficulties in reaching an objective and accurate diagnosis for potential MDFA patients.

      Previous related research[1618] has shown that human biological signals contain considerable information about sleep, pointing to the possibility of recognizing MDFA by studying these biological signals. Usually, these biological signals are mainly include: electroencephalogram (EEG), electrooculogram (EOG), electromyogram (EMG), electrocardiogram (ECG), etc. However, research has often focused on automatic sleep staging (ASS) using physiological signals. For example, the genetic fuzzy inference system based on expert knowledge for ASS has been developed by Liang et al.[19], where eight features are used. The features (used as input variables) include temporal signals and a spectrum of physiological signals. Moreover, the fuzzy rules and the fuzzy sets were constructed based on expert knowledge. Tsinalis et al.[20] present a machine learning methodology which is based on time-frequency analysis and stacked sparse auto-encoders for ASS using a single channel of EEG. Sen et al.[21] found strong mapping connections between EEG signals and each sleep stage using minimum redundancy maximum relevance and t-test algorithm analysis.

      Despite the use of physiological signals to auto-identify sleep stage, research results have sprung up. However, the research on automatic recognition of MDFA is an under-reported area in the literature and remains an open research question. Based on this reason, the purpose of this study is to design a classification method to distinguish MDFA and NCs using physiological data. In this research, we studied the correlations between MDFA and physiological data by calculating heuristic “merit” of different subsets based on fusing physiological features to find the optimal feature subset. We then trained a random forest (RF) classifier based on the optimal feature subset and evaluated the classification performance and statistical significance of our proposed method iteratively using 10-fold cross validation. The experimental result demonstrates that correct recognition rate (CRR) for our method is 96.22%. The performance demonstrates an improvement over alternative popular classification algorithms (including K-nearest neighbors, support vector machine, neural network, Bayesian approaches, and classification trees). There are many technical terms used in this paper, for brevity and to improve readability, we list these technical terms and their abbreviations in Table 1.

      Technical termsAbbreviations
      Mild difficulty falling asleepMDFA
      Correct recognition rateCRR
      Difficulty falling asleepDFA
      Normal control subjectsNCs
      Nottingham health profileNHP
      Research diagnostic criteriaRDC
      Automatic sleep stagingASS
      Subjects experienced MDFAMDFAs
      A ranked feature listRFL

      Table 1.  Technical terms and abbreviations

      This paper is organized as follows: Section 2 provides a systematic description of the proposed MDFA recognition method. In Section 3, we describe our experimental design, experimental results, discussion and analysis in detail. Section 4 concludes the work of this paper with consideration of future directions for research. Before ending this introductory section, the main contributions and novelties of this paper are presented as follows.

      1) Fills the gaps in the area of MDFA research.

      2) Compared with the traditional fixed order auto regression (AR), our proposed adaptive AR model can extract linear candidate features more accurately.

      3) Sleep recognition scheme based on dual-modal physiological feature fusion, EEG features can effectively explore information contained in sleep data, moreover, it relies on EOG features to make up for its inadequacies.

      4) An optimal sample subset containing 16 features is obtained to identify MDFA.

      5) The study found that slow wave sleep (SWS) stage and rapid eye movement (REM) stages are the most important for the recognition of MDFAs.

      6) The experimental results of our method demonstrate improved performance, the highest recognition rate for MDFAs reaches 96.22%.

    • Raw EEG and EOG data cannot directly be used for research, therefore it is necessary to preprocess the original data.

    • The flowchart of MDFA recognition method is depicted graphically in Fig. 1. The method includes four principal functions: 1) data preprocessing, 2) candidate feature extraction, 3) dual-modal physiological feature fusion, 4) correlation-based feature selection (CFS) (exploring the optimal feature subset), 5) RF classification. The following is a detailed description of the above five functions.

      Figure 1.  Schematic diagram of our proposed method

      Raw physiological data represents a mixture of “signal” and “noise”. Data decomposition methods can help separate signal from noise data and disentangle overlapping patterns. Usually, the information of physiological signals with respect to sleep is found at frequencies between 0.5 Hz and 30 Hz[22]. All signals with frequency above 30 Hz, or below 0.5 Hz need to be removed. Thus, the authors have chosen a Butterworth bandpass filter with 0.5 – 30 Hz passband to eliminate EEG and EOG signal drifting and to remove all invalid frequencies.

    • Once invalid physiological signals are filtered (removed), linear and nonlinear analysis is performed on the physiological signals for candidate feature extraction.

      1) Linear analysis extracts linear candidate features

      a) Frequency-domain analysis

      In this study, power spectral features are obtained by adaptive auto regression (AR) modeling. The AR model is a parametric model used to describe a stationary time series. Physiological signals are typical non-stationary, thus, we adopted an adaptive AR modeling in this work. AR model used in physiological signals processing is not novel, but previous studies have used fixed order AR modeling in contrast to our adaptive AR modeling[23].

      Traditionally, fixed order AR modeling parameters can be used to determine physiological signals states. Fixed order AR modeling represents the current signal x(t) as the weighted sum of its previous values x(ti) and the uncorrelated error ε(t) as shown in (1):

      $ x\left( t \right) = \sum\limits_{i = 1}^p {{a_i}x\left( {t - i} \right) + \varepsilon \left( t \right)} $


      where ai represents the AR coefficients and p is a fixed order of model.

      In this study, the authors use Akaikes information criterion (AIC)[24] to adaptively get the best order p of AR model in each 30 s epoch. This is so that the power spectral ranges of different frequency bands can be divided more accurately. In other words, the range of delta (0.5 – 2 Hz), sawtooth (2 – 4 Hz), theta (4 – 8 Hz), alpha (8 – 12 Hz), spindle (12 – 14 Hz), and beta (14 – 30 Hz) are accurately divided. The calculating process of best order p is shown in Algorithm 1. The implementation is achieved using Matlab R2017a.

      Algorithm 1. Process of finding the best order p.

      Input: Sample size N; Input signal vector x, i.e., equal interval data column.

      for p = [1 : floor(sqrt(N))]

       [a, e] = aryule(x, p) /* e is the variance parameter */

      AIC (p) = log(e)+$2 \times\dfrac{p}{N}$


      [~, best p] = min(AIC) /* bestp is the best order p */

      Output: best p

      Finally, candidate features are obtained using frequency-domain analysis. The candidate features include: i) the absolute power of alpha, beta, theta, delta, spindle and sawtooth, ii) the relative spectral power of alpha, beta, theta, delta, spindle and sawtooth, iii) the center frequency of alpha, beta, theta, delta, spindle and sawtooth, iv) the maximum power of alpha, beta, theta, delta, spindle and sawtooth, and v) the absolute ratio of beta power to delta power, alpha power to beta power, alpha power to spindle power, theta power to alpha power, delta power to theta power, delta power to alpha power, delta power to spindle power, spindle power to beta power.

      b) Time-domain analysis

      Time domain analysis is generally used in the analysis of discrete signals. The majority of the commonly used time-domain analyses are grounded in probabilistic analysis of random signals[25]. Therefore, the authors also adopt this signal analysis method to extract candidate features such as average amplitude, variance, skewness, kurtosis. In this work, time-domain analysis method is also used to extract Hjorth parameters[26]: activity, mobility, and complexity. One of the original aims of this parameter is to solve sleep problem, such as sleep staging. Therefore, Hjorth parameters are also calculated in this study.

      2) Nonlinear dynamics analysis extracts nonlinear candidate features

      Linear analysis is the principal method used to extract candidate features. However, to raise the recognition accuracy of MDFAs, nonlinear dynamics analysis is a complementary method of extracting candidate features. Such features reflect the association between sleep activity and physiological signals. In this research, nonlinear candidate features include: C0-complexity, Shannon entropy, spectral entropy, etc.

    • Following data preprocessing, feature subset1 is obtained from dual-channel EEG, a total of 90 features (including 78 linear candidate features and 12 nonlinear candidate features) are identified. Meanwhile, feature subset2 is obtained from one channel EOG, a total of 45 features (including 39 linear candidate features and 6 nonlinear candidate features) are identified. Next, all extracted candidate features are integrated into a composite feature set, which is the fusion of subset1 and subset2. Meanwhile using a feature search method called bests first, a ranked feature list (RFL) $\left\{ {{f_1},{f_2},{f_3}, \cdots ,{f_{144}},{f_{145}}} \right\}$ is generated based on correlations between individual features and classes (i.e., MDFAs class or NCs class) from high to low. Every sample is organized in a table, where each sample is described as 135 feature attributes, and 1 class attribute.

    • Generally, there are a large number of EEG and EOG features, some of which have a negative effect on the evaluation. Using a classification algorithm to select a subset of features that best reflect different class attributes (i.e., MDFAs class or NCs class) requires the testing of all possible combination of features[27, 28]. However, this process is a very computationally expensive and time-consuming task, e.g., in this study to find the best combinations of 145 features it would need to try 2145 combinations. To avoid combinatorial explosion, the authors propose a correlation-based feature selection (CFS) approach to find optimal feature subset.

      CFS[29] is a simple filtering algorithm that ranks feature subsets according to a correlation-based heuristic evaluation function. The evaluation function bias is toward subsets that contain features that are highly correlated with the class and uncorrelated with each other. Irrelevant features should be ignored because they will have low correlation with the class. Redundant features should be screened out as they will be highly correlated with one or more of the remaining features. In this study, an optimal feature subset of 145 features is identified using the following steps (see Fig. 1) which is a schematic diagram illustrating the proposed CFS method.

      Step 1. Calculate rcf: the correlation of every feature-class, and rff: the inter-correlation of feature-feature.

      Step 2. The feature subsets $\left\{ {{f_1}} \right\}\!,\;\left\{ {{f_1},{f_2}} \right\}\!,\;\left\{ {{f_1},{f_2},{f_3}} \right\}, $$\cdots\!,\;\left\{ {{f_1},{f_2}, \cdots ,{f_{145}}} \right\}$ are then tested by (2):

      $ {M_S} = \dfrac{k \times {{\bar r}_{cf}}}{\sqrt {k + k\left( {k - 1} \right) \times {{\bar r}_{ff}}}} $


      where MS is the heuristic “merit” of a feature subset that is containing k features, k$ =1,2,\cdots,145$. ${{\bar r}_{cf}}$ is the mean feature-class correlation. ${{\bar r}_{ff}}$ is the average feature-feature inter-correlation.

      Step 3. From the results obtained in the previous step, the feature subset with the highest MS is selected. Selected feature subsets and corresponding class attributes constitute an optimal feature subset.

      The optimal feature subset will be used to reduce the feature dimension. Furthermore, it will reduce the number of features in MDFA′s recognition process.

    • Following the identification of the optimal feature subset, an inference mechanism is performed in this subset to recognize MDFAs. Generally, to ensure the accuracy, efficiency and simplicity of the algorithm, the classical algorithm and development kit should be chosen wherever possible. Based on these design considerations, the authors chose random forest (RF) algorithm[30], to recognize MDFAs, and the motivation of this choice can be summarized as follows:

      1) The RF can be run large datasets and shows a strong robustness.

      2) The RF has an effective method for estimating missing data and maintains accuracy when a part of the data is missing.

      3) RF is one of the preeminent inductive inference algorithms with the rules usually expressed by an appropriate IF-THEN logic statement.

      4) Many free open-source tool packages exist such as Matlab2Weka toolbox[31].

      In this study, the Matlab2Weka toolbox is used to implement the RF algorithm with 10-fold cross validation. Additionally, to obtain a statistically meaningful result, the number of iterations is set to 10 (see Fig. 1 data partitioning). This means that the RF classifier is called 100 times to train and test the optimal feature subset.

      The RF algorithm is an ensemble of a multitude of classification decision trees and it has been widely used in many fields including sleep research[32]. It is a type of inductive statistical classification model and measures the relationship between a categorical dependent variable and one or more independent variables using an IF-THEN logic inference. In our method, we used RF to explore the best inference model to describe the relationship between MDFAs individuals and the optimal feature subset. By putting the input optimal feature subset down to each decision tree in RF, each tree will give an inference result. The final result is the most popular class by voting from all trees. In this research, the RF algorithm is executed in three steps as follows:

      Step 1. Ten bootstrap samples are extracted from the optimal feature subset using sampling with replacement.

      Step 2. Create a classification decision tree model for each bootstrap sample.

      Start from the root node of each tree, and split bootstrap sample into different subsets according to the node attribute. The selection of node attribute and splitting criterion are based on information gain (IG) of the node attribute. The IG of splitting one data set S into subsets Si can be defined as

      $ IG = - \sum\limits_{i = 1}^c {\frac{{\left| {{S_i}} \right|}}{{\left| S \right|}}E\left( {{S_i}} \right)}. $


      In the above (3), c denotes the number of classes (here c = 2 possible test state: NCs and MDFAs) and E(Si) is the information entropy of the subset Si. It is calculated as

      $ E\left( {{S_i}} \right) = - \sum\limits_{i = 1}^c {{p_i}{{\log }_2}\left( {{p_i}} \right)} $


      where pi is the proportion of test state i in the subset Si.

      Each attribute is applied to calculate the IG, and the attribute with the highest IG is selected as the root node. This process is recursively repeated at each branch node until either every attribute is selected, or this process reaches a leaf node that is a test state output.

      Step 3. Output the results: Step 2 is repeated to build 10 trees, and the final classification output is the most frequently occurring test state out of the 10 output trees.

      Fig. 2 shows a simplified example of partial RF generating process. The example has omitted a large number of information. However, it provides a clear overview and understanding of the inference rules. A rule, with its IF-THEN structure, defines a basic fact about subject′s current test state. For example, an inference rule generation process shown as the bold in Fig. 2 can be described as the following IF-THEN structure:

      Figure 2.  A simplified example for partial RF generating process based on rules

      [IF “Fpz-Cz_Skew” < 0.09

      THEN IF Fpz-Cz_Center_Frequency_Sawthooth” ≥ 2.04

      THEN Subject = <MDFAs>]

    • The population (the subjects used in this research) were selected from the Sleep-EDF database [EXPANDED][33, 34] which contains 61 data recordings taken from 42 Caucasian subjects. This database includes dual-channel EEG [Fpz-Cz and Pz-Oz] and one horizontal EOG with all samples being at 100 Hz. In addition, samples also contain other physiological signals and peripheral data. Data used in this research includes 39 recordings from 20 NCs, and 22 recordings from 22 MDFAs. Among them, the NCs age ranged from 25 to 34 years old (male/female=10/10), and the MDFAs age ranged from 18 to 79 (male/female=7/15). For all the sleep physiological signals, EEG is the most important, because it originates from the central nervous system of the brain and can objectively assess the relationship between brain activity and sleep. Meanwhile, different sleep stages are directly reflected by different EEG bands. For example, slow wave sleep (SWS) is dominated by delta wave, non-rapid eye movement (NREM) sleep stage 1 (NREM1) is dominated by theta wave. Except EEG, the secondary is EOG. Therefore, this study only uses EEG and EOG.

      Typically, the sleep data sample period is divided into 20 s or 30 s[35, 36], in this study the sample period is fixed at 30 s. To ensure the rationality of experimental data, the sample numbers of MDFAs and NCs were almost equal. Each data record of MDFAs includes 540 samples while NCs includes 300 samples, i.e., the total number of MDFAs and NCs were 22×540 and 39×300, respectively. Statistical results are shown as Table 2.

      ClassSample numbersPercentage
      MDFAs11 88050.38 %
      NCs11 70049.62 %
      Total23 580100 %

      Table 2.  Sample statistics

    • Table 3 shows the results of the optimal feature subset, including importance level, salient channel, and feature. From Table 3, it can be seen that:

      Importance levelSalient channelFeature
      1EEG Fpz-CzDelta center frequency
      2EEG Fpz-CzSawtooth center frequency
      3EEG Fpz-CzAlpha absolute power
      4EEG Fpz-CzSkew
      5EEG Pz-OzDelta center frequency
      6EEG Pz-OzSawtooth center frequency
      7EEG Pz-OzBeta absolute power
      8EEG Pz-OzAlpha power to spindle power
      9EEG Pz-OzSkew
      10EOGDelta max power
      11EOGDelta center frequency
      12EOGSawtooth max power
      13EOGSawtooth center frequency
      14EOGTheta center frequency
      15EOGBeta absolute power

      Table 3.  Optimal feature subset

      1) The optimal feature subset contains 16 features, and the most effective feature to recognize MDFAs was derived from linear analysis methods, especially frequency-domain analysis. This conclusion indicates that linear analysis method was useful for understanding the potential sleep mechanisms of MDFAs.

      2) There was a relationship between 16 features and different frequency waves as shown in Fig. 3. As shown, the features associated with delta account for 25%, while the features associated with sawtooth, beta, alpha and theta account for 56%. It is known by R&K rules[37] or new guidelines developed by the American Academy of Sleep Medicine (AASM)[38] that slow wave sleep (SWS) was determined by delta, while rapid eye movement (REM) are determined by sawtooth, beta, alpha and theta. Thus, the authors concluded that SWS and REM stages were the most important for the recognition of MDFAs.

      Figure 3.  Relationship between 16 features and different frequency waves

      3) Some of the most effective features are derived mainly from Fpz-Cz, it indicates that the frontal area was related to MDFAs recognition.

    • In this section, a comparative analysis was conducted between the CFS+RF mechanism and other alternative strategies. Table 4 shows the results of performance comparison of different strategies for recognizing MDFAs with 10-fold cross validation. As can be seen from Table 4, to explore the optimal feature subset, we chose four typical feature selection algorithms: CFS, relief[39], information gain, and gain ratio[40].

      CFSReliefInformation gainGain ratio

      Table 4.  Performance comparison of difference strategies to recognize MDFAs

      Fig. 4 shows the results of feature numbers generated by feature selection methods. From the results, we can conclude that:

      Figure 4.  Feature numbers generated by feature selection methods

      1) CFS generates fewer features, but attains better CRR than other alternative feature selection methods. Especially CFS+RF strategy can achieve the best result.

      2) The number of features generated by Information gain and Gain ratio are very close, additionally, features are basically the same. In our opinion, this result may be due to the same of basic principle of its feature production.

      To find the highest CRR, we conducted a comparative analysis between our proposed approach and alternative popular classification algorithms: a) RF, b) K-nearest neighbor (KNN)[41], c) support vector machine (SVM)[42], d) neural network (NN)[43], e) Bayes[44], and f) classification tree (CR)[45]. The results can be seen in Table 4 which shows the optimal feature subset [according to CFS and CRR] in the first column. Matlab2Weka toolbox is used to accomplish these algorithms, the main parameter settings are shown in Table 5. To better evaluate the superiority/inferiority of each classification mechanism, we also computed the following statistical measures: a) sensitivity, also called the true positive rate (TPR) or recall in other fields such as information retrieval, b) 1-specificity, also called the true negative rate (TNR), c) Precision, d) F-measure, and e) the Kappa statistic. Space restricts a detailed discussion on the five statistical measures, however a detailed introduction may be found in [46, 47]. The specific experimental comparative results are shown in Fig. 5.

      Figure 5.  Specific experimental result of five classifiers base on the optimal feature subset

      MethodMain parameters
      Random forestMaxDepth: 0, NumExecutionSlots: 1, NumTrees: 10, seed: 1, Implementation: RandomForest
      K-nearest neighborsNumber of neighbors: 1, Distance weighting: No distance weighting; Implementation: IBk
      Support vector machineKernel: PolyKernel, Cost(C): 1.0, Epsilon: 1.0E-12, NumFolds: –1, RandomSeed: 1, ToleranceParameter: 0.001, Implementation: SMO
      Neural networkHiddenLayers: a, LearningRate: 0.3, Momentum: 0.2, Seed: 0, Training time: 500, Validation: 0, ValidationThreshold: 20, Implementation: MultilayerPerceptron
      BayesUseKernelEstimator: False, UseSupervisedDiscretization: False, Implementation: NaiveBayes
      Classification treesConfidenceFactor: 0.25, MinNumObj: 2, NumFoldS: 3, ReducedErrorPruning: False, Seed: 1, Implementation: J48

      Table 5.  Main parameters settings

      Usually for five statistical metrics (see Fig. 5), we expect that better recognition performance is indicated by higher values for TPR, precision, F-measure, and Kappa statistic, and a lower value for TNR. The Kappa statistic (which measures the agreement of prediction with the true class attribute) is expected to have a value close to 1.0. As anticipated, our reported experimental result supports the prediction that it achieves a higher TPR, precision, F-measure, and Kappa statistic while using RF algorithm, it also has a lower TNR than other six classification algorithms. The value of Kappa statistic when using RF is 0.92 which is the most closer to 1.0 than the alternative method.

      It is hard to accurately compare the performance differences of various recognition methods due to the differences of datasets used in various methods. However, by analyzing and comparing various methods using different datasets, it can indirectly reflect the advantages and disadvantages of different methods. Table 6 lists a comparison of three aspects of some existing methods. In [48, 49], EEG data was used to perform sleep recognition based on deep learning and deep neural networks, respectively. As you can see in Table 6, the accuracy of the above two schemes is lower than that of our proposed method. Moreover, the Kappa statistics in the literature[48] is also lower than that of our proposed method. We think that this result may be because the feature fusion strategy of EEG and EOG is adopted in this study. EOG features further explore the information contained in sleep data and make up for the inadequacies in EEG features.

      MethodAcc (%)k
      Shahin et al.[48]Deep learning92.000.84
      Shahin et al.[49]Deep neural network84.00
      Proposed methodFeature fusion96.220.62
      Note: Acc: Accuracy rate, k: Kappa statistics, –: the missing cases.

      Table 6.  Performance comparison of various existing methods

    • As discussed above, the CRR derived from the dual-modal optimal feature subset was high and encouraging, especially the accuracy of the RF algorithm which can reach 96.22%. The study has achieved a number of research goals related to recognition of MDFA in a laboratory environment. The next logical stage in our research is the implementation of MDFA in “real-world” environments. Future research will address the development of an MDFA recognition system capable of implementation in the “real-world” to meet the requirements of “real-time” high CRR.

      In terms of the real-time requirements, there is basically one factor which must be taken into consideration. To realize real-time physiological data recording and processing, the complexity of all aspects of the data processing must be kept to a minimum. If data collection and transmission are too time-consuming, the time delays will not conform to the real-time requirements, this will cause the real-time system to be essentially meaningless. Hence, this system needs to adopt a wearable and non-invasive data collection device, and real-time data transmission. We will improve our three recording electrodes belt[50] to meet this requirement. This belt (see Fig. 6) is developed in our previous study, and its original main function is to collect and send raw EEG data to a computer.

      Figure 6.  Prototype of three recording electrodes belt

      Given the developments in the power and memory capacity of mobile devices, such processing (at least pre-processing) may be implemented in body area networks with a high powered mobile device acting as a local server and communications device operating over Wi-Fi and mobile systems (e.g., 3G, 4G, and in future 5G) to maintain connectivity in robust systems incorporating redundancy.

      Our goal in the future is to develop an automatic identification system of MDFA, physiological data being collected from a dual-channel EEG and one channel EOG using improved three recording electrodes belt. Furthermore, dual-modal optimal feature subset and RF algorithm will be configured in a system designed to recognize MDFAs.

    • The purpose of this study is to explore the correlations between physiological signals and MDFA, the goal being automatic recognition of MDFAs from NCs. In this research, an optimal feature subset containing 16 features is identified. The research outcomes are encouraging as our proposed method obtained a high CRR which reached 96.22%, a TPR of 95.31%, a TNR of 2.90%, a precision of 97.10%, a F-Measure of 96.20%, and a Kappa statistic of 0.92.

      From the experimental results, we have found that a certain relationship exists between an optimal feature subset and different frequency waves (see Fig. 3). The authors therefore suggest that the SWS stage and REM stage are the most important for the recognition of MDFAs. In future research, we aim to develop a real-time decision support system (DSS) based on current research to assist clinicians in MDFA diagnosis and recognition. We propose that such a DSS will be potentially extremely useful in recognizing MDFA in “real-world” local and remote diagnostic situations.

    • This work has been supported by National Natural Science Foundation of China (Nos. 61761027 and 61461025), the Yong Scholar Fund of Lanzhou Jiaotong University (No. 2016004) and the Teaching Reform Project of Lanzhou Jiaotong University (No. JGY201841).

Reference (50)



    DownLoad:  Full-Size Img  PowerPoint