A Comparative Analysis of EEG-based Stress Detection Utilizing Machine Learning and Deep Learning Classifiers with a Critical Literature Review
Article Sidebar
Main Article Content
Abstract
Background: Mental stress is considered to be a major contributor to different psychological and physical diseases. Different socio-economic issues, competition in the workplace and amongst the students, and a high level of expectations are the major causes of stress. This in turn transforms into several diseases and may extend to dangerous stages if not treated properly and timely, causing the situations such as depression, heart attack, and suicide. This stress is considered to be a very serious health abnormality. Stress is to be recognized and managed before it ruins the health of a person. This has motivated the researchers to explore the techniques for stress detection. Advanced machine learning and deep learning techniques are to be investigated for stress detection.
Methodology: A survey of different techniques used for stress detection is done here. Different stages of detection including pre-processing, feature extraction, and classification are explored and critically reviewed. Electroencephalogram (EEG) is the main parameter considered in this study for stress detection. After reviewing the state-of-the-art methods for stress detection, a typical methodology is implemented, where feature extraction is done by using principal component analysis (PCA), ICA, and discrete cosine transform. After the feature extraction, some state-of-art machine learning classifiers are employed for classification including support vector machine (SVM), K-nearest neighbor (KNN), NB, and CT. In addition to these classifiers, a typical deep-learning classifier is also utilized for detection purposes. The dataset used for the study is the Database for Emotion Analysis using Physiological Signals (DEAP) dataset.
Results: Different performance measures are considered including precision, recall, F1-score, and accuracy. PCA with KNN, CT, SVM and NB have given accuracies of 65.7534%, 58.9041%, 61.6438%, and 57.5342% respectively. With ICA as feature extractor accuracies obtained are 58.9041%, 61.64384%, 57.5342%, and 54.79452% for the classifiers KNN, CT, SVM, and NB respectively. DCT is also considered a feature extractor with classical machine learning algorithms giving the accuracies of 56.16438%, 50.6849%, 54.7945%, and 45.2055% for the classifiers KNN, CT, SVM, and NB respectively. A conventional DCNN classification is performed given an accuracy of 76% and precision, recall, and F1-score of 0.66, 0.77, and 0.64 respectively.
Conclusion: For EEG-based stress detection, different state-of-the-art machine learning and deep learning methods are used along with different feature extractors such as PCA, ICA, and DCT. Results show that the deep learning classifier gives an overall accuracy of 76%, which is a significant improvement over classical machine learning techniques with the accuracies as PCA+ KNN (65.75%), DCT+KNN (56.16%), and ICA+CT (61.64%).
Article Details
References
Wijsman, Jacqueline, Bernard Grundlehner, Hao Liu, Hermie Hermens, and Julien Penders. "Towards mental stress detection using wearable physiological sensors." In 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 1798-1801. IEEE, 2011.
de Santos Sierra, Alberto, Carmen Sánchez Ávila, Javier Guerra Casanova, and Gonzalo Bailador del Pozo. "A stress-detection system based on physiological signals and fuzzy logic." IEEE Transactions on Industrial Electronics 58, no. 10 (2011): 4857-4865.
Giannakakis, Giorgos, Dimitris Grigoriadis, Katerina Giannakaki, Olympia Simantiraki, Alexandros Roniotis, and Manolis Tsiknakis. "Review on psychological stress detection using biosignals." IEEE Transactions on Affective Computing (2019).
Shruti Garg, Soumyajit Behera, Rahul K Patro and Ashwani Garg “Deep Neural Network for Electroencephalogram based Emotion Recognition” n IOP Conference Series Materials Science and Engineering · September 2021
D. O. Hebb, "Drives and the CNS (conceptual nervous system)," Psychological Review, 62, p. 243, 1955.
P. J. Lang, M. M. Bradley, and B. N. Cuthbert, "International affective picture system (IAPS): Affective ratings of pictures and instruction manual," Technical report, 2008.
J. R. Stroop, "Studies of interference in serial verbal reactions," Journal of Experimental Psychology, 18, p. 643, 1935.
L. Torres-Salomao, M. Mahfouf, and E. El-Samahy, "Pupil diameter size marker for incremental mental stress detection," in E-health Networking, Application & Services (HealthCom), 2015, pp. 286-291.
D. Gronwall, "Paced auditory serial addition task: a measure of recovery from concussion," Perceptual and Motor Skills, 44, pp. 367-373, 1977.
K. Dedovic, R. Renwick, N. K. Mahani, and V. Engert, "The Montreal Imaging Stress Task: using functional imaging to investigate the effects of perceiving and processing psychosocial stress in the human brain," Journal of psychiatry & neuroscience: JPN, 30, p. 319, 2005.
E. A. Berg, "A simple objective technique for measuring flexibility in thinking," The Journal of general psychology, 39, pp. 15-22, 1948.
M. Pedrotti, M. A. Mirzaei, A. Tedesco, J.-R. Chardonnet, et al., "Automatic stress classification with pupil diameter analysis," International Journal of Human-Computer Interaction, 30, pp. 220-236, 2014.
C. Kirschbaum, K. M. Pirke, and D. H. Hellhammer, "The Trier Social Stress Test - a Tool for Investigating Psychobiological Stress Responses in a Laboratory Setting," Neuropsychobiology, 28, pp. 76-81, 1993.
W. Lovallo, "The cold pressor test and autonomic function: a review and integration," Psychophysiology, 12, pp. 268-282, 1975.
A. Bali and A. S. Jaggi, "Clinical experimental stress studies: methods and assessment," Reviews in the Neurosciences, 26, pp. 555-579, 2015.
S Koelstra, C Muhl, M Soleymani, JS Lee, A Yazdani “Deap: A database for emotion analysis; using physiological signals” IEEE transactions on affective computing, 2011.
Wei-Long Zheng, and Bao-Liang Lu, Investigating Critical Frequency Bands and Channels for EEG-based Emotion Recognition with Deep Neural Networks, accepted by IEEE Transactions on Autonomous Mental Development (IEEE TAMD) 7(3): 162-175, 2015.
Zyma I, Tukaev S, Seleznov I, Kiyono K, Popov A, Chernykh M, Shpenkov O. Electroencephalograms during Mental Arithmetic Task Performance.Data. 2019; 4(1):14.https://doi.org/10.3390/data4010014
Bisht, Amandeep, Chamandeep Kaur, and Preeti Singh. "Recent advances in artifact removal techniques for EEG signal processing." Intelligent Communication, Control, and Devices, 385-392, 2020.
Alyasseri, Zaid Abdi Alkareem, Ahamad Tajudin Khader, Mohammed Azmi Al-Betar, Ammar Kamal Abbasi, and Sharif Naser Makhadmeh. "EEG signals denoising using optimal wavelet transform hybridized with efficient metaheuristic methods." IEEE Access 8 (2019): 10584-10605.
Kaur, Chamandeep, Amandeep Bisht, Preeti Singh, and Garima Joshi. "EEG Signal denoising using a hybrid approach of Variational Mode Decomposition and wavelets for depression." Biomedical Signal Processing and Control 65 (2021): 102337.
Abdullah, Ahmed Kareem. "Brain-Computer Interface Enhancement Based on Stones Blind Source Separation and Naive Bayes Classifier." In New Trends in Information and Communications Technology Applications: 4th International Conference, NTICT 2020, Baghdad, Iraq, June 15, 2020, Proceedings, vol. 1183, p. 17. Springer Nature, 2020.
Garvanov, Ivan, Vladimir Jotsov, and Magdalena Garvanova. "Data Science Modeling for EEG Signal Filtering Using Wavelet Transforms." In 2020 IEEE 10th International Conference on Intelligent Systems (IS), pp. 352-357. IEEE, 2020.
Alyasseri, Zaid Abdi Alkareem, Ahamad Tajudin Khader, Mohammed Azmi Al-Betar, Ammar Kamal Abasi, and Sharif Naser Makhadmeh. "EEG signals denoising using optimal wavelet transform hybridized with efficient metaheuristic methods." IEEE Access 8 (2019): 10584-10605.
Paradeshi, K. P., Research Scholar, and U. D. Kolekar. "Removal of ocular artifacts from multichannel EEG signal using wavelet enhanced ICA." In 2017 International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS), pp. 383-387. IEEE, 2017.
Steyrl, David, Gunther Krausz, Karl Koschutnig, Günter Edlinger, and Gernot R. Müller-Putz. "Reference layer adaptive filtering (RLAF) for EEG artifact reduction in simultaneous EEG-fMRI." Journal of neural engineering 14, no. 2 (2017): 026003.
Roy, Vandana, Prashant Kumar Shukla, Amit Kumar Gupta, Vikas Goel, Piyush Kumar Shukla, and Shailja Shukla. "Taxonomy on EEG artifacts removal methods, issues, and healthcare applications." Journal of Organizational and End User Computing (JOEUC) 33, no. 1 (2021): 19-46.
Urigüen, Jose Antonio, and Begoña Garcia-Zapirain. "EEG artifact removal—state-of-the-art and guidelines." Journal of neural engineering 12, no. 3 (2015): 031001.
Vanitha, V., and P. Krishnan. "Real-time stress detection system based on EEG signals." Biomedical Research, pp. 271-275, 2016.
Jun, Guo, and Kavallur Gopi Smitha. "EEG-based stress level identification." In 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 003270-003274. IEEE, 2016.
Sharma, Ruchi, and Khyati Chopra. "EEG signal analysis and detection of stress using classification techniques." Journal of Information and Optimization Sciences 41, no. 1 (2020): 229-238.
Priya, Taruv Harshita, P. Mahalakshmi, V. P. S. Naidu, and M. Srinivas. “Stress detection from EEG using power ratio.” In 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE), pp. 1-6. IEEE, 2020.
Valecha, H.; Varma, A.; Khare, I.; Sachdeva, A.; Goyal, M. Prediction of Consumer Behaviour using Random Forest Algorithm. In Proceedings of the 2018 5th IEEE Uttar Pradesh Section International Conference on Electrical, Electronics and Computer Engineering (UPCON), Gorakhpur, India, 2–4 November 2018; pp. 1–6.
Murphy, K.P. Machine Learning: A Probabilistic Perspective; MIT Press: Cambridge, MA, USA, 2013
Asif, Anum, Muhammad Majid, and Syed Muhammad Anwar. "Human stress classification using EEG signals in response to music tracks." Computers in biology and medicine 107 (2019): 182-196.
Tawfeeq , Y. J. ., & Izzat N. Sulaiman. (2023). Study of Dynamic Viscosity Ratio Effectiveness on Linear Displacement of Fluid Flow . International Journal of Intelligent Systems and Applications in Engineering, 11(1s), 159–163. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2488
Shon, Dongkoo, Kichang Im, Jeong-Ho Park, Dong-Sun Lim, Byungtae Jang, and Jong-Myon Kim. "Emotional stress state detection using genetic algorithm-based feature selection on EEG signals." International Journal of environmental research and public health 15, no. 11 (2018): 2461.
Purnamasari, Prima Dewi, and Alya Fernandya. "Real-Time EEG-based Stress Detection and Meditation Application with K-Nearest Neighbor." In 2019 IEEE R10 Humanitarian Technology Conference (R10-HTC)(47129), pp. 49-54. IEEE, 2019.
P. Mukherjee and A. H. Roy, "Detection of Stress in Human Brain," 2019 Second International Conference on Advanced Computational and Communication Paradigms (ICACCP), Gangtok, India, 2019, pp. 1-6, DOI: 10.1109/ICACCP.2019.8882906
C. Liao, R. Chen and S. Tai, "Emotion stress detection using EEG signal and deep learning technologies," 2018 IEEE International Conference on Applied System Invention (ICASI), Chiba, 2018, pp. 90-93, DOI: 10.1109/ICASI.2018.8394414.
Malviya, L., Mal, S. A novel technique for stress detection from EEG signal using hybrid deep learning model. Neural Comput & Applic (2022). https://doi.org/10.1007/s00521-022-07540-7
Fan, Miaolin, Mohammad Samie Tootooni, Rajesh Sharma Sivasubramony, Vladimir Miskovic, Prahalada K. Rao, and Chun-An Chou. "Acute stress detection using recurrence quantification analysis of EEG signals." In International Conference on Brain Informatics, pp. 252-261. Springer, Cham, 2016.
Al-Share, Fares, Tong Boon Tang, Nasreen Badruddin, and Masashi Kiguchi. "Towards multilevel mental stress assessment using SVM with ECOC: an EEG approach." Medical & biological engineering & computing 56, no. 1 (2018): 125-136.
Xia, Likun, Aamir Saeed Malik, and Ahmad Rauf Subhani. "A physiological signal-based method for early mental-stress detection." Biomedical Signal Processing and Control 46 (2018): 18-32.
Halim, Zahid, and Mahma Rehan. "On identification of driving-induced stress using electroencephalogram signals: A framework based on wearable safety-critical scheme and machine learning." Information Fusion 53 (2020): 66-79.
Tervonen, Jaakko, Sampsa Puttonen, Mikko J. Sillanpää, Leila Hopsu, Zsolt Homorodi, Janne Keränen, Janne Pajukanta, Antti Tolonen, Arttu Lämsä, and Jani Mäntyjärvi. "Personalized mental stress detection with self-organizing map: From laboratory to the field." Computers in Biology and Medicine 124 (2020): 103935.
Tuerxun Waihi, Alshebly, Yousif Sa’ad, Khairul Azami Sidek, and Md Gapar Md Johar. "Stress recognition using Electroencephalogram (EEG) signal." In Journal of Physics: Conference Series, vol. 1502, no. 1, p. 012052. IOP Publishing, 2020.
Priya, Taruv Harshita, P. Mahalakshmi, V. P. S. Naidu, and M. Srinivas. “Stress detection from EEG using power ratio.” In 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE), pp. 1-6. IEEE, 2020.
Desai, Rahul, Pratik Porob, Penjo Rebelo, Damodar Reddy Edla, and Annushree Bablani. "EEG Data Classification for Mental State Analysis Using Wavelet Packet Transform and Gaussian Process Classifier" Wireless Personal Communications (2020): 1-21.
Saeed, Sanay Muhammad Umar, Syed Muhammad Anwar, Humaira Khalid, and Muhammad Majid. "EEG Based Classification of Long-Term Stress Using Psychological Labeling." Sensors 20, no. 7 (2020): 1886(1-15).
Zhang, Yuge, Qin Wang, Zheng Yang Chin, and Kai Keng Ang. "Investigating different stress-relief methods using Electroencephalogram (EEG)." In 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp. 2999-3002. IEEE, 2020.
Gupta, Richa, M. Afshar Alam, and Parul Agarwal. "Modified Support Vector Machine for Detecting Stress Level Using EEG Signals." Computational Intelligence and Neuroscience 2020 (2020).
H. Chao and L. Dong, "Emotion Recognition Using Three-Dimensional Feature and Convolutional Neural Network from Multichannel EEG Signals," in IEEE Sensors Journal, vol. 21, no. 2, pp. 2024-2034, 15 Jan.15, 2021, DOI: 10.1109/JSEN.2020.3020828
Juhani Nieminen , Johan Bakker, Martin Mayer, Patrick Schmid, Andrea Ricci. Exploring Explainable AI in Educational Machine Learning Models. Kuwait Journal of Machine Learning, 2(2). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/191
A. Martínez-Rodrigo, B. García-Martínez, Á. Huerta, and R. Alcaraz, “Detection of Negative Stress through Spectral Features of Electroencephalographic Recordings and a Convolutional Neural Network,” Sensors, vol. 21, no. 9, p. 3050, Apr. 2021, DOI: 10.3390/s21093050. [Online]. Available: http://dx.doi.org/10.3390/s21093050
Vaishali M. Joshi, Rajesh B. Ghongade, EEG-based emotion detection using fourth-order spectral moment and deep learning, Biomedical Signal Processing, and Control, Volume 68 2021,102755, ISSN 1746-8094
Lakhan Dev Sharma, Vijay Kumar Bohat, Maria Habib, Ala’ M. Al-Zoubi, Hossam Faris, Ibrahim Aljarah, Evolutionary inspired approach for mental stress detection using EEG signal, Expert Systems with Applications, Volume 197, 2022,116634, ISSN 0957-4174
Sander Koelstra, Christian Muhl, Mohammad Soleymani, Jong-Seok Lee, Ashkan Yazdani, Touradj Ebrahimi, Thierry Pun, Anton Nijholt, Ioannis Patras, DEAP: a database for emotion analysis using physiological signals, IEEE Transactions on Affective Computing 3 (1) (2012) 18–31, https://doi.org/ 10.1109/T-AFFC.2011.15.
Stamos Katsigiannis, Naeem Ramzan, DREAMER: a database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices, IEEE Journal of Biomedical and Health Informatics 22 (1) (2018) 98–107, https://doi.org/10.1109/JBHI.2017.2688239.
P.J. Lang, M.M. Bradley, B.N. Cuthbert, International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual, Technical Report A8, University of Florida, Gainesville, FL, 2008.
G. McKeown, M. Valstar, R. Cowie, M. Pantic, M. Schroder, The SEMAINE database: annotated multimodal records of emotionally colored conversations between a person and a limited agent, IEEE Transactions on Affective Computing 3 (1) (2012) 5–17, https://doi.org/10.1109/T-AFFC.2011.20.
R. Subramanian, J. Wache, M.K. Abadi, R.L. Vieriu, S. Winkler, N. Sebe, ASCERTAIN: emotion and personality recognition using commercial sensors, IEEE Transactions on Affective Computing 9 (2) (2018) 147–160, https://doi.org/ 10.1109/TAFFC.2016.2625250.
Soujanya Poria, Devamanyu Hazarika, Navonil Majumder, Gautam Naik, Erik Cambria, Rada Mihalcea, MELD: a multimodal multi-party dataset for emotion recognition in conversations, in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Stroudsburg, PA, USA, 2019, pp. 527–536.
Wei-Long Zheng, Bao-Liang Lu, A multimodal approach to estimating vigilance using EEG and forehead EOG, J. Neural. Eng. 14 (2) (2017), 026017, https://doi. org/10.1088/1741-2552/aa5a98.
J.A. Miranda Correa, M.K. Abadi, N. Sebe, I. Patras, AMIGOS: a dataset for affect, personality and mood research on individuals and groups, IEEE Transactions on Affective Computing (2018), https://doi.org/10.1109/TAFFC.2018.2884461, 1- 1.
M.K. Abadi, R. Subramanian, S.M. Kia, P. Avesani, I. Patras, N. Sebe, DECAF: MEG-based multimodal database for decoding affective physiological responses, IEEE Transactions on Affective Computing 6 (3) (2015) 209–222, https://doi. org/10.1109/TAFFC.2015.2392932.
B. Lu, M. Hui, H. Yu-Xia, The development of native Chinese affective picture system–A pretest in 46 college students, Chin. Ment. Health J. 19 (11) (2005) 719–722.
M. Soleymani, J. Lichtenauer, T. Pun, M. Pantic, A multimodal database for affect recognition and implicit tagging, IEEE Transactions on Affective Computing 3 (1) (2012) 42–55, https://doi.org/10.1109/T-AFFC.2011.25.
Khalid, S., Khalil, T. and Nasreen, S., 2014, August. A survey of feature selection and feature extraction techniques in machine learning. In 2014 science and information conference (pp. 372-378). IEEE.
Shanthi, D. N. ., & J, S. . (2021). Machine Learning Architecture in Soft Sensor for Manufacturing Control and Monitoring System Based on Data Classification. Research Journal of Computer Systems and Engineering, 2(2), 01:05. Retrieved from https://technicaljournals.org/RJCSE/index.php/journal/article/view/24
Biber, D. and Gray, B., 2013. Discourse characteristics of writing and speaking task types on the TOEFL ibt® test: A lexico?grammatical analysis. ETS Research Report Series, 2013(1), pp.i-128.
Alim, S.A. and Rashid, N.K.A., 2018. Some commonly used speech feature extraction algorithms (pp. 2-19). London, UK:: IntechOpen.
Gunn, S.R., 1998. Support vector machines for classification and regression. ISIS technical report, 14(1), pp.5-16.
Xue, H., Yang, Q. and Chen, S., 2009. SVM: Support vector machines. In The top ten algorithms in data mining (pp. 51-74). Chapman and Hall/CRC.
Kotsiantis, S.B., 2013. Decision trees: a recent overview. Artificial Intelligence Review, 39(4), pp.261-283.
Leung, K.M., 2007. Naive bayesian classifier. Polytechnic University Department of Computer Science/Finance and Risk Engineering, 2007, pp.123-156.
Renato Costa, Deep Reinforcement Learning for Autonomous Robotics , Machine Learning Applications Conference Proceedings, Vol 2 2022.
Wang, S.C., 2003. Artificial neural network. In Interdisciplinary computing in java programming (pp. 81-100). Springer, Boston, MA.
Yang, Y., Wu, Q.J., Feng, X. and Akilan, T., 2019. Recomputation of the dense layers for performance improvement of dcnn. IEEE transactions on pattern analysis and machine intelligence, 42(11), pp.2912-2925.
Daffertshofer, A., Lamoth, C.J., Meijer, O.G. and Beek, P.J., 2004. PCA in studying coordination and variability: a tutorial. Clinical biomechanics, 19(4), pp.415-428.
Calhoun, V.D., Liu, J. and Adal?, T., 2009. A review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, and ERP data. Neuroimage, 45(1), pp.S163-S172.
Jing, X.Y. and Zhang, D., 2004. A face and palmprint recognition approach based on discriminant DCT feature extraction. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 34(6), pp.2405-2415.
Liu, S., Liang, X., Liu, L., Shen, X., Yang, J., Xu, C., Lin, L., Cao, X. and Yan, S., 2015. Matching-cnn meets knn: Quasi-parametric human parsing. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1419-1427).
Lee, M.C. and To, C., 2010. Comparison of support vector machine and back propagation neural network in evaluating the enterprise financial distress. arXiv preprint arXiv:1007.5133.
Magee, J.F., 1964. Decision trees for decision making (pp. 35-48). Brighton, MA, USA: Harvard Business Review.