Real-Time Monitoring and Assessment System with Facial Landmark Estimation for Emotional Recognition in Work
Article Sidebar
Main Article Content
Abstract
The Model for Monitoring and Regulating Emotional States in the Work Environment based on Neural Networks and Emotion Recognition Algorithms presents an innovative approach to enhancing employee well-being and productivity by leveraging advanced technologies. This paper on the development of a system that utilizes neural networks and emotion recognition algorithms to monitor and interpret emotional cues exhibited by individuals in real-time within the work environment. With the uses of novel Directional Marker Controlled Facial Landmark (DMCFL) Emotion recognition algorithms are employed to analyze facial expressions, speech patterns, physiological data, and text-based communication to infer the emotional state of employees. Neural networks are then utilized to process this data and provide more sophisticated emotion classification and prediction. The emotional states are classified with the integrated Regression Logistics Classifier (RLC) model for classification. The analysis of the findings expressed that the real-time monitoring enables employers and supervisors to gain insights into the emotional well-being of employees, identifying patterns and potential issues. The system facilitates feedback and regulation mechanisms, allowing for personalized interventions and support tailored to individual emotional needs.
Article Details
References
Thulasimani, L., & SP, P. (2021). Real time driver drowsiness detection using opencv and facial landmarks. Int. J. of Aquatic Science, 12(2), 4297-4314.
Malek, S., & Rossi, S. (2021). Head pose estimation using facial-landmarks classification for children rehabilitation games. Pattern Recognition Letters, 152, 406-412.
Alvarez Casado, C., & Bordallo Lopez, M. (2021). Real-time face alignment: evaluation methods, training strategies and implementation optimization. Journal of Real-Time Image Processing, 18(6), 2239-2267.
Liu, W., Qiu, J. L., Zheng, W. L., & Lu, B. L. (2021). Comparing recognition performance and robustness of multimodal deep learning models for multimodal emotion recognition. IEEE Transactions on Cognitive and Developmental Systems, 14(2), 715-729.
Yang, H., Fan, Y., Lv, G., Liu, S., & Guo, Z. (2023). Exploiting emotional concepts for image emotion recognition. The Visual Computer, 39(5), 2177-2190.
Li, D., Zhou, Y., Wang, Z., & Gao, D. (2021). Exploiting the potentialities of features for speech emotion recognition. Information Sciences, 548, 328-343.
Bani, M., Russo, S., Ardenghi, S., Rampoldi, G., Wickline, V., Nowicki Jr, S., & Strepparava, M. G. (2021). Behind the mask: Emotion recognition in healthcare students. Medical Science Educator, 31(4), 1273-1277.
Tu, G., Liang, B., Jiang, D., & Xu, R. (2022). Sentiment-Emotion-and Context-guided Knowledge Selection Framework for Emotion Recognition in Conversations. IEEE Transactions on Affective Computing.
Ngai, W. K., Xie, H., Zou, D., & Chou, K. L. (2022). Emotion recognition based on convolutional neural networks and heterogeneous bio-signal data sources. Information Fusion, 77, 107-117.
Siam, A. I., Soliman, N. F., Algarni, A. D., El-Samie, A., Fathi, E., & Sedik, A. (2022). Deploying machine learning techniques for human emotion detection. Computational Intelligence and Neuroscience, 2022.
Kyamakya, K., Al-Machot, F., Haj Mosa, A., Bouchachia, H., Chedjou, J. C., & Bagula, A. (2021). Emotion and stress recognition related sensors and machine learning technologies. Sensors, 21(7), 2273.
Abdullah, S. M. S. A., Ameen, S. Y. A., Sadeeq, M. A., & Zeebaree, S. (2021). Multimodal emotion recognition using deep learning. Journal of Applied Science and Technology Trends, 2(02), 52-58.
Islam, M. R., Moni, M. A., Islam, M. M., Rashed-Al-Mahfuz, M., Islam, M. S., Hasan, M. K., ... & Lió, P. (2021). Emotion recognition from EEG signal focusing on deep learning and shallow learning techniques. IEEE Access, 9, 94601-94624.
Xu, L., Wen, X., Shi, J., Li, S., Xiao, Y., Wan, Q., & Qian, X. (2021). Effects of individual factors on perceived emotion and felt emotion of music: based on machine learning methods. Psychology of Music, 49(5), 1069-1087.
Saini, G. K., Chouhan, H., Kori, S., Gupta, A., Shabaz, M., Jagota, V., & Singh, B. K. (2021). Recognition of human sentiment from image using machine learning. Annals of the Romanian Society for Cell Biology, 1802-1808.
Gómez-Cañón, J. S., Cano, E., Eerola, T., Herrera, P., Hu, X., Yang, Y. H., & Gómez, E. (2021). Music emotion recognition: Toward new, robust standards in personalized and context-sensitive applications. IEEE Signal Processing Magazine, 38(6), 106-114.
Saganowski, S. (2022). Bringing emotion recognition out of the lab into real life: Recent advances in sensors and machine learning. Electronics, 11(3), 496.
Dadebayev, D., Goh, W. W., & Tan, E. X. (2022). EEG-based emotion recognition: Review of commercial EEG devices and machine learning techniques. Journal of King Saud University-Computer and Information Sciences, 34(7), 4385-4401.
Suresh, K. S. ., & Kamalakannan, T. . (2023). Digital Image Steganography in the Spatial Domain Using Block-Chain Technology to Provide Double-Layered Protection to Confidential Data Without Transferring the Stego-Object. International Journal of Intelligent Systems and Applications in Engineering, 11(2s), 61–68. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2508
Houssein, E. H., Hammad, A., & Ali, A. A. (2022). Human emotion recognition from EEG-based brain–computer interface using machine learning: a comprehensive review. Neural Computing and Applications, 34(15), 12527-12557.
Sakalle, A., Tomar, P., Bhardwaj, H., Acharya, D., & Bhardwaj, A. (2021). An analysis of machine learning algorithm for the classification of emotion recognition. In Soft Computing for Problem Solving: Proceedings of SocProS 2020, Volume 2 (pp. 399-408). Springer Singapore.
Song, Z. (2021). Facial expression emotion recognition model integrating philosophy and machine learning theory. Frontiers in Psychology, 12, 759485.
Yadav, S. P., Zaidi, S., Mishra, A., & Yadav, V. (2022). Survey on machine learning in speech emotion recognition and vision systems using a recurrent neural network (RNN). Archives of Computational Methods in Engineering, 29(3), 1753-1770.
Prof. Madhuri Zambre. (2016). Automatic Vehicle Over speed Controlling System using Microcontroller Unit and ARCAD. International Journal of New Practices in Management and Engineering, 5(04), 01 - 05. Retrieved from http://ijnpme.org/index.php/IJNPME/article/view/47
Sepúlveda, A., Castillo, F., Palma, C., & Rodriguez-Fernandez, M. (2021). Emotion recognition from ECG signals using wavelet scattering and machine learning. Applied Sciences, 11(11), 4945.
Costantini, G., Parada-Cabaleiro, E., Casali, D., & Cesarini, V. (2022). The emotion probe: On the universality of cross-linguistic and cross-gender speech emotion recognition via machine learning. Sensors, 22(7), 2461.
Sekhar, C., Rao, M. S., Nayani, A. K., & Bhattacharyya, D. (2021). Emotion recognition through human conversation using machine learning techniques. In Machine Intelligence and Soft Computing: Proceedings of ICMISC 2020 (pp. 113-122). Springer Singapore.
Prasanth, S., Thanka, M. R., Edwin, E. B., & Nagaraj, V. (2021). WITHDRAWN: Speech emotion recognition based on machine learning tactics and algorithms.
Kamble, K. S., & Sengupta, J. (2021). Ensemble machine learning-based affective computing for emotion recognition using dual-decomposed EEG signals. IEEE Sensors Journal, 22(3), 2496-2507.
Abbaschian, B. J., Sierra-Sosa, D., & Elmaghraby, A. (2021). Deep learning techniques for speech emotion recognition, from databases to models. Sensors, 21(4), 1249.