GAIT Technology for Human Recognition using CNN
Main Article Content
Abstract
Gait is a distinctive biometric characteristic that can be detected from a distance; as a result, it has several uses in social security, forensic identification, and crime prevention. Existing gait identification techniques use a gait template, which makes it difficult to keep temporal information, or a gait sequence, which maintains pointless sequential limitations and loses the ability to portray a gait. Our technique, which is based on this deep set viewpoint, is immune to frame permutations and can seamlessly combine frames from many videos that were taken in various contexts, such as diversified watching, angles, various outfits, or various situations for transporting something. According to experiments, our single-model strategy obtains an average rank-1 accuracy of 96.1% on the CASIA-B gait dataset and an accuracy of 87.9% on the OU-MVLP gait dataset when used under typical walking conditions. Our model also demonstrates a great degree of robustness under numerous challenging circumstances. When carrying bags and wearing a coat while walking, it obtains accuracy on the CASIA-B of 90.8% and 70.3%, respectively, greatly surpassing the best approach currently in use. Additionally, the suggested method achieves a satisfactory level of accuracy even when there are few frames available in the test samples; for instance, it achieves 85.0% on the CASIA-B even with only 7 frames.
Article Details
References
Y. Zhang, Y. Huang, S. Yu and L. Wang, "Cross-View Gait Recognition by Discriminative Feature Learning," in IEEE Transactions on Image Processing, vol. 29, pp. 1001-1015, 2020, doi: 10.1109/TIP.2019.2926208.
K. Jun, Y. Lee, S. Lee, D. -W. Lee and M. S. Kim, "Pathological Gait Classification Using Kinect v2 and Gated Recurrent Neural Networks," in IEEE Access, vol. 8, pp. 139881-139891, 2020, doi: 10.1109/ACCESS.2020.3013029
X. Wang, S. Feng and W. Q. Yan, "Human Gait Recognition Based on Self-adaptive Hidden Markov Model," in IEEE/ACM Transactions on Computational Biology and Bioinformatics, doi: 10.1109/TCBB.2019.2951146.
Y. He, J. Zhang, H. Shan and L. Wang, "Multi-Task GANs for View-Specific Feature Learning in Gait Recognition," in IEEE Transactions on Information Forensics and Security, vol. 14, no. 1, pp. 102-113, Jan. 2019, doi: 10.1109/TIFS.2018.2844819.
M. Deng and C. Wang, "Human Gait Recognition Based on Deterministic Learning and Data Stream of Microsoft Kinect," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 29, no. 12, pp. 3636-3645, Dec. 2019, doi: 10.1109/TCSVT.2018.2883449
Elharrouss, O., Almaadeed, N., Al-Maadeed, S. et al. Gait recognition for person re-identification. J Supercomput 77, 3653–3672 (2021).
K. Z. C. Tun and S. M. M. Zaw, "Gait based Human Identification through Intra-Class Variations," 2021 6th International Conference on Inventive Computation Technologies (ICICT), 2021, pp. 564-571.
Fangmin Sun a , Weilin Zang a , Raffaele Gravina b , Giancarlo Fortino b , Ye Li et al. “Gait-based identification for elderly users in wearable healthcare systems” 2020 ELSEVIER Journals Volume 53, Pages 134-144.
S. Chakraborty and A. Nandy, "An Unsupervised Approach For Gait Phase Detection," 2020 4th International Conference on Computational Intelligence and Networks (CINE), 2020, pp. 1-5.
X. Shao, X. Nie, X. Zhao, R. Zheng and D. Guo, "Gait Recognition based on Improved LeNet Network," 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), 2020, pp. 1534-1538.
Mr. Nikhil Surkar, Ms. Shriya Timande. (2012). Analysis of Analog to Digital Converter for Biomedical Applications. International Journal of New Practices in Management and Engineering, 1(03), 01 - 07. Retrieved from http://ijnpme.org/index.php/IJNPME/article/view/6
L. Gong, J. Li, M. Yu, M. Zhu and R. Clifford, "A novel computer vision based gait analysis technique for normal and Parkinson’s gaits classification," 2020 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), 2020, pp. 209-215.
J. Kondragunta and G. Hirtz, "Gait Parameter Estimation of Elderly People using 3D Human Pose Estimation in Early Detection of Dementia," 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2020, pp. 5798-5801.
T. Jiang, Y. Ge and W. Li, "Gait analysis of people relying on mobility aids by using laser range finder," 2020 IEEE International Conference on Human-Machine Systems (ICHMS), 2020, pp. 1-4.
G. Pagano, G. D’Addio, M. De Campi, L. Donisi, A. Biancardi and M. Cesarelli, "Rehabilitation Outcome in Patients undergone Hip or Knee Replacement Surgery using Inertial Technology for Gait Analysis," 2020 IEEE International Symposium on Medical Measurements and Applications (MeMeA), 2020, pp. 1-5.
J. Luo and T. Tjahjadi, "View and Clothing Invariant Gait Recognition via 3D Human Semantic Folding," in IEEE Access, vol. 8, pp. 100365-100383, 2020.
P. Limcharoen, N. Khamsemanan and C. Nattee, "View-Independent Gait Recognition Using Joint Replacement Coordinates (JRCs) and Convolutional Neural Network," in IEEE Transactions on Information Forensics and Security, vol. 15, pp. 3430-3442, 2020.
M. Zhou, "Feature Extraction of Human Motion Video Based on Virtual Reality Technology," in IEEE Access, vol. 8, pp. 155563-155575, 2020
ATHIRA NAMBIAR, ALEXANDRE BERNARDINO, and JACINTO C. NASCIMENTO, ACM Computing Surveys Vol.52 April 2019 Article No.: 33.
H. Chiu, C. Lin and T. S. Li, "Gait Recognition using Histogram of Oriented Gradient and Self-Organizing Feature Map Classification in Variable Walking Speed," 2019 International Conference on Fuzzy Theory and Its Applications (iFUZZY), 2019, pp. 283-286.
Dhabliya, D. (2021). Feature Selection Intrusion Detection System for The Attack Classification with Data Summarization. Machine Learning Applications in Engineering Education and Management, 1(1), 20–25. Retrieved from http://yashikajournals.com/index.php/mlaeem/article/view/8
P. P. Min, S. Sayeed and T. S. Ong, "Gait Recognition Using Deep Convolutional Features," 2019 7th International Conference on Information and Communication Technology (ICoICT), 2019, pp. 1-5.
Macoveciuc I, Rando CJ, Borrion H. Forensic Gait Analysis and Recognition: Standards of Evidence Admissibility. J Forensic Sci. 2019 Sep;64(5):1294-1303.
R. G. Birdal, A. Sertba? and B. Mïhendisli?i, "Human Identification Based on Gait Analysis: A survey," 2018 3rd International Conference on Computer Science and Engineering (UBMK), 2018, pp. 489-493.
Peibei Cao, Weijie Xia , Ming Ye, Jutong Zhang, Jianjiang Zhou “Radar-ID: human identification based on radar micro-Doppler signatures using deep convolutional neural networks” Volume 12, Issue 7, July 2018, p. 729 – 734.
Imad Rida, Noor Almaadeed, Somaya Almaadeed “Robust gait recognition: a comprehensive survey” IET Biometrics ,August 2018.
MICHA?OWSKA,WALCZAK,GRABSKI,CIE?LAK “People Identification Based on Dynamic Determinants of Human Gait” Vibrations in Physical Systems 2018,Vol. 29,pp 1-6.
K. Z. Htun and S. Maung Maung Zaw, "Human Identification System Based on Statistical Gait Features," 2018 IEEE/ACIS 17th International Conference on Computer and Information Science (ICIS), 2018, pp. 508-512.
Lubov Shiripova , Evgeny Myasnikov “Comparative Analysis of Classification Methods for Human Identification by Gait” Samara University, Moskovskoe Shosse 34, Vol 4 pp 51-59.
Maryam Babaeea,, Linwei Lia, Gerhard Rigolla “Person Identification from Partial Gait Cycle Using Fully Convolutional Neural Network” a Institute for Human-Machine Communication April,18 .
Albert Haque, Alexandre Alahi, Li Fei-Fei “Recurrent Attention Models for Depth-Based Person Identification” arXiv.org V 1 ,2018.
N. Khamsemanan, C. Nattee and N. Jianwattanapaisarn, "Human Identification From Freestyle Walks Using Posture-Based Gait Feature," in IEEE Transactions on Information Forensics and Security, vol. 13, no. 1, pp. 119-128, Jan. 2018.
H. Aggarwal and D. K. Vishwakarma, "Covariate Conscious Approach for Gait Recognition Based Upon Zernike Moment Invariants," in IEEE Transactions on Cognitive and Developmental Systems, vol. 10, no. 2, pp. 397-407, June 2018.
Z. Zhang, J. Chen, Q. Wu and L. Shao, "GII Representation-Based Cross-View Gait Recognition by Discriminative Projection With List-Wise Constraints," in IEEE Transactions on Cybernetics, vol. 48, no. 10, pp. 2935-2947, Oct. 2018.
S. A. More and P. J. Deore, "Gait Recognition by Cross Wavelet Transform and Graph Model," in IEEE/CAA Journal of Automatica Sinica, vol. 5, no. 3, pp. 718-726, May 2018.
Wu Liu, Cheng Zhang, Huadong Ma, Shuangqun Li “Learning Efficient Spatial-Temporal Gait Features with Deep Learning for Human Identification” Neuroinformatics . 2018 Oct;16(3-4):457-471.
Sungjun Hong and Euntai Kim “A New Automatic Gait Cycle Partitioning Method and Its Application to Human Identification” Int. J. Fuzzy Log. Intell. Syst. 2017;17(2):51-57
S. Yu, H. Chen, E. B. G. Reyes and N. Poh, "GaitGAN: Invariant Gait Feature Extraction Using Generative Adversarial Networks," 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2017, pp. 532-539.
Singh, M. ., Angurala, D. M. ., & Bala, D. M. . (2020). Bone Tumour detection Using Feature Extraction with Classification by Deep Learning Techniques. Research Journal of Computer Systems and Engineering, 1(1), 23–27. Retrieved from https://technicaljournals.org/RJCSE/index.php/journal/article/view/21
Gaikwad, R. S. ., & Gandage, S. . C. (2023). MCNN: Visual Sentiment Analysis using Various Deep Learning Framework with Deep CNN. International Journal of Intelligent Systems and Applications in Engineering, 11(2s), 265 –. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2625
Liao R., Cao C., Garcia E.B., Yu S., Huang Y. (2017) Pose-Based Temporal-Spatial Network (PTSN) for Gait Recognition with Carrying and Clothing Variations. In: Zhou J. et al. (eds) Biometric Recognition. CCBR 2017. Lecture Notes in Computer Science, vol 10568. Springer, Cham.
Lishani, A.O., Boubchir, L., Khalifa, E. et al. Human gait recognition based on Haralick features. SIViP 11, 1123–1130 (2017).
Manjunatha Guru, Kamalesh , Dinesh , July 2017 International Journal of Image, Graphics and Signal Processing 9(7):45-54.
G. Mokhtari, Q. Zhang, C. Hargrave and J. C. Ralston, "Non-Wearable UWB Sensor for Human Identification in Smart Home," in IEEE Sensors Journal, vol. 17, no. 11, pp. 3332-3340, 1 June1, 2017.
Davis, W., Wilson, D., López, A., Gonzalez, L., & González, F. Automated Assessment and Feedback Systems in Engineering Education: A Machine Learning Approach. Kuwait Journal of Machine Learning, 1(1). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/102
X. Chen, X. Luo, J. Weng, W. Luo, H. Li and Q. Tian, "Multi-View Gait Image Generation for Cross-View Gait Recognition," in IEEE Transactions on Image Processing, vol. 30, pp. 3041-3055, 2021, doi: 10.1109/TIP.2021.3055936.
Wareechol and W. Chiracharit, "Recognition of Similar Gait Pattern Using Transfer Learning DarkNet," 2021 9th International Electrical Engineering Congress (iEECON), 2021, pp. 381-384, doi: 10.1109/iEECON51072.2021.9440386.
P. Limcharoen, N. Khamsemanan and C. Nattee, "Gait Recognition and Re-Identification Based on Regional LSTM for 2-Second Walks," in IEEE Access, vol. 9, pp. 112057-112068, 2021, doi: 10.1109/ACCESS.2021.3102936
Zhang, Y. Huang, S. Yu, and L. Wang, “Cross-view gait recognition by discriminative feature learning,” IEEE Transactions on Image Processing, vol. 29, pp. 1001–1015, 2019
Hiroshi Yamamoto, An Ensemble Learning Approach for Credit Risk Assessment in Banking , Machine Learning Applications Conference Proceedings, Vol 1 2021.