CDBMGCIG: Design of a Cross-Domain Bioinspired Model for identification of Gait Components via Iterated GANs

Main Article Content

Ashish Kumar Misal
Abha Choubey
Siddharth Choubey
Anil Kumar Pandey

Abstract

This Gait identification assists in recognition of human body components from temporal image sequences. Such components consist of connected-body entities including head, upper body, lower body regions. Existing Gait recognition models use deep learning methods including variants of Convolutional Neural Networks (CNNs), Q-Learning, etc. But these methods are either highly complex, or do not perform well under complex background conditions. Moreover, most of these models are validated on a specific environmental condition, and cannot be scaled for general-purpose deployments. To overcome these issues, this text proposes design of a novel cross-domain bioinspired model for identification of gait components via Iterated Generative Adversarial Networks (IGANs). The proposed model initially extracts multidomain pixel-level feature sets from different images. These include frequency components via Fourier analysis, entropy components via Cosine analysis, spatial components via Gabor analysis, and window-based components via Wavelet &Convolutional analysis. These feature sets are processed via a Grey Wolf Optimization (GWO) Model, which assists in identification of high-density & highly variant features for different gait components. These features are classified via an iterated GAN, which comprises of Generator & Discriminator ssModels that assist in evaluating connected body components. These operations generate component-level scores that assist in identification of gait from complex background images. Due to which, the proposed model was observed to achieve 9.5% higher accuracy, 3.4% higher precision, and 2.9% higher recall than existing gait identification methods. The model also uses iterative learning, due to which its accuracy is incrementally improved w.r.t. number of evaluated image sets.

Article Details

How to Cite
Misal, A. K. ., Choubey, A. ., Choubey, S. ., & Pandey, A. K. . (2023). CDBMGCIG: Design of a Cross-Domain Bioinspired Model for identification of Gait Components via Iterated GANs. International Journal on Recent and Innovation Trends in Computing and Communication, 12(1), 10–18. https://doi.org/10.17762/ijritcc.v12i1.7905
Section
Articles

References

Y. Zhang, Y. Huang, S. Yu and L. Wang, "Cross-View Gait Recognition by Discriminative Feature Learning," in IEEE Transactions on Image Processing, vol. 29, pp. 1001-1015, 2020, doi: 10.1109/TIP.2019.2926208.

P. Limcharoen, N. Khamsemanan and C. Nattee, "Gait Recognition and Re-Identification Based on Regional LSTM for 2-Second Walks," in IEEE Access, vol. 9, pp. 112057-112068, 2021, doi: 10.1109/ACCESS.2021.3102936.

Y. Yang, Y. Ge, B. Li, Q. Wang, Y. Lang and K. Li, "Multiscenario Open-Set Gait Recognition Based on Radar Micro-Doppler Signatures," in IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1-13, 2022, Art no. 2519813, doi: 10.1109/TIM.2022.3214271.

H. Chao, K. Wang, Y. He, J. Zhang and J. Feng, "GaitSet: Cross-View Gait Recognition Through Utilizing Gait As a Deep Set," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 7, pp. 3467-3478, 1 July 2022, doi: 10.1109/TPAMI.2021.3057879.

M. Shopon, G. -S. J. Hsu and M. L. Gavrilova, "Multiview Gait Recognition on Unconstrained Path Using Graph Convolutional Neural Network," in IEEE Access, vol. 10, pp. 54572-54588, 2022, doi: 10.1109/ACCESS.2022.3176873.

X. Ben, C. Gong, P. Zhang, R. Yan, Q. Wu and W. Meng, "Coupled Bilinear Discriminant Projection for Cross-View Gait Recognition," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 30, no. 3, pp. 734-747, March 2020, doi: 10.1109/TCSVT.2019.2893736.

L. Tran, T. Hoang, T. Nguyen, H. Kim and D. Choi, "Multi-Model Long Short-Term Memory Network for Gait Recognition Using Window-Based Data Segment," in IEEE Access, vol. 9, pp. 23826-23839, 2021, doi: 10.1109/ACCESS.2021.3056880.

X. Wang, S. Feng and W. Q. Yan, "Human Gait Recognition Based on Self-Adaptive Hidden Markov Model," in IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 18, no. 3, pp. 963-972, 1 May-June 2021, doi: 10.1109/TCBB.2019.2951146.

X. Gu, Y. Guo, F. Deligianni, B. Lo and G. -Z. Yang, "Cross-Subject and Cross-Modal Transfer for Generalized Abnormal Gait Pattern Recognition," in IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 2, pp. 546-560, Feb. 2021, doi: 10.1109/TNNLS.2020.3009448.

A. Zhao et al., "Multimodal Gait Recognition for Neurodegenerative Diseases," in IEEE Transactions on Cybernetics, vol. 52, no. 9, pp. 9439-9453, Sept. 2022, doi: 10.1109/TCYB.2021.3056104.

J. Wu, J. Wang, Q. Gao, M. Pan and H. Zhang, "Path-Independent Device-Free Gait Recognition Using mmWave Signals," in IEEE Transactions on Vehicular Technology, vol. 70, no. 11, pp. 11582-11592, Nov. 2021, doi: 10.1109/TVT.2021.3111600.

Y. Yang, L. Chen, J. Pang, X. Huang, L. Meng and D. Ming, "Validation of a Spatiotemporal Gait Model Using Inertial Measurement Units for Early-Stage Parkinson’s Disease Detection During Turns," in IEEE Transactions on Biomedical Engineering, vol. 69, no. 12, pp. 3591-3600, Dec. 2022, doi: 10.1109/TBME.2022.3172725.

Y. Xu, W. Yang, M. Chen, S. Chen and L. Huang, "Attention-Based Gait Recognition and Walking Direction Estimation in Wi-Fi Networks," in IEEE Transactions on Mobile Computing, vol. 21, no. 2, pp. 465-479, 1 Feb. 2022, doi: 10.1109/TMC.2020.3012784.

Navarajan, J. ., Jebarani, M. R. E. ., & Krishnan, V. G. . (2023). Frequency Reconfigurable Microstrip Patch Antenna for Multiband Applications with RF MEMS Shunt Capacitor Switch. International Journal of Intelligent Systems and Applications in Engineering, 11(3s), 01–07. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2524

P. Limcharoen, N. Khamsemanan and C. Nattee, "View-Independent Gait Recognition Using Joint Replacement Coordinates (JRCs) and Convolutional Neural Network," in IEEE Transactions on Information Forensics and Security, vol. 15, pp. 3430-3442, 2020, doi: 10.1109/TIFS.2020.2985535.

K. Xu, X. Jiang and T. Sun, "Gait Recognition Based on Local Graphical Skeleton Descriptor With Pairwise Similarity Network," in IEEE Transactions on Multimedia, vol. 24, pp. 3265-3275, 2022, doi: 10.1109/TMM.2021.3095809.

L. Zhang, C. Wang, M. Ma and D. Zhang, "WiDIGR: Direction-Independent Gait Recognition System Using Commercial Wi-Fi Devices," in IEEE Internet of Things Journal, vol. 7, no. 2, pp. 1178-1191, Feb. 2020, doi: 10.1109/JIOT.2019.2953488.

H. Wu, J. Tian, Y. Fu, B. Li and X. Li, "Condition-Aware Comparison Scheme for Gait Recognition," in IEEE Transactions on Image Processing, vol. 30, pp. 2734-2744, 2021, doi: 10.1109/TIP.2020.3039888.

A. Sepas-Moghaddam and A. Etemad, "View-Invariant Gait Recognition With Attentive Recurrent Learning of Partial Representations," in IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 3, no. 1, pp. 124-137, Jan. 2021, doi: 10.1109/TBIOM.2020.3031470.

L. Zhang, C. Wang and D. Zhang, "Wi-PIGR: Path Independent Gait Recognition With Commodity Wi-Fi," in IEEE Transactions on Mobile Computing, vol. 21, no. 9, pp. 3414-3427, 1 Sept. 2022, doi: 10.1109/TMC.2021.3052314.

R. Liu et al., "A Wearable Gait Analysis and Recognition Method for Parkinson’s Disease Based on Error State Kalman Filter," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 8, pp. 4165-4175, Aug. 2022, doi: 10.1109/JBHI.2022.3174249.

M. Bukhari et al., "An Efficient Gait Recognition Method for Known and Unknown Covariate Conditions," in IEEE Access, vol. 9, pp. 6465-6477, 2021, doi: 10.1109/ACCESS.2020.3047266.

J. Moon, J. Jung, E. Kang and S. -I. Choi, "Open Set User Identification Using Gait Pattern Analysis Based on Ensemble Deep Neural Network," in IEEE Sensors Journal, vol. 22, no. 17, pp. 16975-16984, 1 Sept.1, 2022, doi: 10.1109/JSEN.2022.3188527.

C. Xu, Y. Makihara, X. Li, Y. Yagi and J. Lu, "Cross-View Gait Recognition Using Pairwise Spatial Transformer Networks," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 1, pp. 260-274, Jan. 2021, doi: 10.1109/TCSVT.2020.2975671.

Q. Zou, Y. Wang, Q. Wang, Y. Zhao and Q. Li, "Deep Learning-Based Gait Recognition Using Smartphones in the Wild," in IEEE Transactions on Information Forensics and Security, vol. 15, pp. 3197-3212, 2020, doi: 10.1109/TIFS.2020.2985628.

W. Sheng, F. Zha, W. Guo, S. Qiu, L. Sun and W. Jia, "Finite Class Bayesian Inference System for Circle and Linear Walking Gait Event Recognition Using Inertial Measurement Units," in IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 28, no. 12, pp. 2869-2879, Dec. 2020, doi: 10.1109/TNSRE.2020.3032703.

J. Luo and T. Tjahjadi, "View and Clothing Invariant Gait Recognition via 3D Human Semantic Folding," in IEEE Access, vol. 8, pp. 100365-100383, 2020, doi: 10.1109/ACCESS.2020.2997814.

Dr. Anasica S, Mrs. Sweta Batra. (2020). Analysing the Factors Involved In Risk Management in a Business. International Journal of New Practices in Management and Engineering, 9(03), 05 - 10. https://doi.org/10.17762/ijnpme.v9i03.89

C. Wang, Z. Li and B. Sarpong, "Multimodal adaptive identity-recognition algorithm fused with gait perception," in Big Data Mining and Analytics, vol. 4, no. 4, pp. 223-232, Dec. 2021, doi: 10.26599/BDMA.2021.9020006.

G. Urkude and M. Pandey, “Design and Development of Density-Based Effective Document Clustering Method Using Ontology,” Multimed. Tools Appl., Apr. 2022.

X. Chen, X. Luo, J. Weng, W. Luo, H. Li and Q. Tian, "Multi-View Gait Image Generation for Cross-View Gait Recognition," in IEEE Transactions on Image Processing, vol. 30, pp. 3041-3055, 2021, doi: 10.1109/TIP.2021.3055936.

Z. Zhang, L. Tran, F. Liu and X. Liu, "On Learning Disentangled Representations for Gait Recognition," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 1, pp. 345-360, 1 Jan. 2022, doi: 10.1109/TPAMI.2020.2998790.

Mondal, D., & Patil, S. S. (2022). EEG Signal Classification with Machine Learning model using PCA feature selection with Modified Hilbert transformation for Brain-Computer Interface Application. Machine Learning Applications in Engineering Education and Management, 2(1), 11–19. Retrieved from http://yashikajournals.com/index.php/mlaeem/article/view/20

G. Urkude and M. Pandey, “AgriSense: Automatic Irrigation Utility System Using Wireless Sensor Network and Web of Things,” in 2019 Second International Conference on Advanced Computational and Communication Paradigms (ICACCP), 2019, pp. 1–6.

G. Urkude and M. Pandey, “AgriOn: A comprehensive ontology for Green IoT based agriculture,” J. Green Eng., vol. 10, no. 9, pp. 7078–7101, 2020.

G. Urkude and M. Pandey, “Contextual triple inference using a semantic reasoner rule to reduce the weight of semantically annotated data on fail–safe gateway for WSN,” J. Ambient Intell. Humaniz. Comput., Jan. 2021.