Multi-Scale Hybrid Spectral Network for Feature Learning and Hyperspectral Image Classification
Article Sidebar
Main Article Content
Abstract
Hyperspectral image (HSI) classification is an important concern in remote sensing, but it is complex since few numbers of labelled training samples and the high-dimensional space with many spectral bands. Hence, it is essential to develop a more efficient neural network architecture to improve performance in the HSI classification task. Deep learning models are contemporary techniques for pixel-based hyperspectral image (HSI) classification. Deep feature extraction from both spatial and spectral channels has led to high classification accuracy. Meanwhile, the effectiveness of these spatial-spectral methods relies on the spatial dimension of every patch, and there is no feasible method to determine the best spatial dimension to take into consideration. It makes better sense to retrieve spatial properties through examination at different neighborhood scales in spatial dimensions. In this context, this paper presents a multi-scale hybrid spectral convolutional neural network (MS-HybSN) model that uses three distinct multi-scale spectral-spatial patches to pull out properties in spectral and spatial domains. The presented deep learning framework uses three patches of different sizes in spatial dimension to find these possible features. The process of Hybrid convolution operation (3D-2D) is done on each selected patch and is repeated throughout the image. To assess the effectiveness of the presented model, three benchmark datasets that are openly accessible (Pavia University, Indian Pines, and Salinas) and new Indian datasets (Ahmedabad-1 and Ahmedabad-2) are being used in experimental studies. Empirically, it has been demonstrated that the presented model succeeds over the remaining state-of-the-art approaches in terms of classification performance.
Article Details
References
M. Imani and H. Ghassemian, “An overview on spectral and spatial information fusion for hyperspectral image classification: Current trends and challenges,” Information fusion, Vol. 59, pp. 59–83, 2020, doi: 10.1016/j.inffus.2020.01.007.
S. Prasad and J. Chanussot, “Hyperspectral Image Analysis”, Advances in Machine Learning and Signal Processing, Britania Raya, UK: Springer Nature, 2020, doi:10.1007/978-3-030-38617-7.
M. Kanthi, T. H. Sarma, and C. S. Bindu, “A Survey: Deep Learning Classifier for Hyperspectral Image Classification”, Journal of Theoretical and Applied Information Technology, Vol. 99, No. 24, pp. 6042-6053, 2021.
Scholkopf, Bernhard, and A. J. Smola, “Learning with kernels: support vector machines, regularization, optimization, and beyond”, MIT press, 2018.
Yang, Xiaofei, Y. Ye, X. Li, R. Y. K. Lau, X. Zhang, and X. Huang, "Hyperspectral image classification with deep learning models." IEEE Transactions on Geoscience and Remote Sensing, Vol. 56, No. 9, pp. 5408-5423, 2018, doi: 10.1109/TGRS.2018.2815613.
K. Murali, T. H. Sarma, and C. S. Bindu, "Hybrid learning approach for feature extraction and classification in hyperspectral images", Indian Journal of Computer Science and Engineering (IJCSE), Vol. 12, No. 6, pp. 1559-1567, 2021.
M. E. Paoletti, J. M. Haut, J. Plaza, and A. Plaza, “Deep learning classifiers for hyperspectral imaging: A review”, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 158, pp. 279-317, 2019, doi: 10.1016/j.isprsjprs.2019.09.006.
M. E. Paoletti, J. M. Haut, J. Plaza, and A. Plaza, “A new deep convolutional neural network for fast hyperspectral image classification,” ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 145, pp. 120–147, 2018, doi: 10.1016/j.isprsjprs.2017.11.021.
M. Hamouda, K. S. Ettabaa, and M. S. Bouhlel, “Smart feature extraction and classification of hyperspectral images based on convolutional neural networks,” IET Image Processing, vol. 14, no. 10, pp. 1999–2005, 2020, doi: 10.1049/iet-ipr.2019.1282.
B. Pan, Z. Shi, and X. Xu, “Mugnet: Deep learning for hyperspectral image classification using limited samples,” ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 145, pp. 108–119, 2018, doi: 10.1016/j.isprsjprs.2017.11.003.
L. Fang, N. He, S. Li, A. J. Plaza, and J. Plaza, “A New Spatial–Spectral Feature Extraction Method for Hyperspectral Images Using Local Covariance Matrix Representation,” in IEEE Transactions on Geoscience and Remote Sensing, vol. 56, no. 6, pp. 3534-3546, June 2018, doi: 10.1109/TGRS.2018.2801387.
Liu, Bing, X. Yu, P. Zhang, X. Tan, A. Yu, and Z. Xue, "A semi-supervised convolutional neural network for hyperspectral image classification", Remote Sensing Letters, Vol. 8, No. 9, pp. 839-848, 2017, doi:10.1080/2150704X.2017.1331053.
Sarma, Vivek, A. Diba, T. Tuytelaars, and L. V. Gool, "Hyperspectral CNN for image classification & band selection, with application to face recognition", Technical report KUL/ESAT/PSI/1604, KU Leuven, ESAT, Leuven, Belgium, 2016.
Hamida, A. Ben, A. Benoit, P. Lambert, and C. B. Amar, "3-D deep learning approach for remote sensing image classification", IEEE Transactions on geoscience and remote sensing, Vol. 56, No. 8, pp. 4420-4434, 2018, doi: 10.1109/TGRS.2018.2818945.
He, Mingyi, B. Li, and H. Chen, "Multi-scale 3D deep convolutional neural network for hyperspectral image classification", In 2017 IEEE International Conference on Image Processing (ICIP), IEEE, pp. 3904-3908, 2017, doi: 10.1109/ICIP.2017.8297014.
Mrs. Ritika Dhabliya. (2020). Obstacle Detection and Text Recognition for Visually Impaired Person Based on Raspberry Pi. International Journal of New Practices in Management and Engineering, 9(02), 01 - 07. https://doi.org/10.17762/ijnpme.v9i02.83
Liu, Peng, H. Zhang, and K. B. Eom, "Active deep learning for classification of hyperspectral images.", IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 10, No. 2, pp. 712-724, 2016, doi: 10.1109/JSTARS.2016.2598859.
Zhu, Jian, L. Fang, and P. Ghamisi, "Deformable convolutional neural networks for hyperspectral image classification.", IEEE Geoscience and Remote Sensing Letters, Vol. 15, No. 8, pp. 1254-1258, 2018, doi: 10.1109/LGRS.2018.2830403.
Yue, Jun, W. Zhao, S. Mao, and H. Liu, "Spectral–spatial classification of hyperspectral images using deep convolutional neural networks.", Remote Sensing Letters, Vol. 6, No. 6, pp. 468-477, 2015, doi: 10.1080/2150704X.2015.1047045.
Zhao, Wenzhi, and S. Du. "Spectral–spatial feature extraction for hyperspectral image classification: A dimension reduction and deep learning approach.", IEEE Transactions on Geoscience and Remote Sensing, Vol. 54, No. 8, pp. 4544-4554, 2016, doi: 10.1109/TGRS.2016.2543748.
Chen, Yushi, H. Jiang, C. Li, X. Jia, and P. Ghamisi, "Deep feature extraction and classification of hyperspectral images based on convolutional neural networks.", IEEE Transactions on Geoscience and Remote Sensing, Vol. 54, No. 10, pp. 6232-6251, 2016, doi: 10.1109/TGRS.2016.2584107.
Lee, Hyungtae, and H. Kwon, "Contextual deep CNN based hyperspectral classification.", In 2016 IEEE international geoscience and remote sensing symposium (IGARSS), IEEE, pp. 3322-3325, 2016, doi: 10.1109/IGARSS.2016.7729859.
Hamida, A. Ben, A. Benoit, P. Lambert, and C. B. Amar, "3-D deep learning approach for remote sensing image classification", IEEE Transactions on geoscience and remote sensing, Vol. 56, No. 8, pp. 4420-4434, 2018, doi: 10.1109/TGRS.2018.2818945.
K. Murali, T. H. Sarma, and C. S. Bindu, "A 3D-deep CNN based feature extraction and hyperspectral image classification.", In 2020 IEEE India Geoscience and Remote Sensing Symposium (InGARSS), IEEE, pp. 229-232, 2020, doi: 10.1109/InGARSS48198.2020.9358920.
Roy, S. Kumar, G. Krishna, S. R. Dubey, and B. Chaudhuri, "HybridSN: Exploring 3-D–2-D CNN feature hierarchy for hyperspectral image classification.", IEEE Geoscience and Remote Sensing Letters, Vol. 17, No. 2, pp. 277-281, 2019, doi: 10.1109/LGRS.2019.2918719.
B. Raviteja, M. S. P. Babu, K. V. Rao, and J. Harikiran, “A New Methodology of Hierarchical Image Fusion in Framework for Hyperspectral Image Segmentation,” Indonesian Journal of Electrical Engineering and Computer Science, Vol. 6, No. 1, pp. 58-65, 2017.
S. Wan, C. Gong, P. Zhong, B. Du, L. Zhang, and J. Yang, “Multiscale Dynamic Graph Convolutional Network for Hyperspectral Image Classification.”, IEEE Transactions on Geoscience and Remote Sensing, Vol. 58, No. 5, pp. 3162-3177, 2020, doi: 10.1109/TGRS.2019.2949180.
Z. Meng, L. Li, L. Jiao, Z. Feng, X. Tang, and M. Liang, “Fully dense multiscale fusion network for hyperspectral image classification.”, Remote Sensing, Vol. 11, No. 22, 2019, doi: 10.3390/rs11222718.
Harris, K., Green, L., Perez, A., Fernández, C., & Pérez, C. Exploring Reinforcement Learning for Optimal Resource Allocation. Kuwait Journal of Machine Learning, 1(4). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/155
Viswanathan, D., Kumari, S., & Navaneetham, P. (2023). Soft C-means Multi objective Metaheuristic Dragonfly Optimization for Cluster Head Selection in WSN. International Journal of Intelligent Systems and Applications in Engineering, 11(2s), 88–95. Retrieved from https://ijisae.org/in
Mohan and M. Venkatesan, “HybridCNN based hyperspectral image classification using multiscale spatiospectral features”, Infrared Physics & Technology, Vol. 108, 2020, doi: 10.1016/j.infrared.2020.103326.
M. Kanthi, T. H. Sarma, and C. S. Bindu, "Multi-scale 3D-convolutional neural network for hyperspectral image classification.", Indonesian Journal of Electrical Engineering and Computer Science, Vol. 25, No. 1, pp. 307-316, 2022, doi: 10.11591/ijeecs.v25.i1.pp307-316.
M. K. Tripathi and H. Govil, “Evaluation of AVIRIS-NG hyperspectral images for mineral identification and mapping”, Heliyon, Vol. 5, No. 11, p. e02931, 2019, doi:10.1016/j.heliyon.2019.e02931.