An Analytical Performance Evaluation on Multiview Clustering Approaches

Article Sidebar

PDF
Published: Jul 25, 2023
DOI: https://doi.org/10.17762/ijritcc.v11i7s.7531
Keywords:
Multi-Kernel Learning, Co-Training, Graph Clustering, Multi-Task Learning, Multiview Clustering, Non-Negative Matrix Factorization, Subspace Clustering

Main Article Content

Jyoti R. Mankar
Research Scholar, Department of Computer Engineering, K. K. Wagh Institute of Engineering Education and Research, Nashik, SavitribaiPhule Pune University, Pune, Maharashtra, India
S. M. Kamalapur
Professor and Research Guide, Department of Computer Engineering, K. K. Wagh Institute of Engineering Education and Research, Nashik, Savitribai Phule Pune University, Pune, Maharashtra, India

Abstract

The concept of machine learning encompasses a wide variety of different approaches, one of which is called clustering. The data points are grouped together in this approach to the problem. Using a clustering method, it is feasible, given a collection of data points, to classify each data point as belonging to a specific group. This can be done if the algorithm is given the collection of data points. In theory, data points that constitute the same group ought to have attributes and characteristics that are equivalent to one another, however data points that belong to other groups ought to have properties and characteristics that are very different from one another. The generation of multiview data is made possible by recent developments in information collecting technologies. The data were collected from à variety of sources and were analysed using a variety of perspectives. The data in question are what are known as multiview data. On a single view, the conventional clustering algorithms are applied. In spite of this, real-world data are complicated and can be clustered in a variety of different ways, depending on how the data are interpreted. In practise, the real-world data are messy. In recent years, Multiview Clustering, often known as MVC, has garnered an increasing amount of attention due to its goal of utilising complimentary and consensus information derived from different points of view. On the other hand, the vast majority of the systems that are currently available only enable the single-clustering scenario, whereby only makes utilization of a single cluster to split the data. This is the case since there is only one cluster accessible. In light of this, it is absolutely necessary to carry out investigation on the multiview data format. The study work is centred on multiview clustering and how well it performs compared to these other strategies.

Article Details

How to Cite
Mankar, J. R. ., & Kamalapur, S. M. . (2023). An Analytical Performance Evaluation on Multiview Clustering Approaches . International Journal on Recent and Innovation Trends in Computing and Communication, 11(7s), 701–715. https://doi.org/10.17762/ijritcc.v11i7s.7531
Issue
Vol. 11 No. 7s (2023)
Section
Articles

References

P. Berkhin, “Survey of clustering data mining techniques,” Yahoo, Sunnyvale, CA, USA, Tech. Rep., 2002, doi: 10.1007/3-540-28349-8_2.

J. G. Saxe, The Blind Men and the Elephant. Hong Kong: Enrich Spot Limited, 2016.

C. Xu, D. Tao, and C. Xu, “A survey on multi-view learning,” 2013, arXiv:1304.5634.

S. Sun, “A survey of multi-view machine learning,” Neural Comput. Appl., vol. 23, no. 7/8, pp. 2031–2038, 2014.

J.Zhao, X. Xie, X. Xu, and S. Sun, “Multi-view learning overview: Recentprogress and new challenges,” Inf. Fusion, vol. 38, pp. 43–54, 2017.

S. Bickel and T. Scheffer, Multi-view clustering, in Proc. 4th IEEE Int. Conf. Data Mining, Brighton, UK, 2004, pp. 19–26.

K. Nigam and R. Ghani, Analyzing the effectiveness and applicability of co-training, in Proc. 9th Int. Conf.Information and Knowledge Management, McLean, VA, USA, 2000, pp. 86–93.

HamidrezaMirzaei “A Novel Multi-view Agglomerative Clustering Algorithm Based on Ensemble of Partitions on Different Views” 2010 International Conference on Pattern Recognition

VikasSindhwani , ParthaNiyogi , Mikhail Belkin “A Co-Regularization Approach to Semi-supervised Learning with Multiple Views”Proceedings of the Workshop on Learning with Multiple Views, 22 nd ICML, Bonn, Germany, 2005

Khetani, V. ., Gandhi, Y. ., Bhattacharya, S. ., Ajani, S. N. ., & Limkar, S. . (2023). Cross-Domain Analysis of ML and DL: Evaluating their Impact in Diverse Domains. International Journal of Intelligent Systems and Applications in Engineering, 11(7s), 253–262.

Yang Li; Dapeng Tao; Weifeng Liu; Yanjiang Wang “Co-regularization for classification” Proceedings 2014 IEEE International Conference on Security, Pattern Analysis, and Cybernetics (SPAC) DOI: 10.1109/SPAC34359.201418-19 Oct. 2014

Kumar, Abhishek, and Hal Daumé. "A co-training approach for multi-view spectral clustering."Proceedings of the 28th International Conference on Machine Learning (ICML-11). 2011.

Nigam, Kamal, and RayidGhani. "Analyzing the effectiveness and applicability of co-training."Proceedings of the ninth international conference on Information and knowledge management.ACM, 2000.

Zhou, Dengyong, and Christopher JC Burges. "Spectral clustering and transductive learning with multiple views."Proceedings of the 24th international conference on Machine learning.ACM, 2007.

Sally El Hajjar, FadiDornaika,, “One-step multi-view spectral clustering with cluster label correlation graph,” IEEE Trans. Knowl. Data Eng., vol. 21, no. 10,pp. 2022–2034, Oct. 2021

L. Meng, A. H. Tan, and D. Xu, Semi-supervised heterogeneous fusion for multimedia data co-clustering, IEEE Trans. Knowl. Data Eng., vol. 26, no. 9, pp. 2293– 2306, 2014.

J. W. Sun, J. Lu, T. Y. Xu, and J. B. Bi, Multi-view sparse co-clustering via proximal alternating linearized minimization, in Proc. 32nd Int. Conf. Machine Learning, Lille, France, 2015, pp. 757–766.

G. Bisson and C. Grimal, An architecture to efficiently learn co-similarities from multi-view datasets, in Proc. 19th Int. Conf. Neural Information Proc., Doha, Qatar, 2012, pp. 184–193.

G. Bisson and C. Grimal, Co-clustering of multi-view datasets: A parallelizable approach, in Proc. IEEE 12th Int. Conf. Data Mining, Brussels, Belgium, 2012, pp. 828– 833.

S. F. Hussain and S. Bashir, Co-clustering of multi-view datasets, Knowl.Inf.Syst., vol. 47, no. 3, pp. 545–570, 2016.

Y. Jiang, J. Liu, Z. C. Li, and H. Q. Lu, Collaborative PLSA for multi-view clustering, in Proc. 21st Int. Conf. Pattern Recognition, Tsukuba, Japan, 2012, pp. 2997–3000.

M. Ghassany, N. Grozavu, and Y. Bennani, Collaborative multi-view clustering, in Proc. 2013 Int. Joint Conf. Neural Networks, Dallas, TX, USA, 2013, pp. 1–8.

V. R. De Sa, P. W. Gallagher, J. M. Lewis, and V. L. Malave, Multi-view kernel construction, Mach. Learn., vol. 79, nos. 1&2, pp. 47–71, 2010.

V. R. De Sa, Learning classification with unlabeled data, in Advances in Neural Information Processing Systems 6, Cambridge, MA, USA, 1993, pp. 112–119.

V. R. De Sa and D. H. Ballard, Category learning through multimodality sensing, Neural Comput., vol. 10, no. 5, pp. 1097–1117, 1998.

S. Yu, L. C. Tranchevent, X. H. Liu, W. Glanzel, J. A. K. Suykens, B. De Moor, and Y. Moreau, Optimized data fusion for kernel k-means clustering, IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 5, pp. 1031–1039, 2012.

M. Gonen and A. A. Margolin, Localized data fusion ¨ for kernel k-means clustering with application to cancer biology, in Proc. 28th Annu. Conf. Neural Information Proc. Systems, Montreal, Canada, 2014, pp. 1305–1313.

Y. T. Lu, L. T. Wang, J. F. Lu, J. Y. Yang, and C. H. Shen, Multiple kernel clustering based on centered kernel alignment, Pattern Recognit., vol. 47, no. 11, pp. 3656– 3664, 2014.

G. Tzortzis and A. Likas, Kernel-based weighted multiview clustering, in Proc. 12th Int. Conf. Data Mining, Brussels, Belgium, 2012, pp. 675–684.

D. Y. Guo, J. Zhang, X. W. Liu, Y. Cui, and C. X. Zhao, Multiple kernel learning based multi-view spectral clustering, in Proc. 22nd Int. Conf. Pattern Recognition, Stockholm, Sweden, 2014, pp. 3774–3779.

X. W. Liu, Y. Dou, J. P. Yin, L. Wang, and E. Zhu, Multiple kernel k-means clustering with matrixinduced regularization, in Proc. 30th AAAI Conf. Artificial Intelligence, Phoenix, AZ, USA, 2016, pp. 1888–1984.

Y. Zhao, Y. Dou, X. W. Liu, and T. Li, A novel multiview clustering method via low-rank and matrix-induced regularization, Neurocomputing, vol. 216, pp. 342–350, 2016.

P. R. Zhang, Y. Yang, B. Peng, and M. J. He, Multi-view clustering algorithm based on variable weight and MKL, in Proc. Int. Joint Conf. Rough Sets, Olsztyn, Poland, 2017, pp. 599–610.

A. Trivedi, P. Rai, H. Daume III, and S. L. DuVall, ´ Multiview clustering with incomplete views, in Proc. Workshop on Machine Learning for Social Computing, Whistler, Canada, 2010. 35. W. X. Shao, X. X. Shi, and P. S. Yu, Clustering on multiple incomplete datasets via collective kernel learning, in Proc. 13th Int. Conf. Data Mining, Dallas, TX, USA, 2013, pp. 1181–1186.

X. W. Liu, M. M. Li, L. Wang, Y. Dou, J. P. Yin, and E. Zhu, Multiple kernel k-means with incomplete kernels, in Proc. 31st AAAI Conf. Artificial Intelligence, San Francisco, CA, USA, 2017, pp. 2259–2265

S. F. Hussain, M. Mushtaq, and Z. Halim, Multi-view document clustering via ensemble method, J .Intell.Inf.Syst., vol. 43, no. 1, pp. 81–99, 2014.

J. C. Ni, H. H. Tong, W. Fan, and X. Zhang, Flexible and robust multi-network clustering, in Proc. 21th ACMSIGKDD Int. Conf. Knowledge Discovery and Data Mining, Sydney, Australia, 2015, pp. 835–844.

V. R. De Sa, Spectral clustering with two views, in Proc. 22ndWorkshop on Learning with Multiple Views, Bonn, Germany, 2005, pp. 20–27.

V. R. De Sa, Learning classification with unlabeled data,in Advances in Neural Information Processing Systems 6,Cambridge, MA, USA, 1993, pp. 112–119.

V. R. De Sa and D. H. Ballard, Category learning throughmultimodality sensing, Neural Comput., vol. 10, no. 5, pp.1097–1117, 1998.

D. Y. Zhou and C. J. C. Burges, Spectral clustering andtransductive learning with multiple views, in Proc. 24thInt. Conf. Machine Learning, Corvalis, OR, USA, 2007,pp. 1159–1166.

Mohan, D. ., Ulagamuthalvi, V. ., Joseph, N. ., & Kulanthaivel, G. . (2023). Patient-Specific Brain Tumor Segmentation using Hybrid Ensemble Classifier to Extract Deep Features. International Journal of Intelligent Systems and Applications in Engineering, 11(4s), 127–135. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2579

Y. Cheng and R. L. Zhao, Multiview spectral clusteringvia ensemble, in Proc. 2009 IEEE Int. Conf. GranularComputing, Nanchang, China, 2009, pp. 101–106.

X. R. Zhao, N. Evans, and J. L. Dugelay, A subspace co-training framework for multi-view clustering, Pattern Recogn.Lett., vol. 41, pp. 73–82, 2014.

C. Zhang et al., “Generalized latent multi-view subspace clustering,”IEEE Trans. Pattern Anal. Mach. Intell., vol. 42, no. 1, pp. 86–99, Jan.2020.

K. Chaudhuri, S. M. Kakade, K. Livescu, and K. Sridharan,Multi-view clustering via canonical correlation analysis, inProc. 26th Annu. Int. Conf. Machine Learning, Montreal,Canada, 2009, pp. 129–136.

Ekaterina Katya, S.R. Rahman. (2020). Void Node Detection and Packet Re-routing in Underwater Wireless Sensor Network. International Journal of New Practices in Management and Engineering, 9(04), 01 - 10. Retrieved from http://ijnpme.org/index.php/IJNPME/article/view/93

Y. H. Guo, Convex subspace representation learning frommulti-view data, in Proc. 27th AAAI Conf. ArtificialIntelligence, Bellevue, WA, USA, 2013, pp. 387–393.

X. R. Zhao, N. Evans, and J. L. Dugelay, A subspaceco-training framework for multi-view clustering, PatternRecogn.Lett., vol. 41, pp. 73–82, 2014.

Sakura Nakamura, Machine Learning in Environmental Monitoring and Pollution Control , Machine Learning Applications Conference Proceedings, Vol 3 2023.

Q. Deng, Y. Yang, M. He, and H. Xing, Locally adaptivefeature weighting for multiview clustering, in Proc. 12thInt. FLINS Conf. Uncertainty Modelling in Knowledge Engineering and Decision Making, Roubaix, France, 2016,pp. 139–145.

H. D. Zhao, Z. M. Ding, and Y. Fu, Multi-view clustering via deep matrix factorization, in Proc. 31st AAAI Conf. Artificial Intelligence, San Francisco, CA, USA, 2017, pp. 2921–2927

Xu Yang, Cheng Deng, Zhiyuan Dang, and DachengTao,DeepMultiview Collaborative Clustering, IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, VOL. 34, NO. 1, JANUARY 2023

Q. Q. Gu and J. Zhou, Learning the shared subspace for multi-task clustering and transductive transfer classification, in Proc. 9 th IEEE Int. Conf. Data Mining, Miami, FL, USA, 2009, pp. 159–168.

Z. H. Zhang and J. Zhou, Multi-task clustering via domain adaptation, Pattern Recogn., vol. 45, no. 1, pp. 465–473, 2012.

S. N. Xie, H. T. Lu, and Y. C. He, Multi-task co-clustering via nonnegative matrix factorization, in Proc. 21st Int. Conf. Pattern Recognition, Tsukuba, Japan, 2012, pp. 2954–2958.

S. Al-Stouhi and C. K. Reddy, Multi-task clustering using constrained symmetric non-negative matrix factorization, in Proc. 2014 SIAM Int. Conf. Data Mining, Philadelphia, PA, USA, 2014, pp. 785–793.

A. Serra, D. Greco, and R. Tagliaferri, Impact of differentmetrics on multi-view clustering, in Proc. 2015 Int. JointConf. Neural Networks, Killarney, Ireland, 2015, pp. 1–8.

Z. Xue, G. R. Li, S. H. Wang, C. J. Zhang, W. G. Zhang,and Q. M. Huang, GOMES: A group-aware multi-viewfusion approach towards real-world image clustering, inProc. 2015 IEEE Int. Conf. Multimedia and Expo, Turin,Italy, 2015, pp. 1–6.

F. P. Nie, J. Li, and X. L. Li, Parameter-free auto-weightedmultiple graph learning: A framework for multiviewclustering and semi-supervised classification, in Proc. 25thInt. Joint Conf. Artificial Intelligence, New York, NY,USA, 2016, pp. 1881–1887.