Image Tagging using Modified Association Rule based on Semantic Neighbors

Article Sidebar

PDF
Published: Aug 18, 2023
DOI: https://doi.org/10.17762/ijritcc.v11i8s.7207
Keywords:
Modified Association Rule, Random Forest Semantic Neighbors, Tag Recommendation

Main Article Content

Anupama Ganesh Phakatkar
Computer Engineering Department, SCTR’S Pune Institute of Computer Technology, Pune, India
Balwant A. Sonkamble
Computer Engineering Department, SCTR’S Pune Institute of Computer Technology, Pune, India

Abstract

With the rapid development of the internet, mobiles, and social image-sharing websites, a large number of images are generated daily.  The huge repository of the images poses challenges for an image retrieval system. On image-sharing social websites such as Flickr, the users can assign keywords/tags to the images which can describe the content of the images. These tags play important role in an image retrieval system. However, the user-assigned tags are highly personalized which brings many challenges for retrieval of the images.  Thus, it is necessary to suggest appropriate tags to the images.


Existing methods for tag recommendation based on nearest neighbors ignore the relationship between tags. In this paper, the method is proposed for tag recommendations for the images based on semantic neighbors using modified association rule. Given an image, the method identifies the semantic neighbors using random forest based on the weight assigned to each category. The tags associated with the semantic neighbors are used as candidate tags. The candidate tags are expanded by mining tags using modified association rules where each semantic neighbor is considered a transaction. In modified association rules, the probability of each tag is calculated using TF-IDF and confidence value.


The experimentation is done on Flickr, NUS-WIDE, and Corel-5k datasets. The result obtained using the proposed method gives better performance as compared to the existing tag recommendation methods.

Article Details

How to Cite
Phakatkar, A. G. ., & Sonkamble, B. A. . (2023). Image Tagging using Modified Association Rule based on Semantic Neighbors. International Journal on Recent and Innovation Trends in Computing and Communication, 11(8s), 279–289. https://doi.org/10.17762/ijritcc.v11i8s.7207
Issue
Vol. 11 No. 8s (2023)
Section
Articles

References

Spyrou, Evaggelos, and Phivos Mylonas. "A survey on Flickr multimedia research challenges." Engineering Applications of Artificial Intelligence 51 (2016): 71-91.

Wainer, Jacques. "Comparison of 14 different families of classification algorithms on 115 binary datasets." arXiv preprint arXiv:1606.00930(2016).

Sigurbjörnsson, Börkur, and Roelof Van Zwol. "Flickr tag recommendation based on collective knowledge." In Proceedings of the 17th international conference on World Wide Web, pp. 327-336. 2008.

Cagliero, Luca, Alessandro Fiori, and Luigi Grimaudo. "Personalized tag recommendation based on generalized rules." ACM Transactions on Intelligent Systems and Technology (TIST) 5, no. 1 (2014): 1-22.

Chen, Xian, and Hyoseop Shin. "Tag recommendation by machine learning with textual and social features." Journal of Intelligent Information Systems 40, no. 2 (2013): 261-282.

Liu, Dong, Xian-Sheng Hua, Linjun Yang, Meng Wang, and Hong-Jiang Zhang. "Tag ranking." In Proceedings of the 18th international conference on World wide web, pp. 351-360. 2009.

Zhang, Xiaoming, Xiaojian Zhao, Zhoujun Li, Jiali Xia, Ramesh Jain, and Wenhan Chao. "Social image tagging using graph-based reinforcement on multi-type interrelated objects." Signal Processing 93, no. 8 (2013): 2178-2189.

Liu, Jing, Mingjing Li, Wei-Ying Ma, Qingshan Liu, and Hanqing Lu. "An adaptive graph model for automatic image annotation." In Proceedings of the 8th ACM international workshop on Multimedia information retrieval, pp. 61-70. 2006.

Liu, Jing, Mingjing Li, Qingshan Liu, Hanqing Lu, and Songde Ma. "Image annotation via graph learning." Pattern recognition 42, no. 2 (2009): 218-228.

Tang, Jinhui, Richang Hong, Shuicheng Yan, Tat-Seng Chua, Guo-Jun Qi, and Ramesh Jain. "Image annotation by k nn-sparse graph-based label propagation over noisily tagged web images." ACM Transactions on Intelligent Systems and Technology (TIST) 2, no. 2 (2011): 1-15.

Pliakos, Konstantinos, and Constantine Kotropoulos. "Simultaneous image tagging and geo-location prediction within hypergraph ranking framework." In 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6894-6898. IEEE, 2014.

Wu, Lin, Xiaodi Huang, Chengyuan Zhang, John Shepherd, and Yang Wang. "An efficient framework of Bregman divergence optimization for co-ranking images and tags in a heterogeneous network." Multimedia Tools and Applications 74, no. 15 (2015): 5635-5660.

Pantraki, Evangelia, and Constantine Kotropoulos. "Automatic image tagging and recommendation via PARAFAC2." In 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1-6. IEEE, 2015.

Rafailidis, Dimitrios, and Petros Daras. "The TFC model: Tensor factorization and tag clustering for item recommendation in social tagging systems." IEEE Transactions on Systems, Man, and Cybernetics: Systems 43, no. 3 (2012): 673-688.

Yong-sheng, Wang. "Image Tag Recommendation Algorithm Using Tensor Factorization." Journal of Multimedia 9, no. 3 (2014).

Hao, Zhangang, Hongwei Ge, and Long Wang. "Visual attention mechanism and support vector machine based automatic image annotation." PloS one 13, no. 11 (2018): e0206971.

Wu, Wei, Jianyun Nie, and Guanglai Gao. "An improved SVM-based multiple features fusion method for image annotation." Journal Of Information &Computational Science 11, no. 14 (2014): 4987-4997.

Li, Xirong, and Cees GM Snoek. "Classifying tag relevance with relevant positive and negative examples." In Proceedings of the 21st ACM international conference on Multimedia, pp. 485-488. 2013.

Landolsi, Mohamed Yassine, Hela Haj Mohamed, and Lotfi Ben Romdhane. "Image annotation in social networks using graph and multimodal deep learning features." Multimedia Tools and Applications (2021): 1-26.

Uricchio, Tiberio, Lamberto Ballan, Lorenzo Seidenari, and Alberto Del Bimbo. "Automatic image annotation via label transfer in the semantic space." Pattern Recognition 71 (2017): 144-157.

Qian, Xueming, Xian-Sheng Hua, Yuan Yan Tang, and Tao Mei. "Social image tagging with diverse semantics." IEEE transactions on cybernetics 44, no. 12 (2014): 2493-2508.

Liu, Jing, Zechao Li, Jinhui Tang, Yu Jiang, and Hanqing Lu. "Personalized geo-specific tag recommendation for photos on social websites." IEEE Transactions on Multimedia 16, no. 3 (2014): 588-600.

Gao, Yue, Meng Wang, Zheng-Jun Zha, Jialie Shen, Xuelong Li, and Xindong Wu. "Visual-textual joint relevance learning for tag-based social image search." IEEE Transactions on Image Processing 22, no. 1 (2012): 363-376.

Zheng, Liu, Zhao Tianlong, Han Huijian, and Zhang Caiming. "Personalized Tag Recommendation Based on Convolution Feature and Weighted Random Walk." International Journal of Computational Intelligence Systems 13, no. 1 (2020): 24-35.

Singh, A. ., & Kumar, V. . (2023). Sentiment Analysis of Customer Satisfaction Towards Repurchase Intension and the Word-Of-Mouth Advertising in Online Shopping Behavior Using Regression Analysis and Statistical Computing Techniques. International Journal of Intelligent Systems and Applications in Engineering, 11(2s), 45–51. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2506

Ma, Yanchun, Yongjian Liu, Qing Xie, and Lin Li. "CNN-feature based automatic image annotation method." Multimedia Tools and Applications 78, no. 3 (2019): 3767-3780.

Ji, Qian, Liyan Zhang, Xiangbo Shu, and Jinhui Tang. "Image annotation refinement via 2P-KNN based group sparse reconstruction." Multimedia Tools and Applications 78, no. 10 (2019): 13213-13225.

Maihami, Vafa, and Farzin Yaghmaee. "Automatic image annotation using community detection in neighbor images." Physica A: Statistical Mechanics and its Applications 507 (2018): 123-132.

Zhang, Jing, Ying Yang, Qi Tian, Li Zhuo, and Xin Liu. "Personalized social image recommendation method based on user-image-tag model." IEEE Transactions on Multimedia 19, no. 11 (2017): 2439-2449.

Cui, Chaoran, Jialie Shen, Jun Ma, and Tao Lian. "Social tag relevance learning via ranking-oriented neighbour voting." Multimedia Tools and Applications 76, no. 6 (2017): 8831-8857.

Verma, Yashaswi, and C. V. Jawahar. "Image annotation by propagating labels from semantic neighbourhoods." International Journal of Computer Vision 121, no. 1 (2017): 126-148.

Ji, Qian, Liyan Zhang, and Zechao Li. "KNN-based image annotation by collectively mining visual and semantic similarities." KSII Transactions on Internet and Information Systems (TIIS) 11, no. 9 (2017): 4476-4490.

Lee, Sihyoung, Wesley De Neve, and Yong Man Ro. "Visually weighted neighbor voting for image tag relevance learning." Multimedia tools and applications 72, no. 2 (2014): 1363-1386.

Qian, Xueming, Xiaoxiao Liu, Chao Zheng, Youtian Du, and Xingsong Hou. "Tagging photos using users' vocabularies." , Neurocomputing 111 (2013): 144-153.

Li, Xirong, Cees GM Snoek, and Marcel Worring. "Learning social tag relevance by neighbor voting." IEEE Transactions on Multimedia 11, no. 7 (2009): 1310-1322.

Guillaumin, Matthieu, Thomas Mensink, Jakob Verbeek, and Cordelia Schmid. "Tagprop: Discriminative metric learning in nearest neighbor models for image auto-annotation." In 2009 IEEE 12th international conference on computer vision, pp. 309-316. IEEE, 2009.

Han, Jiawei, Micheline Kamber, and Jian Pei. "Data mining concepts and techniques third edition." The Morgan Kaufmann Series in Data Management Systems 5, no. 4 (2011): 83-124.

Dondekar Anupama D., & Balwant A. Sonkamble. “Hybrid Feature based Classification of Images using Supervised Methods for Tag Recommendation.” International Journal of Innovative Technology and Exploring Engineering (IJITEE) 9, no 11(2020): 135–138.

Rodriguez-Galiano, Victor Francisco, Bardan Ghimire, John Rogan, Mario Chica-Olmo, and Juan Pedro Rigol-Sanchez. "An assessment of the effectiveness of a random forest classifier for land-cover classification." ISPRS Journal of Photogrammetry and Remote Sensing 67 (2012): 93-104.

Dondekar Anupama D., and Balwant A. Sonkamble. "Analysis of Flickr Images Using Feature Extraction Techniques." In 2019 IEEE 4th International Conference on Computer and Communication Systems (ICCCS), pp. 278-282. IEEE, 2019.

Dondekar Anupama D., and Balwant A. Sonkamble. "Tag-based Image Retrieval using Hybrid Visual-Tag Feature Extraction Method", International Journal of Advanced Science and Technology, 9(4), 5931 – 5940, 2020.

Chua, Tat-Seng, Jinhui Tang, Richang Hong, Haojie Li, Zhiping Luo, and Yantao Zheng. "Nus-wide: a real-world web image database from national university of singapore." In Proceedings of the ACM international conference on image and video retrieval, pp. 1-9. 2009.

Duygulu, Pinar, Kobus Barnard, Joao FG de Freitas, and David A. Forsyth. "Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary." In European conference on computer vision, pp. 97-112. Springer, Berlin, Heidelberg, 2002.

Liaw, Andy and Matthew Wiener. "Classification and regression by random Forest." R news 2, no. 3 (2002): 18-22.

Breiman, Leo. "Random forests." Machine learning 45, no. 1 (2001): 5-32.