Interactive Content Based Image Retrieval using Multiuser Feedback

M. Premkumar - GMR Institute of Technology, Rajam, AP, India
R. Sowmya - GMR Institute of Technology, Rajam, AP, India


Citation Format:



DOI: http://dx.doi.org/10.30630/joiv.1.4.57

Abstract


Retrieving images from large databases becomes a difficult task. Content based image retrieval (CBIR) deals with retrieval of images based on their similarities in content (features) between the query image and the target image. But the similarities do not vary equally in all directions of feature space. Further the CBIR efforts have relatively ignored the two distinct characteristics of the CBIR systems: 1) The gap between high level concepts and low level features; 2) Subjectivity of human perception of visual content. Hence an interactive technique called the relevance feedback technique was used. These techniques used user’s feedback about the retrieved images to reformulate the query which retrieves more relevant images during next iterations. But those relevance feedback techniques are called hard relevance feedback techniques as they use only two level user annotation. It was very difficult for the user to give feedback for the retrieved images whether they are relevant to the query image or not. To better capture user’s intention soft relevance feedback technique is proposed. This technique uses multilevel user annotation. But it makes use of only single user feedback. Hence Soft association rule mining technique is also proposed to infer image relevance from the collective feedback. Feedbacks from multiple users are used to retrieve more relevant images improving the performance of the system. Here soft relevance feedback and association rule mining techniques are combined. During first iteration prior association rules about the given query image are retrieved to find out the relevant images and during next iteration the feedbacks are inserted into the database and relevance feedback techniques are activated to retrieve more relevant images. The number of association rules is kept minimum based on redundancy detection.


Keywords


Association rules; Content-based image retrieval; Relevance Inference; Soft relevance feedback.

Full Text:

PDF

References


Peng-Yeng Yin, and Shin-Huei Li, “Content-Based Image Retrieval Using Association Rule Mining with Soft Relevance Feedback,†Journal of Visual Communication and Image Representation, Volume 17, Issue 5, pp.1108-1125, 2006.

Harkamaljit Singh, and Harpreet Kaur, “Content based Image Retrieval using Firefly algorithm and Neural Network,†International Journal of Advanced Research in Computer Science, Volume 8, Issue 1, pp.292-298, 2017.

Javeria Amin, and Annam Zafar, “A Survey: Content Based Image Retrievalâ€, International Journal on Advanced Networking and Applications, Volume 5, Issue 6, pp.2076-2083, 2014.

J.J. Rocchio, “Relevance feedback in information retrieval,†In: G. Salton (Ed.), The SMART System, Prentice Hall Inc., Englewood Cliffs, NJ, pp. 313–323, 1971.

Anita Nanasaheb Ligade, and Manisha R. Patil, “Optimized Content Based Image Retrieval Using Genetic Algorithm With Relevance Feedback Techniqueâ€, International Journal of Computer Science Engineering and Information Technology Research, Volume 3, Issue 4, pp.49-54, 2013.

C. Meilhac and C. Nastar, “Relevance feedback and category search in image database,†In: Proceedings of the International Conference on Multimedia Computing and Systems, pp. 512–517, 1999.

I. Cox, M. Miller, T. Minka, T. Papathomas, and P. Yianilos, “The Bayesian image retrieval system-PicHunter: Theory, implementation, and psychophysical experiments, IEEE Transaction on Image Process, Volume 9, Issue 1, pp.20-37, 2000.

Mutasem K.Alsmadi, “Query-sensitive similarity measure for content-based image retrieval using meta-heuristic algorithmâ€, Journal of King Saud University - Computer and Information Sciences,

Volume 29, Issue 3, pp.426-432, 2017.

Chi Zhang, and Lei Huang, “Content-Based Image Retrieval Using Multiple Featuresâ€, Journal of Computing and Information Technology, Volume 22, Special Issue on LISS, pp.1–10, 2014.

K. Tieu, P. Viola, “Boosting image retrieval,†In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 228–235, 2000.

J.C.M. Lee, and A.K. Jain (Eds.), “Special Issue on Image Databaseâ€, Pattern Recognition 30 No. 4, 1997.

R. Agrawal, R. Srikant, “Fast algorithm for mining association rules,†In: Proceedings of Conference on Very Large Data Bases, Santiago, Chile, pp. 487–499, 1994.

R. Agrawal, T. Imielinski, and A. Swami, “Mining association rules between sets of items in large databases,†in: Proceedings of ACM-SIGMOD, In: Proceeding of International Conference on Management of Data, Washington DC, pp. 207–216, 1993.

P.Y. Yin, B. Bhanu, K.C. Chang, and A. Dong, “Improving retrieval performance by long-term relevance information,†In: Proceedings of the International Conference on Pattern Recognition, Volume 3, pp. 533–536, 2002.

T.S. Huang, X.S. Zhou, M. Nakazato, Y. Wu, and I. Cohen, “Learning in content-based image retrieval,†In: Proceedings of the 2nd International Conference on Development and Learning, pp. 155–162, 2002.

C.-H. Hoi, and M.R. Lyu, “A novel log-based relevance feedback technique in content-based image retrieval,†In: Proceedings of the ACM International Conference on Multimedia, pp. 24–31, 2004.

B. Bhanu, and A. Dong, “Concept learning with fuzzy clustering and relevance feedback,†Machine Learning and Data Mining in Pattern Recognition, Volume 15, pp.102-116, 2002.

P.Y. Yin, B. Bhanu, K.C. Chang, A. Dong, “Integrating relevance feedback techniques for image retrieval using reinforcement learning,†IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 27, Issue 10, 2005.

X. He, W.Y. Ma, O. King, M. Li, and H.J. Zhang, “Learning and inferring a semantic space from user’s relevance feedback for image retrieval,†IEEE Transaction on Circuits and Systems Society, Volume 13, Issue 1, pp.39-48, 2003.

S. Tong, and E.Y. Chang, “Support vector machine active learning for image retrieval,†In: Proceedings of the ACM International Conference on Multimedia, pp. 107–118, 2001.