Content-Based Natural language processing using Semantic Assisted Visual Hashing
Keywords:
CBIR, Semantic Assistance, Visual Hashing, Text Auxiliaries, Unsupervised Learning.Abstract
This is a new technology to support scalable content-based image retrieval (CBIR]), hashing has been recently been focused and future directions of research domain. In this paper, we propose a unique unsupervised visual hashing approach called semantic-assisted visual hashing (SAVH). Distinguished from semi-supervised and supervised visual hashing, its core idea emphatically extracts the rich semantics latently embedded in auxiliary texts of images to boost the effectiveness of visual hashing without any explicit semantic labels. To expand the reach, a unsupervised framework is advanced to learn hash codes by simultaneously preserving visual similarities of images, integrating the semantic assistance from texts on modeling high relationships of inter images and defining the correlations between images and shared contents.
References
- J.-H. Su, W.-J. Huang, P. S. Yu, and V. S. Tseng, ―Efficient relevance feedback for content-based image retrieval by mining user navigation patterns.‖ IEEE Trans. Knowl. Data Eng., vol. 23, no. 3, pp. 360–372, 2011.
- P. Wu, S. C. H. Hoi, P. Zhao, C. Miao, and Z. Liu, ―Online multi-modal distance metric learning with application to image retrieval,‖ IEEE Trans. Knowl. Data Eng., vol. 28, no. 2, pp. 454–467, 2016.
- J. Song, Y. Yang, Z. Huang, H. T. Shen, and J. Luo, ―Effective multiple feature hashing for large-scale near-duplicate video retrieval.‖ IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1997– 2008, 2013.
- J. Song, Y. Yang, Z. Huang, H. T. Shen, and R. Hong, ―Multiple feature hashing for real-time large scale near-duplicate video retrieval,‖ in Proc. ACM Int. Conf. Multimedia (MM), 2011, pp. 423– 432.
- V. Jagadeesh, R. Piramuthu, A. Bhardwaj, W. Di, and N. Sundaresan, ―Large scale visual recommendations from street fashion images,‖ in Proc. ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining (SIGKDD), 2014, pp. 1925–1934.
- J. Sivic and A. Zisserman, ―Video Google: A text retrieval approach to object matching in videos,‖ in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), 2003, pp. 1470–1477.
- P. Ciaccia, M. Patella, and P. Zezula, ―M-tree: An efficient access method for similarity search in metric spaces,‖ in Proc. Int. Conf. Very Large Data Bases (VLDB), 1997, pp. 426–435.
- J. Wang, H. T. Shen, J. Song, and J. Ji, ―Hashing for similarity search: A survey,‖ CoRR, vol. abs/1408.2927, 2014.
- L. Gao, J. Song, X. Liu, J. Shao, J. Liu, and J. Shao, ―Learning in high-dimensional multimedia data: the state of the art,‖ Multimedi Syst., pp. 1–11, 2015.
- Y. Weiss, A. Torralba, and R. Fergus, ―Spectral hashing,‖ in Proc. Advances in Neural Information Processing Systems (NIPS), 2008, pp. 1753–1760.
- M.D. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. afner, D. Lee, D. Steele, and P. Yanker,―Query by Image and Video Content: The QBIC System,‖Computer, vol. 28, no. 9, pp. 23-32, Sept. 1995.
- R. Fagin, ―Combining Fuzzy Information from Multiple Systems,‖Proc. Symp. Principles of Database Systems (PODS), pp. 216-226, June 1996.
- R. Fagin, ―Fuzzy Queries in Multimedia Database Systems,‖ Proc. Symp. Principles of Database Systems (PODS), pp. 1-10, June 1998.
- J. French and X-Y. Jin, ―An Empirical Investigation of the Scalability of a Multiple Viewpoint CBIR[1] System,‖ Proc. Int’l Conf. Image and Video Retrieval (CIVR), pp. 252-260, July 2004.
- D. Zhang, J. Wang, D. Cai, and J. Lu, “Self-taught hashing for fast similarity search,” in Proc. Int. ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2010, pp. 18–25.
Downloads
Published
Issue
Section
License
Copyright (c) IJSRSET
This work is licensed under a Creative Commons Attribution 4.0 International License.