Abstract
The rapid growth of digital image collections has prompted the need for development of software tools that facilitate efficient searching and retrieval of images from large image databases. Towards this goal, we propose a content-based image retrieval scheme for retrieval of images via their color, texture, and shape features. Using three specialized histograms (i.e. color, wavelet, and edge histograms), we show that a more accurate representation of the underlying distribution of the image features improves the retrieval quality. Furthermore, in an attempt to better represent the user’s information needs, our system provides an interactive search mechanism through the user interface. Users searching through the database can select the visual features and adjust the associated weights according to the aspects they wish to emphasize. The proposed histogram-based scheme has been thoroughly evaluated using two general-purpose image datasets consisting of 1000 and 3000 images, respectively. Experimental results show that this scheme not only improves the effectiveness of the CBIR system, but also improves the efficiency of the overall process.













Similar content being viewed by others
Notes
The response time is displayed in the GUI every time the user clicks the ‘Search Similar Images’ button.
References
Agarwal M, Maheshwari R (2012) Á Trous gradient structure descriptor for content based image retrieval. International Journal of Multimedia Information Retrieval 1(2):129–138
Androutsos D, Plataniotis KN, Venetsanopoulos AN (1999) A novel vector-based approach to color image retrieval using a vector angular-based distance measure. Comput Vis Image Underst 75(1-2):46–58
Babu CR, Reddy ES, Rao BP (2015) Age group classification of facial images using rank based edge texture unit (retu). In: Information Systems Design and Intelligent Applications. Springer, pp 483–496
Carson C, Thomas M, Belongie S, Hellerstein JM, Malik J (1999) Blobworld: A system for region-based image indexing and retrieval. In: Visual Information and Information Systems. Springer, pp 509–517
Chun YD, Seo SY, Kim NC (2003) Image retrieval using BDIP and BVLC moments. IEEE Trans Circuits Syst Video Technol 13(9):951–957
Chun YD, Kim NC, Jang IH (2008) Content-based image retrieval using multiresolution color and texture features. IEEE Trans Multimedia 10(6):1073–1084
Cox IJ, Miller ML, Minka TP, Papathomas TV, Yianilos PN (2000) The bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments. IEEE Trans Image Process 9(1):20–37
Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv 40(2):5:1–5:60
Deng Y, Manjunath B (1999) An efficient low-dimensional color indexing scheme for region-based image retrieval. In: 1999 IEEE International conference on acoustics, speech, and signal processing, vol 6. IEEE, pp 3017–3020
Faloutsos C, Barber R, Flickner M, Hafner J, Niblack W, Petkovic D, Equitz W (1994) Efficient and effective querying by image content. J Intell Inf Syst 3(3-4):231–262
Flickner M, Sawhney H, Niblack W, Ashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Yanker P (1995) Query by image and video content: The QBIC system. Computer 28(9):23–32
Fonseca MJ, Ferreira A, Jorge JA (2006) Generic shape classification for retrieval. In: Graphics Recognition. Ten Years Review and Future Perspectives, vol 3926. Springer, pp 291–299
Gevers T, Smeulders AWM (2000) PicToSeek: Combining color and shape invariant features for image retrieval. IEEE Trans Image Process 9(1):102–119
Gudivada VN, Raghavan VV (1995) Content based image retrieval systems. Computer 28(9):18–22
Guldogan E, Gabbouj M (2009) Dynamic feature weights with relevance feedback in content-based image retrieval. In: 24th International Symposium on Computer and Information Sciences. IEEE, pp 56–59
Han J, Ma KK (2007) Rotation-invariant and scale-invariant gabor features for texture image retrieval. Image Vision Comput 25(9):1474–1481
Han JW, Guo L (2003) A shape-based image retrieval method using salient edges. Signal processing: Image communication 18(2):141–156
Haralick RM, Shanmugam K, Dinstein I (1973) Textural features for image classification. IEEE Trans Syst Man Cybern SMC 3(6):610–621
Hu MK (1962) Visual pattern recognition by moment invariants. IRE Trans Inf Theory 8(2):179– 187
Huang J, Kumar SR, Mitra M, Zhu WJ, Zabih R (1997) Image indexing using color correlograms. In: 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE, pp 762–768
Huiskes MJ, Lew MS (2008) The MIR Flickr retrieval evaluation. In: Proceedings of the 1st ACM International Conference on Multimedia Information Retrieval. ACM, pp 39–43
Jain AK, Vailaya A (1996) Image retrieval using color and shape. Pattern Recogn 29(8):1233–1244
Jégou H, Douze M, Schmid C, Pérez P (2010) Aggregating local descriptors into a compact image representation. IEEE
Jeong S, Won CS, Gray RM (2004) Image retrieval using color histograms generated by gauss mixture vector quantization. Comput Vis Image Underst 94 (1-3):44–66
Jiawei H, Kamber M (2006) Data mining: concepts and techniques, 2nd edn. Morgan Kaufmann, USA
Kokare M, Biswas PK, Chatterji BN (2007) Texture image retrieval using rotated wavelet filters. Pattern Recogn Lett 28(10):1240–1249
Li X (2003) Image retrieval based on perceptive weighted color blocks. Pattern Recogn Lett 24(12):1935–1941
Liapis S, Tziritas G (2004) Color and texture image retrieval using chromaticity histograms and wavelet frames. IEEE Trans Multimedia 6(5):676–686
Lin CH, Chen RT, Chan YK (2009) A smart content-based image retrieval system based on color and texture feature. Image Vision Comput 27(6):658–665
Liu F, Picard RW (1996) Periodicity, directionality, and randomness: Wold features for image modeling and retrieval. IEEE Trans Pattern Anal Mach Intell 18 (7):722–733
Liu Y, Zhang D, Lu G, Ma WY (2007) A survey of content-based image retrieval with high-level semantics. Pattern Recogn 40(1):262–282
Llorente A, Manmatha R, Rüger S (2010) Image retrieval using markov random fields and global image features. In: Proceedings of the ACM International Conference on Image and Video Retrieval. ACM, pp 243–250
Long F, Zhang H, Feng DD (2003) Fundamentals of content-based image retrieval. In: Multimedia Information Retrieval and Management. Springer, pp 1–26
Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110
Lu TC, Chang CC (2007) Color image retrieval technique based on color features and image bitmap. Inf Process Manag 43(2):461–472
Ma WY, Manjunath BS (1999) NeTra: A toolbox for navigating large image databases. Multimedia Syst 7(3):184–198
Manjunath BS, Ma WY (1996) Texture features for browsing and retrieval of image data. IEEE Trans Pattern Anal Mach Intell 18(8):837–842
Manjunath BS, Ohm JR, Vasudevan VV, Yamada A (2001) Color and texture descriptors. IEEE Trans Circuits Syst Video Technol 11(6):703–715
Manning CD, Raghavan P, Schütze H (2008) Introduction to information retrieval. Cambridge university press, New York
Matias Y, Vitter JS, Wang M (1998) Wavelet-based histograms for selectivity estimation. In: Proceedings of the 1998 ACM SIGMOD International Conference on Management of Data. ACM, pp 448– 459
Oliva A, Torralba A (2001) Modeling the shape of the scene: a holistic representation of the spatial envelope. Int J Comput Vis 42(3):145–175
Ooi BC, Tan KL, Chua TS, Hsu W (1998) Fast image retrieval using color-spatial information. VLDB J 7(2):115–128
Pass G, Zabih R, Miller J (1996) Comparing images using color coherence vectors. In: Proceedings of the Fourth ACM International Conference on Multimedia. ACM, pp 65–73
Pentland A, Picard RW, Sclaroff S (1996) Photobook: Content-based manipulation of image databases. Int J Comput Vision 18(3):233–254
Persoon E, Fu KS (1977) Shape discrimination using fourier descriptors. IEEE Trans Syst Man Cybern 7(3):170–179
Pi MH, Tong CS, Choy SK, Zhang H (2006) A fast and effective model for wavelet subband histograms and its application in texture image retrieval. IEEE Trans Image Process 15(10):3078–3088
Puzicha J, Hofmann T, Buhmann JM (1997) Non-parametric similarity measures for unsupervised texture segmentation and image retrieval. In: 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE, pp 267–272
Rao LK, Rao DV (2015) Local quantized extrema patterns for content-based natural and texture image retrieval. HCIS 5(1):1–24
Razavian AS, Azizpour H, Sullivan J, Carlsson S (2014) CNN features off-the-shelf: an astounding baseline for recognition. In: 2014 IEEE Conference on computer vision and pattern recognition workshops(CVPRW). IEEE, pp 512–519
Robinson GS (1977) Edge detection by compass gradient masks. Comput Graphics Image Process 6(5):492–501
Rui Y, Huang TS, Ortega M, Mehrotra S (1998) Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans Circuits Syst Video Technol 8(5):644–655
Rui Y, Huang TS, Chang SF (1999) Image retrieval: Current techniques, promising directions, and open issues. J Vis Commun Image R 10(1):39–62
Sikora T (2001) The mpeg-7 visual standard for content description an overview. IEEE Trans Circuits Syst Video Technol 11(6):696–702
Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12):1349–1380
Smith AR (1978) Color gamut transform pairs. In: Proceedings of the 5th Annual Conference on Computer Graphics and Interactive Techniques, ACM, SIGGRAPH ’78, pp 12–19
Smith J, Chang SF (1996a) Automated binary texture feature sets for image retrieval. In: 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol 4. IEEE, pp 2239– 2242
Smith JR, Chang SF, 1996b VisualSEEk: a fully automated content-based image query system. In: Proceedings of the 4th ACM international conference on Multimedia. ACM, pp 87–98
Stricker MA, Orengo M (1995) Similarity of color images Proceedings of the SPIE 2420, storage and retrieval for image and video databases, vol III, pp 381–392
Subrahmanyam M, Wu QJ, Maheshwari R, Balasubramanian R (2013) Modified color motif co-occurrence matrix for image indexing and retrieval. Comput Electr Eng 39(3):762–774
Swain MJ, Ballard DH (1991) Color indexing. Int J Comput Vision 7(1):11–32
Veltkamp RC, Tanase M (2002) A survey of content-based image retrieval systems. In: Content-Based Image and Video Retrieval, vol 21. Springer, USA, pp 47–101
Wan X, Kuo CCJ (1996) Color distribution analysis and quantization for image retrieval Proceedings of the SPIE 2670, storage and retrieval for still image and video databases, vol IV, pp 8–16
Wang JZ, Wiederhold G, Firschein O, Wei SX (1998) Content-based image indexing and searching using daubechies’ wavelets. Int J Digit Libr 1(4):311–328
Wang JZ, Li J, Wiederhold G (2001) SIMPLIcity: Semantics-sensitive integrated matching for picture libraries. IEEE Trans Pattern Anal Mach Intell 23(9):947–963
Wang XY, Yu YJ, Yang HY (2011) An effective image retrieval scheme using color, texture and shape features. Comp Stand Inter 33(1):59–68
Wei CH, Li Y, Chau WY, Li CT (2009) Trademark image retrieval using synthetic features for describing global shape and interior structure. Pattern Recogn 42 (3):386–394
Wu Y, Zhang A (2002) A feature re-weighting approach for relevance feedback in image retrieval. In: 2002 International Conference on Image Processing, vol 2. IEEE, pp II–581–II–584
Xu X, Lee DJ, Antani S, Long LR (2008) A spine X-ray image retrieval system using partial shape matching. IEEE Trans Inf Technol Biomed 12(1):100–108
Yoo HW, Park HS, Jang DS (2005) Expert system for color image retrieval. Expert Syst Appl 28(2):347–357
Zhang S, Tianm Q, Hua G, Huang Q, Li S (2009) Descriptive visual words and visual phrases for image applications. In: Proceedings of the 17th ACM international conference on Multimedia. ACM, pp 75–84
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interests
The authors declare that they have no conflict of interest.
Funding
This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.
Rights and permissions
About this article
Cite this article
Khokher, A., Talwar, R. A fast and effective image retrieval scheme using color-, texture-, and shape-based histograms. Multimed Tools Appl 76, 21787–21809 (2017). https://doi.org/10.1007/s11042-016-4096-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-016-4096-5