Automatic Leaf Recognition from a Big Hierarchical Image Database
Corresponding Author
Huisi Wu
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, People's Republic of China
Author to whom all correspondence should be addressed; e-mail: [email protected].Search for more papers by this authorLei Wang
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, People's Republic of China
Search for more papers by this authorFeng Zhang
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, People's Republic of China
Search for more papers by this authorZhenkun Wen
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, People's Republic of China
e-mail: [email protected].
Search for more papers by this authorCorresponding Author
Huisi Wu
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, People's Republic of China
Author to whom all correspondence should be addressed; e-mail: [email protected].Search for more papers by this authorLei Wang
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, People's Republic of China
Search for more papers by this authorFeng Zhang
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, People's Republic of China
Search for more papers by this authorZhenkun Wen
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, People's Republic of China
e-mail: [email protected].
Search for more papers by this authorAbstract
Automatic plant recognition has become a research focus and received more and more attentions recently. However, existing methods usually only focused on leaf recognition from small databases that usually only contain no more than hundreds of species, and none of them reported a stable performance in either recognition accuracy or recognition speed when compared with a big image database. In this paper, we present a novel method for leaf recognition from a big hierarchical image database. Unlike the existing approaches, our method combines the textural gradient histogram with the shape context to form a more distinctive feature for leaf recognition. To achieve efficient leaf image retrieval, we divided the big database into a set of subsets based on mean-shift clustering on the extracted features and build hierarchical k-dimensional trees (KD-trees) to index each cluster in parallel. Finally, the proposed parallel indexing and searching schemes are implemented with MapReduce architectures. Our method is evaluated with extensive experiments on different databases with different sizes. Comparisons to state-of-the-art techniques were also conducted to validate the proposed method. Both visual results and statistical results are shown to demonstrate its effectiveness.
References
- 1Wang XF, Du JX, Zhang GJ. Recognition of leaf images based on shape features using a hypersphere classifier. Lect Notes Comput Sci 2005; 3644: 87–96.
10.1016/j.entcs.2004.11.008 Google Scholar
- 2Im C, NiShida H, Tosiyasu L. Recognizing plant species by leaf shapes-a case study of the acer family. In: 14th Int Conf on Pattern Recognition, Brisbane, Australia; August 16–20, 1998. pp 1171–1173.
- 3Wu S, Bao F, Xu E. A leaf recognition algorithm for plant classification using probabilistic neural network. In: IEEE Int Symp on Signal Processing and Information Technology, Cairo, Egypt; December 15–18, 2007. pp 11–16.
- 4Uluturk C, Ugur A. Recognition of leaves based on morphological features derived from two half-regions. In: Int Symposium on Innovations in Intelligent Systems and Applications (INISTA), Trabzon, Turkey; July 2–4, 2012. pp 1–4.
- 5Shabanzade M, Zahedi M, Aghvami S. Combination of local descriptors and global features for leaf recognition. Signal Image Process 2011; 2(3): 23–31.
- 6Zulkifli Z, Saad P, Mohtar I. Plant leaf identification using moment invariants & general regression neural network. In: 11th Int Conf on Hybrid Intelligent Systems, Malacca, Malaysia; December 5–8, 2011. pp 430–435.
- 7Wu H, Pu P, He G, Zhang B, Zhao F. Fast and robust leaf recognition based on rotation invariant shape context. In: 8th Int Conf on Intelligent Systems and Knowledge Engineering (ISKE2013), Shenzhen, China; November 21–23, 2014. pp 145–154.
- 8Fu H, Chi Z, Feng D, Song J. Machine learning techniques for ontology-based leaf classification. In: IEEE 8th Int Conf on Control, Automation, Robotics and Vision, Kunming, China; December 6–9, 2004. pp 681–686.
- 9Warren D. Automated leaf shape description for variety testing in chrysanthemums. In: Proc IEE 6th Int Conf on Image Processing and Its Applications, Dublin, OH; July 14–17, 1997. pp 497–501.
- 10Brendel T, Schwanke J, Jensch P, Megnet R. Knowledge-based object recognition for different morphological classes of plants. Proc SPIE 1995; 2345: 277–284.
- 11Saitoh T, Kaneko T. Automatic recognition of wild flowers. In: Proc Pattern Recognition, Barcelona, Spain; September 3–7, 2000. pp 507–510.
- 12Ridler T, Calvard S. Picture thresholding using an Iterative selection method. IEEE Trans Syst Man Cybernet 1978; 8(8): 30–632.
- 13Hu M. Visual pattern recognition by moment invariants. IRE Trans Inform Theory 1962; 8(2): 179–187.
- 14Du JX, Huang DS, Wang XF, Gu X. Computer-aided plant species identification based on leaf shape matching technique. Trans Inst Meas Cont 2007; 28(3): 275–284.
- 15Mishra P, Maurya S, Singh R, Misra A. A semi-automatic plant identification based on digital leaf and flower images. In: Int Conf on Advances In Engineering Science And Management, Tamil Nadu, India; March 30–31, 2012. pp 68–73.
- 16ArunPriya C, Balasaravanan T, Thanamani A. An efficient leaf recognition algorithm for plant classification using support vector machine. In: Proc Int Conf on Pattern Recognition, Informatics and Medical Engineering, Tsukuba, Japan; November 11–15, 2012. pp 428–432.
- 17Hossain J, Amin M. Leaf shape identification based plant biometrics. In: Proc 13th Int Conf on Computer and Information Technology, Bradford, UK; June 29 – July 1, 2010. pp 458–463.
- 18Satti W, Satya A, Sharma S. An automatic leaf recognition system for plant identification using machine vision rechnology. Int J Eng Sci Technol 2013; 4(5): 874–879.
- 19Ling H, Jacobs D. Shape classication using the inner-distance. IEEE Trans Pattern Anal Mach Intell 2007; 29(2): 286–299.
- 20Wu Q, Zhou C, Wang C. Feature extraction and automatic recognition of plant leaf using artificial neural network. Avances en Ciencias de la Computación. Cd. de México, México; 2006. pp 5–12.
- 21Mora C, Tittensor DP, Adl S, Simpson AGB, Boris Worm. How many species are there on earth and in the ocean? PLoS Biol 2011; 9(8): e1001127.
- 22Felzenszwalb PF, Huttenlocher DP. Efficient graph-based image segmentation. Int J Comput Vis 2004; 59(2): 167–181.
- 23Kekre H, Mishra D, Narula S, Shah V. Color feature extraction for CBIR. Int J Eng Sci Technol 2011; 3(12): 8357–8365.
- 24Manay S, Cremers D, Hong B, Yezzi A, Soatto S. Integral invariants for shape matching. IEEE Trans Pattern Anal Mach Intell 2006; 28(10): 1602–1618.
- 25Chaki J, Parekh R. Plant leaf recognition using shape based features and neural network classifiers. Int J Adv Comput Sci Appl 2011; 2(10): 41–47.
- 26Kumar N, Belhumeur PN, Biswas A, Jacobs DW, Kress WJ, Lopez IC, Soares JVB. Leafsnap: a computer vision system for automatic plant species identification. In: 14th Eur Conf on Computer Vision, Firenze, Italy; October 7–13, 2012. pp 502–516.
- 27Belongie S, Malik J, Puzicha J. Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 2002; 4(24): 509–522.
- 28Aly M, Munich ME, Perona P. Indexing in large scale image collections: scaling properties and benchmark. In: IEEE Workshop on Applications of Computer Vision, Kona, HI; January 5–7, 2011. pp 418–425.
- 29Jegou H, Douze M, Schmid C. Hamming embedding and weak geometric consistency for large scale image search. In; 10th Eur Conf on Computer Vision, Marseille, France; October 12–18, 2008. pp 304–317.
- 30Philbin J, Chum O, Isard M, Sivic J, Zisserman A. Object retrieval with large vocabularies and fast spatial matching. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Minneapolis, MI; June 18–23, 2007. pp 1–8.
- 31Philbin J, Chum O, Isard M, Sivic J, Zisserman A. Lost in quantization: improving particular object retrieval in large scale image databases. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, AK; June 24–26, 2008. pp 1–8.
- 32Lowe D. Distinctive image features from scale-invariant keypoints. Int J Comput Vis 2004; 60(2): 91–110.
- 33Aly M, Munich ME, Perona P. Bag of Words for large scale object recognition - properties and benchmark. In: Proc 6th Int Conf on Computer Vision Theory and Applications, Vilamoura, Algarve, Portugal; March 5–7, 2011. pp 299–306.
- 34Manay S, Cremers D, Hong B, Yezzi A, Soatto S. Integral invariants for shape matching. IEEE Trans Pattern Anal Mach Intell 2006; 28(10): 1602–1618.
- 35Jermyn I, Ishikawa H. Globally optimal regions and boundaries as minimum ratio weight cycles. IEEE Trans Pattern Anal Mach Intell 2001; 23(10): 1075–1088.
- 36Zitnick C. Binary coherent edge descriptors. In: Eur Conf on Computer Vision, Crete, Greece; September 5–11, 2010. pp 1–14.
- 37Branson S, Wah C, Babenko B, Schroff F, Welinder P, Perona P, Belongie S. Visual recognition with humans in the loop. In: Eur Conf on Computer Vision, Crete, Greece; September 5–11, 2010. pp 438–451.
- 38Dean J, Ghemawat S. Mapreduce: simplified data processing on large clusters. In: 6th Symp on Operating System Design and Implementation, San Francisco, CA; December 6–8, 2004. pp 137–150.
- 39Dean J, Ghemawat S. Mapreduce: simplified data processing on large clusters. Commun ACM 2008; 51(1): 107–113.
- 40Comaniciu D, Meer P. Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 2002; 24(5): 603–619.
- 41Zhou F, Zhao Y, Ma KL. Parallel mean shift for interactive volume segmentation. In: Machine Learning in Medical Imaging. Lect Notes Comput Sci 2010; 6357: 67–75.
- 42Hall P, Park BU, Samworth RJ. Choice of neighbor order in nearest-neighbor classification. Ann Stat 2008; 36(5): 2135–2152.
- 43Muja M, Lowe D. Fast approximate nearest neighbors with automatic algorithm configuration. In: Int Conf on Computer Vision Theory and Application, Lisboa, Portugal; February 5–8, 2009. pp 331–340.
- 44Chum O, Philbin J, Isard M, Zisserman A. Scalable near identical image and shot detection. In: CIVR, ACM International Conference on Image and Video Retrieval, Amsterdam, Netherlands; July 9–11, 2007. pp 549–556.
- 45Perronnin F, Liu Y, Sánchez J, Poirier H. Large-scale image retrieval with compressed fisher vectors. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA; June 13–18, 2010. pp 3384–3391.
- 46Chuck L. Hadoop in Action. Manning Publications, Shelter Island, NY; 2010. p 325.
- 47Zhou K, Hou Q, Wang R, Guo B. Real-time KD-tree construction on graphics hardware. ACM Trans Graph 2008; 27(5): 126.
10.1145/1409060.1409079 Google Scholar