Feature Points Detection and Image Matching

Image matching is a part of many computer vision or image processing applications, such as object recognition, registration, panoramic images and image mosaics, three-dimensional (3D) reconstruction and modeling, stereovision or even indexing and searching for images via content. This chapter examines a general scenario where the amount of visual information is limited and where no prior knowledge is available. The current process of image matching consists of three main stages: detecting the feature points/regions; calculating the descriptors such as Daisy descriptor and multi-scale oriented patches (MOPS) descriptor, in this region, normalized if necessary; and matching the feature points of the two images using their descriptors and estimating the geometric transformation by removing false matches.

Bibliography

[AWR 12] AWRANGJEB M., LU G., FRASER C.S., “Performance comparisons of contour-based corner detectors”, IEEE Transactions on Image Processing, vol. 21, no. 9, pp. 4167–4179, 2012.
10.1109/TIP.2012.2200493
Web of Science® Google Scholar
[BAL 81] BALLARD D.H., “Generalizing the Hough transform to detect arbitrary shapes”, Pattern Recognition, vol. 13, no. 2, pp. 111–122, January 1981.
10.1016/0031-3203(81)90009-1
Web of Science® Google Scholar
[BAY 08] BAY H., ESS A., TUYTELAARS T., et al., “Speeded-up robust features (SURF)”, Computer Vision and Image Understanding, vol. 110, no. 3, pp. 346–359, 2008.
10.1016/j.cviu.2007.09.014
Web of Science® Google Scholar
[BEA 87] BEAUDET P.R., “Rotationally invariant image operators”, International Joint Conference on Artificial Intelligence, pp. 579–583, 1987.
Google Scholar
[BEI 97] BEIS J.S., LOWE D.G., “Shape indexing using approximate nearest-neighbour search in high-dimensional spaces”, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), IEEE Computer Society, Washington, DC, pp. 1000–1006, 1997.
Web of Science® Google Scholar
[BEL 00] BELONGIE S., MALIK J., PUZICHA J., “Shape context: a new descriptor for shape matching and object recognition”, NIPS, IEEE Computer Society, pp. 831–837, 2000.
Google Scholar
[BER 04] BERAR M., DESVIGNES M., BAILLY G., et al., “3D meshes registration: application to statistical skull model”, in CAMPILHO A., KAMEL M. (eds), Image Analysis and Recognition, Lecture Notes in Computer Science, vol. 3212, Springer, Berlin, Heidelberg, pp. 100–107, 2004.
10.1007/978-3-540-30126-4_13
Google Scholar
[BER 05] BERG A.C., BERG T.L., MALIK J., “Shape matching and object recognition using low distortion correspondences”, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR' 05), vol. 1, pp. 26–33, 2005.
10.1109/CVPR.2005.320
Google Scholar
[BRO 05] BROWN M., SZELISKI R., WINDER S., “Multi-image matching using multi-scale oriented patches”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005 (CVPR 2005), vol. 1, IEEE, pp. 510–517, 2005.
Google Scholar
[CHU 05] CHUM O., MATAS J., “Matching with PROSAC – progressive sample consensus”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005 (CVPR 2005), IEEE Computer Society, vol. 1, pp. 220–226, 2005.
Web of Science® Google Scholar
[DUC 11] DUCHENNE O., BACH F., KWEON I.-S., et al., “A tensor-based algorithm for high-order graph matching”, IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE Computer Society, Los Alamitos, CA, USA, vol. 33, no. 12, pp. 2383–2395, 2011.
Web of Science® Google Scholar
[FIS 81] FISCHLER M.A., BOLLES R.C., “Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography”, Communications of the ACM, vol. 24, no. 6, pp. 381–395, June 1981.
10.1145/358669.358692
Web of Science® Google Scholar
[FRI 77] FRIEDMAN J.H., BENTLEY J.L., FINKEL R.A., “An algorithm for finding best matches in logarithmic expected time”, ACM Transactions on Mathematical Software, vol. 3, no. 3, pp. 209–226, September 1977.
10.1145/355744.355745
Google Scholar
[GAU 11] GAUGLITZ S., HOLLERER T., TURK M., “Evaluation of interest point detectors and feature descriptors for visual tracking”, International Journal of Computer Vision, vol. 94, no. 3, pp. 335–360, 2011.
10.1007/s11263-011-0431-5
Web of Science® Google Scholar
[HAR 88] HARRIS C., STEPHENS M., “A combined corner and edge detector”, 4th Alvey Vision Conference, Manchester, United Kingdom, pp. 147–152, 1988.
Google Scholar
[HOU 59] HOUGH P.V.C., “Machine analysis of bubble chamber pictures”, International Conference on High Energy Accelerators and Instrumentation, CERN, 1959.
Google Scholar
[LEO 05] LEORDEANU M., HEBERT M., “A spectral technique for correspondence problems using pairwise constraints”, International Conference of Computer Vision (ICCV), vol. 2, pp. 1482–1489, October 2005.
Google Scholar
[LEO 07] LEORDEANU M., HEBERT M., SUKTHANKAR R., “Beyond local appearance: category recognition from pairwise interactions of simple features”, Proceedings of the CVPR, Minneapolis, Minnesota, USA, June 2007.
Google Scholar
[LEU 11] LEUTENEGGER S., CHLI M., SIEGWART R.Y., “BRISK: Binary Robust invariant scalable keypoints”, IEEE International Conference on Computer Vision, IEEE Computer Society, Los Alamitos, CA, USA, pp. 2548–2555, 2011.
Web of Science® Google Scholar
[LIN 08] LINDEBERG T., “Scale-space”, in BENJAMIN W. (ed.), Encyclopedia of Computer Science and Engineering, vol. IV, John Wiley & Sons, Hoboken, NJ, pp. 2495–2504, 2008.
Google Scholar
[LOW 99] LOWE D., “Object recognition from local scale-invariant features”, Proceedings of the 7th IEEE International Conference on Computer Vision, 1999, vol. 2, IEEE, pp. 1150–1157, 1999.
Google Scholar
[LOW 04] LOWE D., “Distinctive image features from scale-invariant keypoints”, International Journal of Computer Vision, vol. 60, no. 2, pp. 91–110, 2004.
10.1023/B:VISI.0000029664.99615.94
Web of Science® Google Scholar
[MAT 02] MATAS J., CHUM O., MARTIN U., et al., “Robust wide baseline stereo from maximally stable extremal regions”, British Machine Vision Conference, vol. 1, London, pp. 384–393, 2002.
Google Scholar
[MIK 05a] MIKOLAJCZYK K., TUYTELAARS T., SCHMID C., et al., “A comparison of affine region detectors”, International Journal of Computer Vision, vol. 65, no. 1, pp. 43–72, 2005.
10.1007/s11263-005-3848-x
Web of Science® Google Scholar
[MIK 05b] MIKOLAJCZYK K., SCHMID C., “A performance evaluation of local descriptors”, IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 27, no. 10, pp. 1615–1630, 2005.
10.1109/TPAMI.2005.188
PubMed Web of Science® Google Scholar
[MOI 04] MOISAN L., STIVAL B., “A probabilistic criterion to detect rigid point matches between two images and estimate the fundamental matrix”, International Journal of Computer Vision, vol. 57, no. 3, pp. 201–218, May 2004.
10.1023/B:VISI.0000013094.38752.54
Web of Science® Google Scholar
[MOK 98] MOKHTARIAN F., SUOMELA R., “Robust image corner detection through curvature scale space”, IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 20, pp. 1376–1381, 1998.
10.1109/34.735812
Web of Science® Google Scholar
[MOK 01] MOKHTARIAN F., MOHANNA F., “Enhancing the curvature scale space corner detector”, Scandinavian Conference on Image Analysis, Bergen, Norway, pp. 145–152, 2001.
Google Scholar
[MOK 06] MOKHTARIAN F., MOHANNA F., “Performance evaluation of corner detectors using consistency andaccuracy measures”, Computer Vision and Image Understanding, vol. 102, no. 1, pp. 81–94, April 2006.
10.1016/j.cviu.2005.11.001
Web of Science® Google Scholar
[MOR 81] MORAVEC H.P., Robot Rover Visual navigation, UMI Research Press, 1981.
Google Scholar
[RAB 08] RABIN J., DELON J., GOUSSEAU Y., “A contrario matching of SIFT-like descriptors”, 19th International Conference on Pattern Recognition (ICPR 2008), IEEE, Tampa, FL, pp. 1–4, December 8–11, 2008.
10.1109/ICPR.2008.4761371
Google Scholar
[REN 00] RENAULT C., DESVIGNES M., REVENU M., “3D curves tracking and its application to cortical sulci detection”, IEEE International Conference on Image Processing (ICIP2000), vol. 2, pp. 491–494, September 2000.
Google Scholar
[ROM 02] ROMANIUK B., DESVIGNES M., REVENU M., et al., “Linear and nonlinear model for statistical localization of landmarks”, International Conference of Pattern Recognition (ICPR), vol. 4, pp. 393–396, 2002.
Google Scholar
[ROM 12] ROMANIUK B., YOUNES L., BITTAR E., “First steps toward spatio-temporal Rheims reconstruction using old postcards”, International Conference on Signal Image Technology & Internet Based Systems (SITIS), pp. 374–380, 2012.
Google Scholar
[ROS 05] ROSTEN E., DRUMMOND T., “Fusing points and lines for high performance tracking”, IEEE International Conference on Computer Vision, vol. 2, pp. 1508–1511, October 2005.
Google Scholar
[ROS 10] ROSTEN E., PORTER R., DRUMMOND T., “Faster and better: a machine learning approach to corner detection”, IEEE Pattern Analysis Machine Intelligence, vol. 32, no. 1, pp. 105–119, January 2010.
10.1109/TPAMI.2008.275
PubMed Web of Science® Google Scholar
[RUB 00] RUBNER Y., TOMASI C., GUIBAS L.J., “The earth mover's distance as a metric for image retrieval”, International Journal of Computer Vision, Hingham, MA, USA, vol. 40, no. 2, pp. 99–121, November 2000.
10.1023/A:1026543900054
Web of Science® Google Scholar
[SMI 97] SMITH S.M., BRADY J.M., “SUSAN – a new approach to low level image processing”, International Journal of Computer Vision, vol. 23, no. 1, pp. 45–78, 1997.
10.1023/A:1007963824710
Web of Science® Google Scholar
[STE 95] STEWART C.V., “MINPRAN: a new robust estimator for computer vision”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, no. 10, pp. 925–938, 1995.
10.1109/34.464558
Web of Science® Google Scholar
[TOL 10] TOLA E., LEPETIT V., FUA P., “DAISY: an efficient dense descriptor applied to wide-baseline stereo”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 5, pp. 815–830, 2010.
10.1109/TPAMI.2009.77
PubMed Web of Science® Google Scholar
[TOR 00] TORR P.H.S., ZISSERMAN A., “MLESAC: a new robust estimator with application to estimating image geometry”, Computer Vision and Image Understanding, vol. 78, no. 1, pp. 138–156, 2000.
10.1006/cviu.1999.0832
Web of Science® Google Scholar
[TUY 04] TUYTELAARS T., GOOL L.V., “Matching widely separated views based on affine invariant regions”, International Journal of Computer Vision, vol. 59, no. 1, pp. 61–85, August 2004.
10.1023/B:VISI.0000020671.28016.e8
Web of Science® Google Scholar
[TUY 08] TUYTELAARS T., MIKOLAJCZYK K., Local Invariant Feature Detectors: A Survey, Now Publishers, Inc. cop., Hanover, MA, 2008.
Google Scholar
[VIO 01] VIOLA P., JONES M., “Rapid object detection using a boosted cascade of simple features”, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2001 (CVPR 2001), vol. 1, IEEE, pp. I–511, 2001.
Google Scholar
[ZAS 08] ZASS R., SHASHUA A., “Probabilistic graph and hypergraph matching”, Proceedings of the 2008 Conference on Computer Vision and Pattern Recognition (CVPR '08), Anchorage, Alaska, USA, pp. 1–8, 2008.
Google Scholar
[ZHE 06] ZHENG Y., DOERMANN D., “Robust point matching for nonrigid shapes by preserving local neighborhood structures”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 643–649, April 2006.
10.1109/TPAMI.2006.81
PubMed Web of Science® Google Scholar

3D Video: From Capture to Diffusion