PRELIMINARY INVESTIGATION OF THE ROBUSTNESS OF MAXIMALLY STABLE EXTREMAL REGIONS (MSER) MODEL FOR THE AUTOMATIC REGISTRATION OF OVERLAPPING IMAGES

DOI: https://doi.org/10.14710/geoplanning.5.1.63-74
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Article Metrics: (Click on the Metric tab below to see the detail)

Article Info
Published: 25-04-2018
Section: Articles
Fulltext PDF Tell your colleagues Email the author

Various researchers in Digital Image processing have developed keen interest in the automation of object detection, description and extraction process used for various applications and this has led to the development of series of Feature detection and extraction models one of which is the Maximally Stable Extremal Regions Feature Algorithm (MSER).  This paper investigates the robustness of MSER algorithm (a blob-like and affine-invariant feature detector) for the detection and extraction of corresponding features used for the automatic registration of series of overlapping images. The robustness investigation was carried out in three different registration campaigns using overlapping images extracted from google earth and image pair acquired from an Unmanned Aerial Vehicle (UAV). Sum of Square Difference (SSD) and Bilinear interpolation models were used to establish the similarity measure between the images to be registered, resampling of the pixel-values and computation of non-integer coordinates respectively while Random Sampling Consensus (RANSAC) algorithm was used to exclude the outliers and to compute the transformation matrix using affine transformation function. The results obtained from this preliminary investigation shows that the processing speed of MSER is quite high for Automatic Image Registration with a relatively high accuracy. While an accuracy of 61.54% was obtained from the first campaign with a processing time of 11.92 seconds, the second campaign gave an accuracy of 52.02% with a processing time of 11.20 seconds and the third campaign produced an accuracy of 55.62% with a processing time of 3.27 seconds. The obtained speed and accuracy shows that MSER is a very robust model and as such, can be deployed as the feature detection and extraction model in the development of an automatic image registration scheme.

Keywords

MSER;Image Registration;Overlapping Images;RANSAC;UAV

  1. Oluibukun Gbenga Ajayi 
    Department of Surveying and Geoinformatics, Federal University of Technology, Minna, PMB 65, Minna, Nigeria, Nigeria

    Department of Surveying and Geoinformatics

  2. Ifeanyi Jonathan Nwadialor 
    Federal University of Technology, Minna, Nigeria
    Department of Surveying and Geoinformatics, Professor
  3. Ifeanyi Chukwudi Onuigbo 
    Federal University of Technology, Minna, Nigeria
    Department of Surveying and Geoinformatics, Associate Professor
  4. Olurotimi Adebowale Kemiki 
    Federal University of Technology, Minna, Nigeria
    Department of Estate Management, Associate Professor
  1. Ajayi, O. G., Odumosu, J. O., Okorocha, C. V, Nzelibe, I. C., Ahmadu, H. A., & Bawa, S. (2014). Semi-Automatic Generation of Mosaic from Overlapping Images Using MATLAB. Int J Engg Advance Tech Studies, 2(4), 1–15.

  2. Brown, L. G. (1992). A Survey of Image Registration Techniques. ACM Computing Surveys, 24(4), 325–376. [Crossref]

  3. Dai, X., & Khorram, S. (1999). A Feature-Based Image Registration Algorithm Using Improved Chain-Code Representation Combined with Invariant Moments. IEEE Transactions on Geoscience and Remote Sensing, 37(5), 2351–2362. [Crossref]

  4. Donoser, M., & Bischof, H. (n.d.). Efficient Maximally Stable Extremal Region (MSER) Tracking. in 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPRtextquotesingle06). IEEE. [Crossref]

  5. Fraundorfer, F., & Bischof, H. (n.d.). A novel performance evaluation method of local detectors on non-planar scenes. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPRtextquotesingle05) - Workshops. IEEE. [Crossref]

  6. KAAKINEN, M., HUTTUNEN, S., PAAVOLAINEN, L., MARJOMÄKI, V., HEIKKILÄ, J., & EKLUND, L. (2013). Automatic detection and analysis of cell motility in phase-contrast time-lapse images using a combination of maximally stable extremal regions and Kalman filter approaches. Journal of Microscopy, 253(1), 65–78. [Crossref]

  7. Kimmel, R., Zhang, C., Bronstein, A. M., & Bronstein, M. M. (2011). Are MSER Features Really Interesting? IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(11), 2316–2320. [Crossref]

  8. Kristensen, F., & MacLean, W. J. (2007). Real-Time Extraction of Maximally Stable Extremal Regions on an FPGA. In 2007 IEEE International Symposium on Circuits and Systems. IEEE. [Crossref]

  9. Kumar, A. S., Manjunath, A. S., & Rao, K. M. M. (2003). Merging IRS multispectral and PAN images by A-Trous wavelets. International Journal of Remote Sensing.

  10. Lemaitre, C., Perdoch, M., Rahmoune, A., Matas, J., & Miteran, J. (2011). Detection and matching of curvilinear structures. Pattern Recognition, 44(7), 1514–1527. [Crossref]

  11. Matas, J., Chum, O., Urban, M., & Pajdla, T. (2004). Robust wide-baseline stereo from maximally stable extremal regions. Image and Vision Computing, 22(10), 761–767. [Crossref]

  12. Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., … Gool, L. Van. (2005). A Comparison of Affine Region Detectors. International Journal of Computer Vision, 65(1–2), 43–72. [Crossref]

  13. Nister, D., & Stewenius, H. (n.d.). Scalable Recognition with a Vocabulary Tree. In 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPRtextquotesingle06). IEEE. [Crossref]  

  14. Nistér, D., & Stewénius, H. (2008). Linear Time Maximally Stable Extremal Regions. In Lecture Notes in Computer Science (pp. 183–196). Springer Berlin Heidelberg. [Crossref]  

  15. Obdrzalek, S., & Matas, J. (2002). Object Recognition using Local Affine Frames on Distinguished Regions. In Procedings of the British Machine Vision Conference 2002. British Machine Vision Association. [Crossref]

  16. Olaleye, J. B., Ajayi, O. G., Omogunloye, O. G., Odumosu, J. O., & Okorocha, C. V. (2015). AUTOMATIC REGISTRATION OF SIMULTANEOUSLY OVERLAPPING IMAGES. NED University Journal of Research, 12(4).

  17. Rao, C. V., Rao, K. M. M., Manjunath, A. S., & Srinivas, R. V. N. (2004). Optimization of automatic image registration algorithms and characterization. In Proceedings of the ISPRS Congress (pp. 698–702).

  18. Salahat, E., Saleh, H., Sluzek, A., Al-Qutayri, M., Mohammad, B., & Ismail, M. (2015). A maximally stable extremal regions system-on-chip for real-time visual surveillance. In IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society. IEEE. [Crossref]

  19. Sivic, & Zisserman. (2003). Video Google: a text retrieval approach to object matching in videos. In Proceedings Ninth IEEE International Conference on Computer Vision. IEEE. [Crossref]

  20. Śluzek, A. (2016). Improving performances of MSER features in matching and retrieval tasks. In European Conference on Computer Vision (pp. 759–770).

  21. Varah, S., & Grujić, N. (2013). Target Detection and Tracking Using a Parallel Implementation of Maximally Stable Extremal Region. In GPU Technology Conference, Canada.

  22. Zitová, B., & Flusser, J. (2003). Image registration methods: a survey. Image and Vision Computing, 21(11), 977–1000. [Crossref]