Abstract
We propose an objective, comprehensive, and complexity independent metric for performance evaluation of graphics/text separation (text segmentation) algorithms. The metric includes a positive set and a negative set of indices, at both the character and the character string (text) levels, _and it evaluates the detection accuracy of the location, width, height, orientation, skew, string length, and the fragmentation of both characters and strings. Assigning a Segmentation Difficulty (SD) value to the ground truth characters, the performance indices are normalized with respect to the character SD and are therefore independent of the ground truth complexity. The evaluation provides an overall, objective, and comprehensive metric of the text segmentation capability of various algorithms aimed at performing this task.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Haralick, “Performance Characterization in Image Analysis—Thinning, a Case in Point”, Pattern Recognition Letters 13:5–12, 1992.
Lee, L. Lam, and C.Y. Suen, “Performance Evaluation of Skeletonization Algorithms for Document Image Processing”, In: Proc. of the first International Conference on Document Analysis and Recognition, Saint-Malo, France, pp 260–271, 1991.
Lam, and C.Y. Suen, “Evaluation of Thinning Algorithms from an OCR Viewpoint. In: Proc. of the second International Conference on Document Analysis and Recognition, Tsukuba, Japan, pp 287–290, 1993.
Jaisimha, R.M. Haralick, and D. Dori, “A Methodology for the Characterization of the Performance of Thinning Algorithms”, In: Proc. of the second International Conference on Document Analysis and Recognition, Tsukuba, Japan, pp 282–286, 1993.
Cordella and A. Marcelli, “An alternative Approach to the Performance Evaluation of Thinning Algorithms for Document Processing Applications”, In: Kasturi R, Tombre K (eds) Graphics Recognition — Methods and Applications (Lecture Notes in Computer Science, vol. 1072), Springer, Berlin, pp 13–22, 1996.
O. Hori, D.S. Doermann, “Quantitative Measurement of the Performance of Raster-to-Vector Conversion Algorithms”, In: Kasturi R, Tombre K (eds) Graphics Recognition — Methods and Applications (Lecture Notes in Computer Science, vol. 1072), Springer, Berlin, pp 57–68, 1996.
B. Kong, I.T. Phillips, R.M. Haralick, A. Prasad, R. Kasturi, “A Benchmark: Performance Evaluation of Dashed-Line Detection Algorithms”, In: Kasturi R, Tombre K (eds) Graphics Recognition — Methods and Applications (Lecture Notes in Computer Science, vol. 1072), Springer, Berlin, pp 270–285, 1996.
Liu W. and D. Dori, “A Protocol for Performance Evaluation of Line Detection Algorithms”, Machine Vision Applications, Special Issue on Performance Characterisitics of Vision Algorithms, 9(5):240–250, 1997.
L.A. Fletcher and R. Kasturi, “A Robust Algorithm for Textbox String Separation from Mixed Text/Graphics Images”, IEEE Trans. PAMI, 10(6):900–918., 1988
I. Chai and D. Dori, “Extraction of Text Boxes from Engineering Drawings”, Proc. SPIE/IS&T Symposium on Electronic Imaging Science and Technology, Conference on Character Recognition and Digitizer Technologies, San Jose (CA, USA), SPIE Vol. 1661, pp 38–49, 1992.
Gao J., Tang L. Liu W. and Tang Z., “Segmentation and Recognition of Dimension Texts in Engineering Drawings”, ICDAR'95, Montreal, Canada, pp 528–531, 1995.
D. Dori and Liu W., “Vector-Based Segmentation of Text Connected to Graphics in Engineering Drawings”, Advances in Structural and Syntactical Pattern Recognition, eds. P. Perner, P. Wang, and A. Rosenfeld, Lecture Notes in Computer Science, vol. [12], pp 322–331, Springer, 1996.
Liu W. and D. Dori, “Automated CAD Conversion with the Machine Drawing Understanding System”, Proc. DAS96, Malvern, PA, USA, October, pp 241—259, 1996.
http://graphics.nynexst.com/iapr-tc l0/contest.html
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wenyin, L., Dori, D. (1998). A proposed scheme for performance evaluation of graphics/text separation algorithms. In: Tombre, K., Chhabra, A.K. (eds) Graphics Recognition Algorithms and Systems. GREC 1997. Lecture Notes in Computer Science, vol 1389. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-64381-8_63
Download citation
DOI: https://doi.org/10.1007/3-540-64381-8_63
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64381-4
Online ISBN: 978-3-540-69766-4
eBook Packages: Springer Book Archive