Journal Home > Volume 1 , Issue 1

Cartoons are a worldwide popular visual entertainment medium with a long history. Nowadays, with the boom of electronic devices, there is an increasing need to digitize old classic cartoons as a basis for further editing, including deformation, colorization, etc. To perform such editing, it is essential to extract the structure lines within cartoon images. Traditional edge detection methods are mainly based on gradients. These methods perform poorly in the face of compression artifacts and spatially-varying line colors, which cause gradient values to become unreliable. This paper presents the first approach to extract structure lines in cartoons based on regions. Our method starts by segmenting an image into regions, and then classifies them as edge regions and non-edge regions. Our second main contribution comprises three measures to estimate the likelihood of a region being a non-edge region. These measure darkness, local contrast, and shape. Since the likelihoods become unreliable as regions become smaller, we further classify regions using both likelihoods and the relationships to neighboring regions via a graph-cut formulation. Our method has been evaluated on a wide variety of cartoon images, and convincing results are obtained in all cases.


menu
Abstract
Full text
Outline
About this article

Region-based structure line detection for cartoons

Show Author's information Xiangyu Mao1,2Xueting Liu1,2Tien-Tsin Wong1,2( )Xuemiao Xu3
The Chinese University of Hong Kong, Hong Kong, China.
Shenzhen Research Institute, The Chinese University of Hong Kong, Shenzhen, China.
South China University of Technology, Guangzhou, China.

Abstract

Cartoons are a worldwide popular visual entertainment medium with a long history. Nowadays, with the boom of electronic devices, there is an increasing need to digitize old classic cartoons as a basis for further editing, including deformation, colorization, etc. To perform such editing, it is essential to extract the structure lines within cartoon images. Traditional edge detection methods are mainly based on gradients. These methods perform poorly in the face of compression artifacts and spatially-varying line colors, which cause gradient values to become unreliable. This paper presents the first approach to extract structure lines in cartoons based on regions. Our method starts by segmenting an image into regions, and then classifies them as edge regions and non-edge regions. Our second main contribution comprises three measures to estimate the likelihood of a region being a non-edge region. These measure darkness, local contrast, and shape. Since the likelihoods become unreliable as regions become smaller, we further classify regions using both likelihoods and the relationships to neighboring regions via a graph-cut formulation. Our method has been evaluated on a wide variety of cartoon images, and convincing results are obtained in all cases.

Keywords: image processing, image segmentation, computational cartoon, edge detection, line extraction, region analysis

References(14)

[1]
Canny, J. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. PAMI-8, No. 6, 679-698, 1986.
[2]
Liu, X.; Mao, X.; Yang, X.; Zhang, L.; Wong, T.-T. Stereoscopizing cel animations. ACM Transactions on Graphics Vol. 32, No. 6, Article No. 223, 2013.
[3]
Zhang, S.-H.; Chen, T.; Zhang, Y.-F.; Hu, S.-M.; Martin, R. R. Vectorizing cartoon animations. IEEE Transactions on Visualization and Computer Graphics Vol. 15, No. 4, 618-629, 2009.
[4]
Sýkora, D.; Buriánek, J.; Žára, J. Unsupervised colorization of black-and-white cartoons. In: Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, 121-127, 2004.
DOI
[5]
Arbelaez, P.; Maire, M.; Fowlkes, C.; Malik, J. Contour detection and hierarchical image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 33, No. 5, 898-916, 2010.
[6]
Prewitt, J. M. S. Object enhancement and extraction. In: Picture Processing and Psychopictorics. Lipkin, B.; Rosenfeld, A. Eds. New York, NY, USA: Academic Press, 15-19, 1970.
[7]
Roberts, L. G. Machine Perception of Three-Dimensional Solids. Garland Publishing, 1963.
[8]
Senthilkumaran, N.; Rajesh, R. Edge detection techniques for image segmentation—a survey of soft computing approaches. International Journal of Recent Trends in Engineering Vol. 1, No. 2, 250-254, 2009.
[9]
Sýkora, D.; Buriánek, J.; Žára, J. Sketching cartoons by example. In: Proceedings of the 2nd Eurographics Workshop on Sketch-Based Interfaces and Modeling, 27-34, 2005.
[10]
Sýkora, D.; Buriánek, J.; Žára, J. Video codec for classical cartoon animations with hardware accelerated playback. In: Advances in Visual Computing. Lecture Notes in Computer Science Volume 3804. Bebis, G.; Boyle, R.; Koracin, D.; Parvin, B. Eds. Berlin Heidelberg, Germany: Springer, 43-50, 2005.
[11]
Steger, C. An unbiased detector of curvilinear structures. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 20, No. 2, 113-125, 1998.
[12]
Comaniciu, D.; Meer, P. Mean shift analysis and applications. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision, Vol. 2, 1197-1203, 1999.
DOI
[13]
Fukunaga, K.; Hostetler, L. The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Transactions on Information Theory Vol. 21, No. 1, 32-40, 1975.
[14]
Selinger, P. Potrace: A polygon-based tracing algorithm. 2003. Available at http://potrace.sourceforge.net/potrace.pdf.
Publication history
Copyright
Acknowledgements
Rights and permissions

Publication history

Revised: 24 October 2014
Accepted: 09 February 2015
Published: 08 August 2015
Issue date: March 2015

Copyright

© The Author(s) 2015

Acknowledgements

This project was supported by National Natural Science Foundation of China (Nos. 61272293 and 61103120), Shenzhen Basic Research Project (No. JCYJ20120619152326448), Shenzhen Nanshan Innovative Institution Establishment Fund (No. KC2013ZDZJ0007A), the Research Grants Council of the Hong Kong Special Administrative Region under RGC General Research Fund (No. CUHK 417913), and Guangzhou Novo Program of Science & Technology (No. 0501-330).

Rights and permissions

This article is published with open access at Springerlink.com

This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.

Return