AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (10.3 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article | Open Access

Boundary-aware texture region segmentation from manga

The Chinese University of Hong Kong, Hong Kong, China.
Shenzhen Research Institute, the Chinese University of Hong Kong, Shenzhen, China.
Show Author Information

Abstract

Due to the lack of color in manga (Japanese comics), black-and-white textures are often used to enrich visual experience. With the rising need to digitize manga, segmenting texture regions from manga has become an indispensable basis for almost all manga processing, from vectorization to colorization. Unfortunately, such texture segmentation is not easy since textures in manga are composed of lines and exhibit similar features to structural lines (contour lines). So currently, texture segmentation is still manually performed, which is labor-intensive and time-consuming. To extract a texture region, various texture features have been proposed for measuring texture similarity, but precise boundaries cannot be achieved since boundary pixels exhibit different features from inner pixels. In this paper, we propose a novel method which also adopts texture features to estimate texture regions. Unlike existing methods, the estimated texture region is only regarded an initial, imprecise texture region. We expand the initial texture region to the precise boundary based on local smoothness via a graph-cut formulation. This allows our method to extract texture regions with precise boundaries. We have applied our method to various manga images and satisfactory results were achieved in all cases.

References

[1]
Tuytelaars, T.; Mikolajczyk, K.Local invariant feature detectors: A survey. Foundations and Trends in Computer Graphics and Vision Vol. 3, No. 3, 177-280, 2008.
[2]
Xu, L.; Yan, Q.; Xia, Y.; Jia, J. Structure extraction from texture via relative total variation. ACM Transactions on Graphics Vol. 31, No. 6, Article No. 139, 2012.
[3]
Julesz, B. Textons, the elements of texture perception, and their interactions. Nature Vol. 290, 91-97, 1981.
[4]
Weldon, T. P.; Higgins, W. E.; Dunn, D. F. Efficient Gabor filter design for texture segmentation. Pattern Recognition Vol. 29, No. 12, 2005-2015, 1996.
[5]
Varma, M.; Zisserman, A. Texture classification: Are filter banks necessary? In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, II-691-8, 2003.
[6]
Qu, Y.; Wong, T.-T.; Heng, P.-A. Manga colorization. ACM Transactions on Graphics Vol. 25, No. 3, 1214-1220, 2006.
[7]
Hofmann, T.; Puzicha, J.; Buhmann, J. M. Unsupervised texture segmentation in a deterministic annealing framework. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 20, No. 8, 803-818, 1998.
[8]
Paragios, N.; Deriche, R. Geodesic active regions for supervised texture segmentation. In: Proceedings of the 7th IEEE International Conference on Computer Vision, Vol. 2, 926-932, 1999.
[9]
Hays, J.; Leordeanu, M.; Efros, A. A.; Liu, Y. Discovering texture regularity as a higher-order correspondence problem. In: Computer Vision–ECCV 2006. Leonardis, A.; Bischof, H.; Pinz, A. Eds. Springer Berlin Heidelberg, 522-535, 2006.
[10]
Liu, Y.; Collins, R. T.; Tsin, Y. A computational model for periodic pattern perception based on frieze and wallpaper groups. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 26, No. 3, 354-371, 2004.
[11]
Liu, Y.; Lin, W.-C.; Hays, J. Near-regular texture analysis and manipulation. ACM Transactions on Graphics Vol. 23, No. 3, 368-376, 2004.
[12]
Liuy, Y.; Belkina, T.; Hays, J. H.; Lublinerman, R. Image de-fencing. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1-8, 2008.
[13]
Siddiqui, H.; Boutin, M.; Bouman, C. A. Hardware-friendly descreening. IEEE Transactions on Image Processing Vol. 19, No. 3, 746-757, 2010.
[14]
Kopf, J.; Lischinski, D. Digital reconstruction of halftoned color comics. ACM Transactions on Graphics Vol. 31, No. 6, Article No. 140, 2012.
[15]
Yao, C.-Y.; Hung, S.-H.; Li, G.-W.; Chen, I.-Y.; Adhitya, R.; Lai, Y.-C. Manga vectorization and manipulation with procedural simple screentone. IEEE Transactions on Visualization and Computer Graphics Vol. 23, No. 2, 1070-1084, 2017.
[16]
Aujol, J.-F.; Gilboa, G.; Chan, T.; Osher, S. Structure-texture image decomposition—Modeling, algorithms, and parameter selection. International Journal of Computer Vision Vol. 67, No. 1, 111-136, 2006.
[17]
Meyer, Y. Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures. American Mathematical Society, 2001.
[18]
Rudin, L. I.; Osher, S.; Fatemi, E. Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena Vol. 60, Nos. 1–4, 259-268, 1992.
[19]
Yin, W.; Goldfarb, D.; Osher, S. Image cartoon-texture decomposition and feature selection using the total variation regularized L1 functional. In: Variational, Geometric, and Level Set Methods in Computer Vision. Paragios, N.; Faugeras, O.; Chan, T.; Schnörr, C. Eds. Springer Berlin Heidelberg, 73-84, 2005.
[20]
Durand, F.; Dorsey, J. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics Vol. 21, No. 3, 257-266, 2002.
[21]
Fattal, R.; Agrawala, M.; Rusinkiewicz, S. Multiscale shape and detail enhancement from multi-light image collections. ACM Transactions on Graphics Vol. 26, No. 3, Article No. 51, 2007.
[22]
Paris, S.; Durand, F. A fast approximation of the bilateral filter using a signal processing approach. In: Computer Vision–ECCV 2006. Leonardis, A.; Bischof, H.; Pinz, A. Eds. Springer Berlin Heidelberg, 568-580, 2006.
[23]
Kass, M.; Solomon, J. Smoothed local histogram filters. ACM Transactions on Graphics Vol. 29, No. 4, Article No. 100, 2010.
[24]
Farbman, Z.; Fattal, R.; Lischinski, D.; Szeliski, R. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Transactions on Graphics Vol. 27, No. 3, Article No. 67, 2008.
[25]
Subr, K.; Soler, C.; Durand, F. Edge-preserving multiscale image decomposition based on local extrema. ACM Transactions on Graphics Vol. 28, No. 5, Article No. 147, 2009.
[26]
Xu, L.; Lu, C.; Xu, Y.; Jia, J. Image smoothing via L0 gradient minimization. ACM Transactions on Graphics Vol. 30, No. 6, Article No. 174, 2011.
[27]
Manjunath, B. S.; Ma, W.-Y. Texture features for browsing and retrieval of image data. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 18, No. 8, 837-842, 1996.
Computational Visual Media
Pages 61-71
Cite this article:
Liu X, Li C, Wong T-T. Boundary-aware texture region segmentation from manga. Computational Visual Media, 2017, 3(1): 61-71. https://doi.org/10.1007/s41095-016-0069-x

817

Views

20

Downloads

13

Crossref

N/A

Web of Science

14

Scopus

4

CSCD

Altmetrics

Revised: 09 September 2016
Accepted: 20 December 2016
Published: 17 March 2017
© The Author(s) 2016

This article is published with open access at Springerlink.com

The articles published in this journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www. editorialmanager.com/cvmj.

Return