Journal Home > Volume 5 , Issue 1
Computational Visual Media 2019, 5(1): 45-58 https://doi.org/10.1007/s41095-019-0130-7
Research Article | Open Access | Issue | Published: 08 April 2019

Discernible image mosaic with edge-aware adaptive tiles

Show Author's Information Pengfei Xu1,  Jianqiang Ding1,  Hao Zhang2,  Hui Huang1( )
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, Guangdong, China.
School of Computing Science, Simon Fraser University, Vancouver, BC, Canada.
Keywords:
image synthesis, image mosaic, image retrieval
Cite this article:
Xu P, Ding J, Zhang H, et al. Discernible image mosaic with edge-aware adaptive tiles. Computational Visual Media, 2019, 5(1): 45-58. https://doi.org/10.1007/s41095-019-0130-7
Download citation
EndNote(RIS)
BibTeX

471

Views

24

Downloads

Citations

6

Crossref

N/A

WoS

6

Scopus

2

CSCD

Abstract Full text About this article

We present a novel method to produce discernible image mosaics, with relatively large image tiles replaced by images drawn from a database, to resemble a target image. Compared to existing works on image mosaics, the novelty of our method is two-fold. Firstly, believing that the presence of visual edges in the final image mosaic strongly supports image perception, we develop an edge-aware photo retrieval scheme which emphasizes the preservation of visual edges in the target image. Secondly, unlike most previous works which apply a pre-determined partition to an input image, our image mosaics are composed of adaptive tiles, whose sizes are determined based on the available images in the database and the objective of maximizing resemblance to the target image. We show discernible image mosaics obtained by our method, using image collections of only moderate size. To evaluate our method, we conducted a user study to validate that the image mosaics generated present both globally and locally appropriate visual impressions to the human observers. Visual comparisons with existing techniques demonstrate the superiority of our method in terms of mosaic quality and perceptibility.


menu
Abstract
Full text
Outline
About this article

Discernible image mosaic with edge-aware adaptive tiles

Show Author's information Pengfei Xu1, Jianqiang Ding1, Hao Zhang2, Hui Huang1( )
College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, Guangdong, China.
School of Computing Science, Simon Fraser University, Vancouver, BC, Canada.

Abstract

We present a novel method to produce discernible image mosaics, with relatively large image tiles replaced by images drawn from a database, to resemble a target image. Compared to existing works on image mosaics, the novelty of our method is two-fold. Firstly, believing that the presence of visual edges in the final image mosaic strongly supports image perception, we develop an edge-aware photo retrieval scheme which emphasizes the preservation of visual edges in the target image. Secondly, unlike most previous works which apply a pre-determined partition to an input image, our image mosaics are composed of adaptive tiles, whose sizes are determined based on the available images in the database and the objective of maximizing resemblance to the target image. We show discernible image mosaics obtained by our method, using image collections of only moderate size. To evaluate our method, we conducted a user study to validate that the image mosaics generated present both globally and locally appropriate visual impressions to the human observers. Visual comparisons with existing techniques demonstrate the superiority of our method in terms of mosaic quality and perceptibility.

Keywords: image synthesis, image mosaic, image retrieval

References(38)

[1]
Wikipedia-contributors. Photographic mosaic. Availableat https://en.wikipedia.org/wiki/Photographic_mosaic.
[2]
R. Silvers,; M. Hawley, Photomosaics. Henry Holt and Co., Inc., 1997.
[3]
J. Kim,; F. Pellacini, Jigsaw image mosaics. ACM Transactions on Graphics Vol. 21, No. 3, 657-664, 2002.
DOI Google Scholar
[4]
G. Di Blasi,; G. Gallo,; M. P. Petralia, Smart ideas for photomosaic rendering. In: Proceedings of the Eurographics Italian Chapter Conference, Vol. 2006, 267-272, 2006.
[5]
J. Orchard,; C. S. Kaplan, Cut-out image mosaics. In: Proceedings of the 6th International Symposium on Non-Photorealistic Animation and Rendering, 79-87, 2008.
DOI
[6]
D. Pavić,; U. Ceumern,; L. Kobbelt, GIzMOs: Genuine image mosaics with adaptive tiling. Computer Graphics Forum Vol. 28, No. 8, 2244-2254, 2009.
DOI Google Scholar
[7]
J. Miller,; D. Mould, Accurate and discernible photocollages. In: Proceedings of the 8th Annual Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging, 115-124, 2012.
[8]
L. Zhang,; K.-L. Ma,; J. Yu, Adaptively tiled image mosaics utilizing measures of color and region entropy. In: Proceedings of the 9th International Symposium on Visual Information Communication and Interaction, 122-129, 2016.
DOI
[9]
S. Battiato,; G. Di Blasi,; G. M. Farinella,; G. Gallo, Digital mosaic frameworks—An overview. Computer Graphics Forum Vol. 26, No. 4, 794-812, 2007.
DOI Google Scholar
[10]
Y. Dobashi,; T. Haga,; H. Johan,; T. Nishita, A method for creating mosaic images using Voronoi diagrams. In: Proceedings of the Eurographics, Vol. 2, 341-348, 2002.
[11]
G. M. Faustino,; L. H. de Figueiredo, Simple adaptive mosaic effects. In: Proceedings of the XVIII Brazilian Symposium on Computer Graphics and Image Processing, 315-322, 2005.
DOI
[12]
L. Zhang,; J. Yu, Image mosaics with irregular tiling. In: Proceedings of the 12th International Conference on Computer-Aided Design and Computer Graphics, 155-162, 2011.
DOI
[13]
Y.-K. Lai,; S.-M. Hu,; R.-R. Martin, Surface mosaics. The Visual Computer Vol. 22, Nos. 9-11, 604-611, 2006.
DOI Google Scholar
[14]
A. Hausner, Simulating decorative mosaics. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, 573-580, 2001.
DOI
[15]
Y. Liu,; O. Veksler,; O. Juan, Generating classic mosaics with graph cuts. Computer Graphics Forum Vol. 29, No. 8, 2387-2399, 2010.
DOI Google Scholar
[16]
S. Battiato,; G. Di Blasi,; G. Gallo,; G. C. Guarnera,; G. Puglisi, Artificial mosaics by gradient vector flow. In: Proceedings of the Eurographics (Short Papers), 53-56, 2008.
[17]
H. Wu,; X. Lyu,; Z. Wen, Automatic texture exemplar extraction based on global and local textureness measures. Computational Visual Media Vol. 4, No. 2, 173-184, 2018.
DOI Google Scholar
[18]
C. Barnes,; F. L. Zhang, A survey of the state-of-the-art in patch-based synthesis. Computational Visual Media Vol. 3, No. 1, 3-20, 2017.
DOI Google Scholar
[19]
C. Barnes,; F.-L. Zhang,; L. Lou,; X. Wu,; S.-M. Hu, Patchtable: Efficient patch queries for large datasets and applications. ACM Transactions on Graphics Vol. 34, No. 4, Article No. 97, 2015.
DOI Google Scholar
[20]
G. Di Blasi,; G. Gallo,; M. Petralia, Puzzle image mosaic. In: Proceedings of the IASTED/VIIP, 33-37, 2005.
[21]
K. C. Kwan,; L. T. Sinn,; C. Han,; T. T. Wong,; C. W. Fu, Pyramid of arclength descriptor for generating collage of shapes. ACM Transactions on Graphics Vol. 35, No. 6, Article No. 229, 2016.
DOI Google Scholar
[22]
H. Huang,; L. Zhang,; H.-C. Zhang, Arcimboldo-like collage using internet images. ACM Transactions on Graphics Vol. 30, No. 6, Article No. 155, 2011.
DOI Google Scholar
[23]
B. Reinert,; T. Ritschel,; H.-P. Seidel, Interactive by-example design of artistic packing layouts. ACM Transactions on Graphics Vol. 32, No. 6, Article No. 218, 2013.
DOI Google Scholar
[24]
C. Zou,; J. Cao,; W. Ranaweera,; I. Alhashim,; P. Tan,; A. Sheffer,; H. Zhang, Legible compact calligrams. ACM Transactions on Graphics Vol. 35, No. 4, Article No. 122, 2016.
DOI Google Scholar
[25]
S.-M. Hu,; F.-L. Zhang,; M. Wang,; R. R. Martin,; J. Wang, PatchNet: A patch-based image representation for interactive library-driven image editing. ACM Transactions on Graphics Vol. 32, No. 6, Article No. 196, 2013.
DOI Google Scholar
[26]
F.-L. Zhang,; J. Wang,; E. Shechtman,; Z.-Y. Zhou,; J.-X. Shi,; S.-M. Hu, PlenoPatch: Patch-based plenoptic image manipulation. IEEE Transactions on Visualization and Computer Graphics Vol. 23, No. 5, 1561-1573, 2017.
DOI Google Scholar
[27]
C. Rother,; L. Bordeaux,; Y. Hamadi,; A. Blake, AutoCollage. ACM Transactions on Graphics Vol. 25, No. 3, 847-852, 2006.
DOI Google Scholar
[28]
Z. Yu,; L. Lu,; Y. Guo,; R. Fan,; M. Liu,; W. Wang, Content-aware photo collage using circle packing. IEEE Transactions on Visualization and Computer Graphics Vol. 20, No. 2, 182-195, 2014.
DOI Google Scholar
[29]
S. Goferman,; A. Tal,; L. Zelnik-Manor, Puzzle-like collage. Computer Graphics Forum Vol. 29, No. 2, 459-468, 2010.
DOI Google Scholar
[30]
A. Oliva,; A. Torralba,; P. G. Schyns, Hybrid images. ACM Transactions on Graphics Vol. 25, No. 3, 527-532, 2006.
DOI Google Scholar
[31]
H.-K. Chu,; W.-H. Hsu,; N. J. Mitra,; D. Cohen-Or,; T.-T. Wong,; T.-Y. Lee, Camouflage images. ACM Transactions on Graphics Vol. 29, No. 4, Article No. 51, 2010.
DOI Google Scholar
[32]
Q. Tong,; S.-H. Zhang,; S.-M. Hu,; R. R. Martin, Hidden images. In: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering, 27-34, 2011.
DOI
[33]
Z. Farbman,; R. Fattal,; D. Lischinski,; R. Szeliski, Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Transactions on Graphics Vol. 27, No. 3, Article No. 67, 2008.
DOI Google Scholar
[34]
M. Muja,; D. G. Lowe, Flann: Fast library for approximate nearest neighbors. 2009. Available at http://www.cs.ubc.ca/research/ann/.
[35]
N. Dalal,; B. Triggs, Histograms of oriented gradients for human detection. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1, 886-893, 2005.
[36]
C. L. Zitnick,; P. Dollár, Edge boxes: Locating object proposals from edges. In:Computer Vision - ECCV 2014. Lecture Notes in Computer Science, Vol. 8693. D. Fleet,; T. Pajdla,; B. Schiele,; T. Tuytelaars, Eds. Springer Cham, 391-405, 2014.
[37]
B. Zhou,; A. Lapedriza,; A. Khosla,; A. Oliva,; A. Torralba, Places: A 10 million image database for scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 40, No. 6, 1452-1464, 2018.
DOI Google Scholar
[38]
Rapid-Mosaic. Foto-mosaic-edda. Available at https://fmedda.com/en/home.
Publication history
Copyright
Acknowledgements
Rights and permissions

Publication history

Revised: 09 December 2018
Accepted: 20 January 2019
Published: 08 April 2019
Issue date: March 2019

Copyright

© The author(s) 2019

Acknowledgements

We thank the anonymous reviewers and the editorsfor their valuable comments. This work was supported in part by the National Natural Science Foundation of China (Nos. 61602310, 61522213, and 61528208), Guangdong Science and Technology Program (No. 2015A030312015), Shenzhen InnovationProgram (Nos. JCYJ20170302154106666, KQJSCX-20170727101233642), and NSERC (No. 611370).

Rights and permissions

This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduc-tion in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyrightholder.

To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.

Return