Journal Home > Volume 29 , Issue 4

Edge is the key information in the process of image smoothing. Some edges, especially the weak edges, are difficult to maintain, which result in the local area being over-smoothed. For the protection of weak edges, we propose an image smoothing algorithm based on global sparse structure and parameter adaptation. The algorithm decomposes the image into high frequency and low frequency part based on global sparse structure. The low frequency part contains less texture information which is relatively easy to smoothen. The high frequency part is more sensitive to edge information so it is more suitable for the selection of smoothing parameters. To reduce the computational complexity and improve the effect, we propose a bicubic polynomial fitting method to fit all the sample values into a surface. Finally, we use Alternating Direction Method of Multipliers (ADMM) to unify the whole algorithm and obtain the smoothed results by iterative optimization. Compared with traditional methods and deep learning methods, as well as the application tasks of edge extraction, image abstraction, pseudo-boundary removal, and image enhancement, it shows that our algorithm can preserve the local weak edge of the image more effectively, and the visual effect of smoothed results is better.


menu
Abstract
Full text
Outline
About this article

A Parameter Adaptive Method for Image Smoothing

Show Author's information Suwei Wang1Xiang Ma2Xuemei Li2( )
School of Computer Science and Technology, Shandong University, Jinan 250101, China
School of Software, Shandong University, Jinan 250101, China

Abstract

Edge is the key information in the process of image smoothing. Some edges, especially the weak edges, are difficult to maintain, which result in the local area being over-smoothed. For the protection of weak edges, we propose an image smoothing algorithm based on global sparse structure and parameter adaptation. The algorithm decomposes the image into high frequency and low frequency part based on global sparse structure. The low frequency part contains less texture information which is relatively easy to smoothen. The high frequency part is more sensitive to edge information so it is more suitable for the selection of smoothing parameters. To reduce the computational complexity and improve the effect, we propose a bicubic polynomial fitting method to fit all the sample values into a surface. Finally, we use Alternating Direction Method of Multipliers (ADMM) to unify the whole algorithm and obtain the smoothed results by iterative optimization. Compared with traditional methods and deep learning methods, as well as the application tasks of edge extraction, image abstraction, pseudo-boundary removal, and image enhancement, it shows that our algorithm can preserve the local weak edge of the image more effectively, and the visual effect of smoothed results is better.

Keywords: image smoothing, parameter adaptation, bicubic interpolation, polynomial fitting

References(48)

[1]
C. Tomasi and R. Manduchi, Bilateral filtering for gray and color images, in Proc. 6th Int. Conf. Computer Vision (IEEE Cat. No. 98CH36271), Bombay, India, 1998, pp. 839–846.
[2]

J. Chen, S. Paris, and F. Durand, Real-time edge-aware image processing with the bilateral grid, ACM Trans. Graph., vol. 26, no. 3, p. 103, 2007.

[3]

S. Wu, S. Shen, X. Xu, Y. Chen, X. Zhou, D. Liu, X. Xue, and L. Qi, Popularity-aware and diverse web APIs recommendation based on correlation graph, IEEE Trans. Comput. Soc. Syst., vol. 10, no. 2, pp. 771–782, 2023.

[4]

C. Yang, X. Xu, X. Zhou, and L. Qi, Deep Q network–driven task offloading for efficient multimedia data analysis in edge computing–assisted IoV, ACM Trans. Multimedia Comput. Commun. Appl., vol. 18, no. 2s, pp. 1–24, 2022.

[5]

Y. Jia, B. Liu, W. Dou, X. Xu, X. Zhou, L. Qi, and Z. Yan, CroApp: A CNN-based resource optimization approach in edge computing environment, IEEE Trans. Ind. Inform., vol. 18, no. 9, pp. 6300–6307, 2022.

[6]

Y. Xu, X. Gao, C. Zhang, J. Tan, and X. Li, High quality superpixel generation through regional decomposition, IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 4, pp. 1802–1815, 2023.

[7]

H. Cho, H. Lee, H. Kang, and S. Lee, Bilateral texture filtering, ACM Trans. Graph., vol. 33, no. 4, pp. 1–8, 2014.

[8]

L. Bao, Y. Song, Q. Yang, H. Yuan, and G. Wang, Tree filtering: Efficient structure-preserving smoothing with a minimum spanning tree, IEEE Trans. Image Process., vol. 23, no. 2, pp. 555–569, 2014.

[9]

Z. Li, X. Xu, T. Hang, H. Xiang, Y. Cui, L. Qi, and X. Zhou, A knowledge-driven anomaly detection framework for social production system, IEEE Trans. Comput. Soc. Syst. doi: 10.1109/2022.3217790.

[10]

P. Perona and J. Malik, Scale-space and edge detection using anisotropic diffusion, IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 7, pp. 629–639, 1990.

[11]

X. Xu, J. Gu, H. Yan, W. Liu, L. Qi, and X. Zhou, Reputation-aware supplier assessment for blockchain-enabled supply chain in industry 4.0, IEEE Trans. Ind. Inform., vol. 19, no. 4, pp. 5485–5494, 2023.

[12]

L. Qi, W. Lin, X. Zhang, W. Dou, X. Xu, and J. Chen, A correlation graph based approach for personalized and compatible web APIs recommendation in mobile APP development, IEEE Trans. Knowl. Data Eng., vol. 35, no. 6, pp. 5444–5457, 2023.

[13]

Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, Edge-preserving decompositions for multi-scale tone and detail manipulation, ACM Trans. Graph., vol. 27, no. 3, pp. 1–10, 2008.

[14]
K. Mikolajczyk and C. Schmid, An affine invariant interest point detector, in Proc. 7th European Conf. Computer Vision, Copenhagen, Denmark, 2002, pp. 128–142.
DOI
[15]

H. Dai, J. Yu, M. Li, W. Wang, A. X. Liu, J. Ma, L. Qi, and G. Chen, Bloom filter with noisy coding framework for multi-set membership testing, IEEE Trans. Knowl. Data Eng., vol. 35, no. 7, pp. 6710–6724, 2023.

[16]
B. Cai, X. Xing, and X. Xu, Edge/structure preserving smoothing via relativity-of-Gaussian, in Proc. 2017 IEEE Int. Conf. Image Processing (ICIP), Beijing, China, 2018, pp. 250–254.
DOI
[17]

X. Xu, Z. Fang, L. Qi, X. Zhang, Q. He, and X. Zhou, TripRes: Traffic flow prediction driven resource reservation for multimedia IoV with edge computing, ACM Trans. Multimedia Computing, Communications, and Applications, vol. 17, no. 2, pp. 1–21, 2021.

[18]

L. I. Rudin, S. Osher, and E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D Nonlinear Phenom., vol. 60, nos.1−4, pp. 259–268, 1992.

[19]

L. Xu, Q. Yan, Y. Xia, and J. Jia, Structure extraction from texture via relative total variation, ACM Trans. Graph., vol. 31, no. 6, pp. 1–10, 2012.

[20]

L. Xu, C. Lu, Y. Xu, and J. Jia, Image smoothing via L0 gradient minimization, ACM Trans. Graph., vol. 30, no. 6, pp. 1–12, 2011.

[21]

S. Ono, L0 gradient projection, IEEE Trans. Image Process., vol. 26, no. 4, pp. 1554–1564, 2017.

[22]

Y. Wang, L. Qi, R. Dou, S. Shen, L. Hou, Y. Liu, Y. Yang, and L. Kong, An accuracy-enhanced group recommendation approach based on DEMATEL, Pattern Recognit. Lett., vol. 167, pp. 171–180, 2023.

[23]
Y. Akai, T. Shibata, R. Matsuoka, and M. Okuda, L0 smoothing based on gradient constraints, in Proc. 2018 25th IEEE Int. Conf. Image Processing (ICIP), Athens, Greece, 2018, pp. 3943–3947.
[24]

W. Liu, P. Zhang, Y. Lei, X. Huang, J. Yang, and M. Ng, A generalized framework for edge-preserving and structure-preserving image smoothing, IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 10, pp. 6631–6648, 2022.

[25]
Q. Chen, J. Xu, and V. Koltun, Fast image processing with fully-convolutional networks, in Proc. 2017 IEEE Int. Conf. Computer Vision (ICCV), Venice, Italy, 2017, pp. 2516–2525.
DOI
[26]
L. Xu, J. Ren, Q. Yan, R. Liao, and J. Jia, Deep edge-aware filters, in Proc. 32nd Int. Conf. Machine Learning, Lille, France, 2015, pp. 1669–1678.
[27]

Y. Liu, D. Li, S. Wan, F. Wang, W. Dou, X. Xu, S. Li, R. Ma, and L. Qi, A long short-term memory-based model for greenhouse climate prediction, Int. J. Intell. Syst., vol. 37, no. 1, pp. 135–151, 2022.

[28]

Y. Kim, B. Ham, M. N. Do, and K. Sohn, Structure-texture image decomposition using deep variational priors, IEEE Trans. Image Process., vol. 28, no. 6, pp. 2692–2704, 2019.

[29]

L. Qi, Y. Liu, Y. Zhang, X. Xu, M. Bilal, and H. Song, Privacy-aware point-of-interest category recommendation in Internet of Things, IEEE Internet Things J., vol. 9, no. 21, pp. 21398–21408, 2022.

[30]
J. Li, K. Qin, R. Xu, and H. Ji, Deep scale-aware image smoothing, in Proc. ICASSP 2022 - 2022 IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Singapore, 2022, pp. 2105–2109.
DOI
[31]

Q. Fan, J. Yang, D. Wipf, B. Chen, and X. Tong, Image smoothing via unsupervised learning, ACM Trans. Graph., vol. 37, no. 6, pp. 1–14, 2018.

[32]
M. Li, Y. Fu, X. Li, and X. Guo, Deep flexible structure preserving image smoothing, in Proc. 30th ACM Int. Conf. Multimedia, Lisboa, Portugal, 2022, pp. 1875–1883.
DOI
[33]

Y. Liu, H. Wu, K. Rezaee, M. R. Khosravi, O. I. Khalaf, A. A. Khan, D. Ramesh, and L. Qi, Interaction-enhanced and time-aware graph convolutional network for successive point-of-interest recommendation in traveling enterprises, IEEE Trans. Ind. Inform., vol. 19, no. 1, pp. 635–643, 2023.

[34]

Y. Yang, H. Hui, L. Zeng, Y. Zhao, Y. Zhan, and T. Yan, Edge-preserving image filtering based on soft clustering, IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 7, pp. 4150–4162, 2022.

[35]

X. Ma, X. Li, Y. Zhou, and C. Zhang, Image smoothing based on global sparsity decomposition and a variable parameter, Comput. Vis. Medium., vol. 7, no. 4, pp. 483–497, 2021.

[36]

X. Zhang, Y. Sun, H. Liu, Z. Hou, F. Zhao, and C. Zhang, Improved clustering algorithms for image segmentation based on non-local information and back projection, Inf. Sci., vol. 550, pp. 129–144, 2021.

[37]

X. Yu, H. Liu, Y. Lin, Y. Wu, and C. Zhang, Auto-weighted sample-level fusion with anchors for incomplete multi-view clustering, Pattern Recognition, vol. 130, p. 108772, 2022.

[38]

Y. Wang, J. Yang, W. Yin, and Y. Zhang, A new alternating minimization algorithm for total variation image reconstruction, SIAM J. Imaging Sci., vol. 1, no. 3, pp. 248–272, 2008.

[39]

T. Yao, X. Kong, H. Fu, and Q. Tian, Discrete semantic alignment hashing for cross-media retrieval, IEEE Trans. Cybern., vol. 50, no. 12, pp. 4896–4907, 2020.

[40]
Q. He, S. Tan, F. Chen, X. Xu, L. Qi, X. Hei, H. Jin, and Y. Yang, EDIndex: Enabling fast data queries in edge storage systems, in Proc. 46th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Taipei, China, 2023, pp. 675–685.
DOI
[41]

M. Zhang and C. Desrosiers, High-quality image restoration using low-rank patch regularization and global structure sparsity, IEEE Trans. Image Process., vol. 28, no. 2, pp. 868–879, 2019.

[42]

J. Pan, D. Sun, J. Zhang, J. Tang, J. Yang, Y. W. Tai, and M. H. Yang, Dual convolutional neural networks for low-level vision, Int. J. Comput. Vis., vol. 130, no. 6, pp. 1440–1458, 2022.

[43]

J. Eckstein and D. P. Bertsekas, On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators, Math. Program., vol. 55, nos. 1−3, pp. 293–318, 1992.

[44]

S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, Distributed optimization and statistical learning via the alternating direction method of multipliers, Found. Trends® Mach. Learn., vol. 3, no. 1, pp. 1–122, 2011.

[45]
R. Zhang and J. T. Kwok, Asynchronous distributed ADMM for consensus optimization, in Proc. 31st Int. Conf. Mach. Learn., Beijing, China, 2014, pp. 3689–3697.
[46]
D. L. Sun and C. Févotte, Alternating direction method of multipliers for non-negative matrix factorization with the beta-divergence, in Proc. 2014 IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy, 2014, pp. 6201–6205.
DOI
[47]

G. H. Ma, M. L. Zhang, X. M. Li, and C. M. Zhang, Image smoothing based on image decomposition and sparse high frequency gradient, J. Comput. Sci. Technol., vol. 33, no. 3, pp. 502–510, 2018.

[48]

D. G. Lowe, Distinctive image features from scale-invariant keypoints, Int. J. Comput. Vis., vol. 60, no. 2, pp. 91–110, 2004.

Publication history
Copyright
Rights and permissions

Publication history

Received: 29 May 2023
Revised: 26 June 2023
Accepted: 02 July 2023
Published: 09 February 2024
Issue date: August 2024

Copyright

© The Author(s) 2024.

Rights and permissions

The articles published in this open access journal are distributed under the terms of theCreative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return