AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Tsinghua Science and Technology Article
PDF (6.2 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

A Parameter Adaptive Method for Image Smoothing

School of Computer Science and Technology, Shandong University, Jinan 250101, China
School of Software, Shandong University, Jinan 250101, China
Show Author Information

Abstract

Edge is the key information in the process of image smoothing. Some edges, especially the weak edges, are difficult to maintain, which result in the local area being over-smoothed. For the protection of weak edges, we propose an image smoothing algorithm based on global sparse structure and parameter adaptation. The algorithm decomposes the image into high frequency and low frequency part based on global sparse structure. The low frequency part contains less texture information which is relatively easy to smoothen. The high frequency part is more sensitive to edge information so it is more suitable for the selection of smoothing parameters. To reduce the computational complexity and improve the effect, we propose a bicubic polynomial fitting method to fit all the sample values into a surface. Finally, we use Alternating Direction Method of Multipliers (ADMM) to unify the whole algorithm and obtain the smoothed results by iterative optimization. Compared with traditional methods and deep learning methods, as well as the application tasks of edge extraction, image abstraction, pseudo-boundary removal, and image enhancement, it shows that our algorithm can preserve the local weak edge of the image more effectively, and the visual effect of smoothed results is better.

Keywords

image smoothingparameter adaptationbicubic interpolationpolynomial fitting

References

[1]
C. Tomasi and R. Manduchi, Bilateral filtering for gray and color images, in Proc. 6th Int. Conf. Computer Vision (IEEE Cat. No. 98CH36271), Bombay, India, 1998, pp. 839–846.
[2]

J. Chen, S. Paris, and F. Durand, Real-time edge-aware image processing with the bilateral grid, ACM Trans. Graph., vol. 26, no. 3, p. 103, 2007.
Crossref Google Scholar
[3]

S. Wu, S. Shen, X. Xu, Y. Chen, X. Zhou, D. Liu, X. Xue, and L. Qi, Popularity-aware and diverse web APIs recommendation based on correlation graph, IEEE Trans. Comput. Soc. Syst., vol. 10, no. 2, pp. 771–782, 2023.
Crossref Google Scholar
[4]

C. Yang, X. Xu, X. Zhou, and L. Qi, Deep Q network–driven task offloading for efficient multimedia data analysis in edge computing–assisted IoV, ACM Trans. Multimedia Comput. Commun. Appl., vol. 18, no. 2s, pp. 1–24, 2022.
Crossref Google Scholar
[5]

Y. Jia, B. Liu, W. Dou, X. Xu, X. Zhou, L. Qi, and Z. Yan, CroApp: A CNN-based resource optimization approach in edge computing environment, IEEE Trans. Ind. Inform., vol. 18, no. 9, pp. 6300–6307, 2022.
Crossref Google Scholar
[6]

Y. Xu, X. Gao, C. Zhang, J. Tan, and X. Li, High quality superpixel generation through regional decomposition, IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 4, pp. 1802–1815, 2023.
Crossref Google Scholar
[7]

H. Cho, H. Lee, H. Kang, and S. Lee, Bilateral texture filtering, ACM Trans. Graph., vol. 33, no. 4, pp. 1–8, 2014.
Crossref Google Scholar
[8]

L. Bao, Y. Song, Q. Yang, H. Yuan, and G. Wang, Tree filtering: Efficient structure-preserving smoothing with a minimum spanning tree, IEEE Trans. Image Process., vol. 23, no. 2, pp. 555–569, 2014.
Crossref Google Scholar
[9]

Z. Li, X. Xu, T. Hang, H. Xiang, Y. Cui, L. Qi, and X. Zhou, A knowledge-driven anomaly detection framework for social production system, IEEE Trans. Comput. Soc. Syst. doi: 10.1109/2022.3217790.
Google Scholar
[10]

P. Perona and J. Malik, Scale-space and edge detection using anisotropic diffusion, IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 7, pp. 629–639, 1990.
Crossref Google Scholar
[11]

X. Xu, J. Gu, H. Yan, W. Liu, L. Qi, and X. Zhou, Reputation-aware supplier assessment for blockchain-enabled supply chain in industry 4.0, IEEE Trans. Ind. Inform., vol. 19, no. 4, pp. 5485–5494, 2023.
Crossref Google Scholar
[12]

L. Qi, W. Lin, X. Zhang, W. Dou, X. Xu, and J. Chen, A correlation graph based approach for personalized and compatible web APIs recommendation in mobile APP development, IEEE Trans. Knowl. Data Eng., vol. 35, no. 6, pp. 5444–5457, 2023.
Google Scholar
[13]

Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, Edge-preserving decompositions for multi-scale tone and detail manipulation, ACM Trans. Graph., vol. 27, no. 3, pp. 1–10, 2008.
Crossref Google Scholar
[14]
K. Mikolajczyk and C. Schmid, An affine invariant interest point detector, in Proc. 7th European Conf. Computer Vision, Copenhagen, Denmark, 2002, pp. 128–142.
Crossref
[15]

H. Dai, J. Yu, M. Li, W. Wang, A. X. Liu, J. Ma, L. Qi, and G. Chen, Bloom filter with noisy coding framework for multi-set membership testing, IEEE Trans. Knowl. Data Eng., vol. 35, no. 7, pp. 6710–6724, 2023.
Google Scholar
[16]
B. Cai, X. Xing, and X. Xu, Edge/structure preserving smoothing via relativity-of-Gaussian, in Proc. 2017 IEEE Int. Conf. Image Processing (ICIP), Beijing, China, 2018, pp. 250–254.
Crossref
[17]

X. Xu, Z. Fang, L. Qi, X. Zhang, Q. He, and X. Zhou, TripRes: Traffic flow prediction driven resource reservation for multimedia IoV with edge computing, ACM Trans. Multimedia Computing, Communications, and Applications, vol. 17, no. 2, pp. 1–21, 2021.
Crossref Google Scholar
[18]

L. I. Rudin, S. Osher, and E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D Nonlinear Phenom., vol. 60, nos.1−4, pp. 259–268, 1992.
Crossref Google Scholar
[19]

L. Xu, Q. Yan, Y. Xia, and J. Jia, Structure extraction from texture via relative total variation, ACM Trans. Graph., vol. 31, no. 6, pp. 1–10, 2012.
Crossref Google Scholar
[20]

L. Xu, C. Lu, Y. Xu, and J. Jia, Image smoothing via L0 gradient minimization, ACM Trans. Graph., vol. 30, no. 6, pp. 1–12, 2011.
Crossref Google Scholar
[21]

S. Ono, L0 gradient projection, IEEE Trans. Image Process., vol. 26, no. 4, pp. 1554–1564, 2017.
Crossref Google Scholar
[22]

Y. Wang, L. Qi, R. Dou, S. Shen, L. Hou, Y. Liu, Y. Yang, and L. Kong, An accuracy-enhanced group recommendation approach based on DEMATEL, Pattern Recognit. Lett., vol. 167, pp. 171–180, 2023.
Crossref Google Scholar
[23]
Y. Akai, T. Shibata, R. Matsuoka, and M. Okuda, L0 smoothing based on gradient constraints, in Proc. 2018 25th IEEE Int. Conf. Image Processing (ICIP), Athens, Greece, 2018, pp. 3943–3947.
[24]

W. Liu, P. Zhang, Y. Lei, X. Huang, J. Yang, and M. Ng, A generalized framework for edge-preserving and structure-preserving image smoothing, IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 10, pp. 6631–6648, 2022.
Crossref Google Scholar
[25]
Q. Chen, J. Xu, and V. Koltun, Fast image processing with fully-convolutional networks, in Proc. 2017 IEEE Int. Conf. Computer Vision (ICCV), Venice, Italy, 2017, pp. 2516–2525.
Crossref
[26]
L. Xu, J. Ren, Q. Yan, R. Liao, and J. Jia, Deep edge-aware filters, in Proc. 32nd Int. Conf. Machine Learning, Lille, France, 2015, pp. 1669–1678.
[27]

Y. Liu, D. Li, S. Wan, F. Wang, W. Dou, X. Xu, S. Li, R. Ma, and L. Qi, A long short-term memory-based model for greenhouse climate prediction, Int. J. Intell. Syst., vol. 37, no. 1, pp. 135–151, 2022.
Crossref Google Scholar
[28]

Y. Kim, B. Ham, M. N. Do, and K. Sohn, Structure-texture image decomposition using deep variational priors, IEEE Trans. Image Process., vol. 28, no. 6, pp. 2692–2704, 2019.
Crossref Google Scholar
[29]

L. Qi, Y. Liu, Y. Zhang, X. Xu, M. Bilal, and H. Song, Privacy-aware point-of-interest category recommendation in Internet of Things, IEEE Internet Things J., vol. 9, no. 21, pp. 21398–21408, 2022.
Crossref Google Scholar
[30]
J. Li, K. Qin, R. Xu, and H. Ji, Deep scale-aware image smoothing, in Proc. ICASSP 2022 - 2022 IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Singapore, 2022, pp. 2105–2109.
Crossref
[31]

Q. Fan, J. Yang, D. Wipf, B. Chen, and X. Tong, Image smoothing via unsupervised learning, ACM Trans. Graph., vol. 37, no. 6, pp. 1–14, 2018.
Crossref Google Scholar
[32]
M. Li, Y. Fu, X. Li, and X. Guo, Deep flexible structure preserving image smoothing, in Proc. 30th ACM Int. Conf. Multimedia, Lisboa, Portugal, 2022, pp. 1875–1883.
Crossref
[33]

Y. Liu, H. Wu, K. Rezaee, M. R. Khosravi, O. I. Khalaf, A. A. Khan, D. Ramesh, and L. Qi, Interaction-enhanced and time-aware graph convolutional network for successive point-of-interest recommendation in traveling enterprises, IEEE Trans. Ind. Inform., vol. 19, no. 1, pp. 635–643, 2023.
Crossref Google Scholar
[34]

Y. Yang, H. Hui, L. Zeng, Y. Zhao, Y. Zhan, and T. Yan, Edge-preserving image filtering based on soft clustering, IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 7, pp. 4150–4162, 2022.
Crossref Google Scholar
[35]

X. Ma, X. Li, Y. Zhou, and C. Zhang, Image smoothing based on global sparsity decomposition and a variable parameter, Comput. Vis. Medium., vol. 7, no. 4, pp. 483–497, 2021.
Crossref Google Scholar
[36]

X. Zhang, Y. Sun, H. Liu, Z. Hou, F. Zhao, and C. Zhang, Improved clustering algorithms for image segmentation based on non-local information and back projection, Inf. Sci., vol. 550, pp. 129–144, 2021.
Crossref Google Scholar
[37]

X. Yu, H. Liu, Y. Lin, Y. Wu, and C. Zhang, Auto-weighted sample-level fusion with anchors for incomplete multi-view clustering, Pattern Recognition, vol. 130, p. 108772, 2022.
Crossref Google Scholar
[38]

Y. Wang, J. Yang, W. Yin, and Y. Zhang, A new alternating minimization algorithm for total variation image reconstruction, SIAM J. Imaging Sci., vol. 1, no. 3, pp. 248–272, 2008.
Crossref Google Scholar
[39]

T. Yao, X. Kong, H. Fu, and Q. Tian, Discrete semantic alignment hashing for cross-media retrieval, IEEE Trans. Cybern., vol. 50, no. 12, pp. 4896–4907, 2020.
Crossref Google Scholar
[40]
Q. He, S. Tan, F. Chen, X. Xu, L. Qi, X. Hei, H. Jin, and Y. Yang, EDIndex: Enabling fast data queries in edge storage systems, in Proc. 46th Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Taipei, China, 2023, pp. 675–685.
Crossref
[41]

M. Zhang and C. Desrosiers, High-quality image restoration using low-rank patch regularization and global structure sparsity, IEEE Trans. Image Process., vol. 28, no. 2, pp. 868–879, 2019.
Crossref Google Scholar
[42]

J. Pan, D. Sun, J. Zhang, J. Tang, J. Yang, Y. W. Tai, and M. H. Yang, Dual convolutional neural networks for low-level vision, Int. J. Comput. Vis., vol. 130, no. 6, pp. 1440–1458, 2022.
Crossref Google Scholar
[43]

J. Eckstein and D. P. Bertsekas, On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators, Math. Program., vol. 55, nos. 1−3, pp. 293–318, 1992.
Crossref Google Scholar
[44]

S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, Distributed optimization and statistical learning via the alternating direction method of multipliers, Found. Trends® Mach. Learn., vol. 3, no. 1, pp. 1–122, 2011.
Google Scholar
[45]
R. Zhang and J. T. Kwok, Asynchronous distributed ADMM for consensus optimization, in Proc. 31st Int. Conf. Mach. Learn., Beijing, China, 2014, pp. 3689–3697.
[46]
D. L. Sun and C. Févotte, Alternating direction method of multipliers for non-negative matrix factorization with the beta-divergence, in Proc. 2014 IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy, 2014, pp. 6201–6205.
Crossref
[47]

G. H. Ma, M. L. Zhang, X. M. Li, and C. M. Zhang, Image smoothing based on image decomposition and sparse high frequency gradient, J. Comput. Sci. Technol., vol. 33, no. 3, pp. 502–510, 2018.
Crossref Google Scholar
[48]

D. G. Lowe, Distinctive image features from scale-invariant keypoints, Int. J. Comput. Vis., vol. 60, no. 2, pp. 91–110, 2004.
Crossref Google Scholar
Tsinghua Science and Technology
Volume 29 Issue 4,
August 2024
Pages 1138-1151
DOI: 10.26599/TST.2023.9010068
Cite this article:
Wang S, Ma X, Li X. A Parameter Adaptive Method for Image Smoothing. Tsinghua Science and Technology, 2024, 29(4): 1138-1151. https://doi.org/10.26599/TST.2023.9010068

840

Views

85

Downloads

0

Crossref

0

Web of Science

0

Scopus

0

CSCD

Altmetrics
Received: 29 May 2023
Revised: 26 June 2023
Accepted: 02 July 2023
Published: 09 February 2024
© The Author(s) 2024.

The articles published in this open access journal are distributed under the terms of theCreative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
Return