AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (1.4 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Publishing Language: Chinese | Open Access

Research on a prompt learning method for intangible cultural heritage art image classification

Qinyu ZHANG1,2Xinda LIU1,2( )Zhuoming LU3Mingquan ZHOU1,2,4
National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Northwest University, Xi’an 710127, China
School of Information Science and Technology, Northwest University, Xi’an 710127, China
College of Letters and Science, University of California, Davis CA 95616, USA
Virtual Reality Research Center of Ministry of Education, Being Normal University, Bejing 100875, China
Show Author Information

Abstract

To address the issues of prolonged processing time, low efficiency, and high data complexity in the classification of Chinese intangible cultural heritage (ICH) artworks, this paper proposes a context-based text prompt tuning strategy based on a pre-trained vision-language model. This approach introduces trainable context optimization soft prompts, enabling the model to quickly adapt to downstream classification tasks under limited sample conditions, thereby effectively reducing training time and improving convergence speed. Specifically, the proposed method integrates text features generated by the soft prompts with the original features of the pre-trained vision-language model through an attention mechanism, and optimizes the embedded representations via a contrastive loss function. This mechanism significantly reduces the embedding discrepancy between the two types of features, preventing the model from overfitting to visible base categories and enhancing its generalization ability to unseen classes. Moreover, the retention of original features helps mitigate catastrophic forgetting during training, ensuring high classification accuracy even under few-shot conditions. Experimental results demonstrate that the proposed method improves classification accuracy by 1.79%, enhances generalization by 10.4%, and maintains low computational cost.

CLC number: TP391

References

【1】
【1】
 
 
Journal of Northwest University (Natural Science Edition)
Pages 106-117

{{item.num}}

Comments on this article

Go to comment

< Back to all reports

Review Status: {{reviewData.commendedNum}} Commended , {{reviewData.revisionRequiredNum}} Revision Required , {{reviewData.notCommendedNum}} Not Commended Under Peer Review

Review Comment

Close
Close
Cite this article:
ZHANG Q, LIU X, LU Z, et al. Research on a prompt learning method for intangible cultural heritage art image classification. Journal of Northwest University (Natural Science Edition), 2025, 55(1): 106-117. https://doi.org/10.16152/j.cnki.xdxbzr.2025-01-009

454

Views

3

Downloads

0

Crossref

0

CSCD

Received: 20 November 2024
Published: 25 February 2025
© The Editorial Department of Journal of Northwest University (Natural Science Edition)2025.

This is an open access article under the CC BY-NC-ND 4.0 license (https://creativecommons.org/licenses/by-nc-nd/4.0/).