AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (7.9 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Deep Model Compression for Mobile Platforms: A Survey

School of Computer Science and Technology, Xidian University, Xi’an 710071, China.
School of Software and Institute of Software Engineering, Xidian University, Xi’an 710071, China.
Show Author Information

Abstract

Despite the rapid development of mobile and embedded hardware, directly executing computation-expensive and storage-intensive deep learning algorithms on these devices’ local side remains constrained for sensory data analysis. In this paper, we first summarize the layer compression techniques for the state-of-the-art deep learning model from three categories: weight factorization and pruning, convolution decomposition, and special layer architecture designing. For each category of layer compression techniques, we quantify their storage and computation tunable by layer compression techniques and discuss their practical challenges and possible improvements. Then, we implement Android projects using TensorFlow Mobile to test these 10 compression methods and compare their practical performances in terms of accuracy, parameter size, intermediate feature size, computation, processing latency, and energy consumption. To further discuss their advantages and bottlenecks, we test their performance over four standard recognition tasks on six resource-constrained Android smartphones. Finally, we survey two types of run-time Neural Network (NN) compression techniques which are orthogonal with the layer compression techniques, run-time resource management and cost optimization with special NN architecture, which are orthogonal with the layer compression techniques.

References

【1】
【1】
 
 
Tsinghua Science and Technology
Pages 677-693

{{item.num}}

Comments on this article

Go to comment

< Back to all reports

Review Status: {{reviewData.commendedNum}} Commended , {{reviewData.revisionRequiredNum}} Revision Required , {{reviewData.notCommendedNum}} Not Commended Under Peer Review

Review Comment

Close
Close
Cite this article:
Nan K, Liu S, Du J, et al. Deep Model Compression for Mobile Platforms: A Survey. Tsinghua Science and Technology, 2019, 24(6): 677-693. https://doi.org/10.26599/TST.2018.9010103

1962

Views

155

Downloads

45

Crossref

N/A

Web of Science

49

Scopus

1

CSCD

Received: 31 January 2018
Revised: 18 May 2018
Accepted: 25 May 2018
Published: 05 December 2019
© The author(s) 2019