Publications
Sort:
Open Access Issue
Efficient RNN inference engine on very long vector processor
Journal of National University of Defense Technology 2024, 46(1): 121-130
Published: 28 February 2024
Abstract PDF (3.5 MB) Collect
Downloads:3

With the increasing depth and the inconsistent length of processing sequences, the performance optimization of RNN (recurrent neural network) on different processors makes it difficult to researchers. An efficient RNN acceleration engine was implemented for the self-developed long vector processor FT-M7032. This engine proposed a row-first matrix vector multiplication algorithm and a data-aware multi-core parallel method to improve the computational efficiency of matrix vector multiplication. It proposed a two-level kernel fusion optimization method to reduce the overhead of temporary data transmission. Optimized handwritten assembly codes for multiple operators were integrated to further tap the performance potential of long vector processors. Experiments show that the RNN engine for long-vector processors is efficient, when compared with the multi-core ARM CPU and Intel Golden CPU, the RNN-like model long short term memory networks can achieve a performance acceleration of up to 62.68 times and 3.12 times, respectively.

Total 1