TY - GEN
T1 - Implementing VTA, a tensor accelerator on Flow-in-Cloud
AU - Hironaka, Kazuei
AU - Iizuka, Kensuke
AU - Amano, Hideharu
N1 - Funding Information:
This work was supported by JST CREST Grant Number JPMJCR19K1, Japan.
Publisher Copyright:
© 2021 ACM.
PY - 2021/6/20
Y1 - 2021/6/20
N2 - A multi-FPGA system Flow-in-Cloud (FiC) consists of nodes with a mid-class cost-efficient FPGA and Raspberry Pi3B connected with high speed serial links. It aims to implement a large scale AI applications which is difficult to be implemented on a single FPGA by dividing the target into a number of boards. On the other hand, overlay domain specific architecture receives attention for implementing complicated application programs easily on the FPGA. Here, we focus on an open-source AI compiler framework Apache TVM, and its implementation for FPGA, VTA(Versatile Tensor Accelerator). In order to use FiC through the TVM, we implemented it on FiC and executed the ResNet-18 inference benchmark. The preliminary evaluation results showed that VTA on FiC-SW achieved up to 10 times performance compared to the execution on ARM Cortex-A54 software.
AB - A multi-FPGA system Flow-in-Cloud (FiC) consists of nodes with a mid-class cost-efficient FPGA and Raspberry Pi3B connected with high speed serial links. It aims to implement a large scale AI applications which is difficult to be implemented on a single FPGA by dividing the target into a number of boards. On the other hand, overlay domain specific architecture receives attention for implementing complicated application programs easily on the FPGA. Here, we focus on an open-source AI compiler framework Apache TVM, and its implementation for FPGA, VTA(Versatile Tensor Accelerator). In order to use FiC through the TVM, we implemented it on FiC and executed the ResNet-18 inference benchmark. The preliminary evaluation results showed that VTA on FiC-SW achieved up to 10 times performance compared to the execution on ARM Cortex-A54 software.
KW - Apache TVM
KW - FPGA
KW - Versatile Tensor Acclerator
UR - http://www.scopus.com/inward/record.url?scp=85118294293&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85118294293&partnerID=8YFLogxK
U2 - 10.1145/3468081.3471121
DO - 10.1145/3468081.3471121
M3 - Conference contribution
AN - SCOPUS:85118294293
T3 - ACM International Conference Proceeding Series
SP - 46
EP - 50
BT - Proceedings - 8th International Conference on Applied Computing and Information Technology, ACIT 2021
PB - Association for Computing Machinery
T2 - 8th International Conference on Applied Computing and Information Technology, ACIT 2021
Y2 - 20 June 2021 through 22 June 2021
ER -