Design of High Energy Efficient Spiking Neural Network Accelerator for Image Recognition

ZHANG Jian; LIU Jia; WAN Xianjie; YU Zhou; HAN Chuanyu; ZHANG Guohe

doi:10.7652/xjtuxb202301020

您当前的位置：

首页 >

文章列表页 >

Design of High Energy Efficient Spiking Neural Network Accelerator for Image Recognition

更新时间：2025-07-09

- Design of High Energy Efficient Spiking Neural Network Accelerator for Image Recognition
- Vol. 57, Issue 1, Pages: 211-220(2023)
- 作者机构：
  
  1. 西安交通大学电子与信息学部,西安,710049
  2. 中国电子科技集团第二十四研究所,重庆,400060
- 作者简介：
- 基金信息：
- DOI：10.7652/xjtuxb202301020
  CLC： TM301
- Online First：10 January 2023，
  
  Published：2023
- 稿件说明：
移动端阅览
ZHANG Jian, LIU Jia, WAN Xianjie, et al. Design of High Energy Efficient Spiking Neural Network Accelerator for Image Recognition[J]. 2023, 57(1): 211-220.
DOI：

ZHANG Jian, LIU Jia, WAN Xianjie, et al. Design of High Energy Efficient Spiking Neural Network Accelerator for Image Recognition[J]. 2023, 57(1): 211-220. DOI： 10.7652/xjtuxb202301020.

摘要

针对基于通用处理器解决方案在图像识别应用中速度慢、功耗高的问题

提出了一种高能效的脉冲神经网络加速器设计方案。首先

采用神经形态学计算中的高并行设计思想

设计了多核并行结构来实现硬件加速; 然后

根据脉冲数据传输稀疏性的特点

采用基于事件驱动的数据传输与处理方式

设计了一对一的核间传输机制

减小了用于通信的硬件资源并提高了数据传输效率; 其次

提出了按行的数据存放方式来加快膜电压数据在存储器的存取效率; 最后

设计了结合查找表与异或的电路结构

可以快速的将事件向量转变为地址事件表达(AER)格式。采用所提加速器设计方案在现场可编程逻辑门阵列(FPGA)开发板上进行优化和部署。实验结果表明:当时钟频率采用100 MHz时

识别单张手写数字图像所需能量为1.04 mJ

仅为2.2 GHz通用中央处理器(CPU)上的串行软件程序的1/1 453.8。该加速器设计方案适用于实时性要求高和能量受限的实际场景。

Abstract

A high energy efficiency spiking neural network(SNN)accelerator is proposed to solve the problems of low-speed and high-power consumption in image recognition application based on the general processor. Firstly

a multi-core parallel structure is designed for hardware acceleration by adopting the concept of high parallel design in neuromorphic computation. Secondly

considering the sparsity of spike data transmission

the one-to-one inter-core transmission mechanism is designed based on event-driven data transmission and processing

which reduces the hardware resources used for communication and improves the data transmission efficiency. Thirdly

a data arrangement scheme is proposed to speed up the access efficiency of membrane in memory. Finally

a circuit structure combining lookups and XOR is designed

which can quickly transform the event vectors into address-event-represent(AER)format. The proposed design is optimized and implemented on the field programmable logic gate array(FPGA)development board. The experimental results show that when the clock frequency is 100 MHz

the energy required to recognize a handwritten digital image is 1.04 mJ

which is only 1/1 453.8 of the serial software program on the 2.2 GHz universal central processing unit(CPU). The proposed accelerator design scheme is suitable for the real scenarios with high real-time requirements and limited energy.

关键词

Keywords

references

GREENBERG A, HAMILTON J, MALTZ D A, et al. The cost of a cloud: research problems in data center networks [J]. ACM SIGCOMM Computer Communication Review, 2009, 39(1): 68-73.

TOGAÇAR M, ERGEN B, CÖMERT Z. Detection of weather images by using spiking neural networks of deep learning models [J]. Neural Computing and Applications, 2021, 33(11): 6147-6159.

马新娜, 赵猛, 祁琳. 基于卷积脉冲神经网络的故障诊断方法研究 [J]. 广西师范大学学报(自然科学版), 2022, 40(3): 112-120.

MA Xinna, ZHAO Meng, QI Lin.Fault diagnosis based on spiking convolution neural network [J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(3): 112-120.

胡一凡, 李国齐, 吴郁杰, 等. 脉冲神经网络研究进展综述 [J]. 控制与决策, 2021, 36(1): 1-26.

HU Yifan, LI Guoqi, WU Yujie, et al.Spiking neural networks: a survey on recent advances and new directions [J]. Control and Decision, 2021, 36(1): 1-26.

BOUVIER M, VALENTIAN A, MESQUIDA T, et al. Spiking neural networks hardware implementations and challenges: a survey [J]. ACM Journal on Emerging Technologies in Computing Systems, 2019, 15(2): 22.

VAN SCHAIK A. Building blocks for electronic spiking neural networks [J]. Neural Networks, 2001, 14(6/7): 617-628.

MITRA S, FUSI S, INDIVERI G. Real-time classification of complex patterns using spike-based learning in neuromorphic VLSI [J]. IEEE Transactions on Biomedical Circuits and Systems, 2009, 3(1): 32-42.

AKOPYAN F, SAWADA J, CASSIDY A, et al. TrueNorth: design and Tool flow of a 65 mW 1 million neuron programmable neurosynaptic chip [J]. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2015, 34(10): 1537-1557.

MA De, SHEN Juncheng, GU Zonghua, et al. Darwin: A neuromorphic hardware co-processor based on spiking neural networks [J]. Journal of Systems Architecture, 2017, 77: 43-51.

FURBER S B, GALLUPPI F, TEMPLE S, et al. The SpiNNaker project [J]. Proceedings of the IEEE, 2014, 102(5): 652-665.

DENG Lei, WANG Guanrui, LI Guoqi, et al. Tianjic: a unified and scalable chip bridging spike-based and continuous neural computation [J]. IEEE Journal of Solid-State Circuits, 2020, 55(8): 2228-2246.

BENJAMIN B V, GAO Peiran, MCQUINN E, et al. Neurogrid: a mixed-analog-digital multichip system for large-scale neural simulations [J]. Proceedings of the IEEE, 2014, 102(5): 699-716.

LI Sixu, ZHANG Zhaomin, MAO Ruixin, et al. A fast and energy-efficient SNN processor with adaptive clock/event-driven computation scheme and online learning [J]. IEEE Transactions on Circuits and Systems: I Regular Papers, 2021, 68(4): 1543-1552.

WU Yujie, DENG Lei, LI Guoqi, et al. Spatio-temporal backpropagation for training high-performance spiking neural networks [J]. Frontiers in Neuroscience, 2018, 12: 331.

刘宙思, 李尊朝, 张剑, 等. 一种离散时间调度的图像自分类脉冲神经网络 [J]. 西安交通大学学报, 2021, 55(3): 57-64.

LIU Zhousi, LI Zunchao, ZHANG Jian, et al. Discrete-time-scheduling spiking neural network for image self-classification [J]. Journal of Xi'an Jiaotong University, 2021, 55(3): 57-64.

KOSTAL L, LANSKY P, ROSPARS J P. Neuronal coding and spiking randomness [J]. European Journal of Neuroscience, 2007, 26(10): 2693-2701.

苏亚丽, 吴健行, 惠维, 等. 一种用于视觉颜色特征分类的脉冲神经网络 [J]. 西安交通大学学报, 2019, 53(10): 115-121.

SU Yali, WU Jianxing, HUI Wei, et al. A spiking neural network for classification of visual color features [J]. Journal of Xi'an Jiaotong University, 2019, 53(10): 115-121.

GERSTNER W, KISTLER W M. Spiking neuron models: single neurons, populations, plasticity [M]. New York, USA: Cambridge University Press, 2002: 20-25.

ABBOTT L F. Lapicque's introduction of the integrate-and-fire model neuron(1907)[J]. Brain Research Bulletin, 1999, 50(5/6): 303-304.

程龙, 刘洋. 脉冲神经网络:模型、学习算法与应用 [J]. 控制与决策, 2018, 33(5): 923-937.

CHENG Long, LIU Yang.Spiking neural networks: model, learning algorithms and applications [J]. Control and Decision, 2018, 33(5): 923-937.

IZHIKEVICH E M. Simple model of spiking neurons [J]. IEEE Transactions on Neural Networks, 2003, 14(6): 1569-1572.

KUMAR A, ROTTER S, AERTSEN A. Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding [J]. Nature Reviews Neuroscience, 2010, 11(9): 615-627.

SERRANO-GOTARREDONA R, SERRANO-GOTARREDONA T, ACOSTA-JIMENEZ A, et al. On real-time AER 2-D convolutions hardware for neuromorphic spike-based cortical processing [J]. IEEE Transactions on Neural Networks, 2008, 19(7): 1196-1219.

SERRANO-GOTARREDONA R, OSTER M, LICHTSTEINER P, et al. CAVIAR: a 45 K neuron, 5 M synapse, 12 G connects/s AER hardware sensory-processing- learning-actuating system for high-speed visual object recognition and tracking [J]. IEEE Transactions on Neural Networks, 2009, 20(9): 1417-1438.

SON B, SUH Y, KIM S, et al. 4.1 A 640×480 dynamic vision sensor with a 9 μm pixel and 300Meps address-event representation [C]//2017 IEEE International Solid-State Circuits Conference(ISSCC). Piscataway, NJ, USA: IEEE, 2017: 66-67.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Advances in Research and Application of Boron Neutron Capture Therapy for Cancer Treatment

Turbulent Kinetic Energy Dissipation Mechanism of Supercritical Carbon Dioxide Leakage Flow in a Scallop Bionic Seal Cavity

Bi-Level Multi-Obj ective Optimization of a Wind-Solar Coupled Hydrogen Production System Based on the Synergy of Hybrid Electrolyzer Arrays

Review of the Application of EBSILON Software in Combined Heat and Power System Optimization

Study on the Thermodynamic Properties in the Anomalous Region of Supercritical Water

Related Author

WANG Sheng

LI Zhifeng

LI Haipeng

YANG Shanghui

XIE Yupeng

LI Jie

WANG Sheng

LI Zhifeng

Related Institution

State Industry-Education Integration Center for Medical Innovations，Xi'an Jiaotong University

Hua Boron Neutron Technology（Hangzhou）Co.，Ltd.

State Industry-Education Integration Center for Medical Innovations, Xi’an Jiaotong University

Hua Boron Neutron Technology (Hangzhou) Co., Ltd.

⁰