论文标题

时空模式的尖峰关联记忆

Spiking Associative Memory for Spatio-Temporal Patterns

论文作者

Davidson, Simon, Furber, Stephen B., Rhodes, Oliver

论文摘要

峰值定时依赖性可塑性是在实际皮质组织中证明的学习形式,但是尝试将其用于人造系统的尝试并未产生良好的结果。本文旨在通过两个重大进展来解决这个问题。首先是开发一个名为Cyclic STDP的简单随机学习规则,该规则可以提取在一组神经元的精确峰值时间中编码的模式。我们表明,赋予该学习规则的一群神经元可以充当有效的短期关联记忆,存储并可靠地回忆起很长一段时间的大量模式关联。 第二个主要主题研究了与训练神经元相关的挑战,以便在精确的时间以及在进一步学习时要保持尖峰召回时间的忠诚度。学习规则要求使用精确时定的尖峰(所谓的时间编码)的强大限制,但也与相信这种编码计划的必要性使尖峰神经网络成为连续学习环境中灵活的智能系统的竞争解决方案的必要性。 编码和学习规则在单层关联内存的设计中得到了证明(我们模拟并表征了与类似大小的内存神经元的3200个尖峰神经元组成的输入层完全连接在一起)。探索了设计注意事项和阐明在设计人员控制下参数的作用。

Spike Timing Dependent Plasticity is form of learning that has been demonstrated in real cortical tissue, but attempts to use it for artificial systems have not produced good results. This paper seeks to remedy this with two significant advances. The first is the development a simple stochastic learning rule called cyclic STDP that can extract patterns encoded in the precise spiking times of a group of neurons. We show that a population of neurons endowed with this learning rule can act as an effective short-term associative memory, storing and reliably recalling a large set of pattern associations over an extended period of time. The second major theme examines the challenges associated with training a neuron to produce a spike at a precise time and for the fidelity of spike recall time to be maintained as further learning occurs. The strong constraint of working with precisely-timed spikes (so-called temporal coding) is mandated by the learning rule but is also consistent with the believe in the necessity of such an encoding scheme to render a spiking neural network a competitive solution for flexible intelligent systems in continuous learning environments. The encoding and learning rules are demonstrated in the design of a single-layer associative memory (an input layer consisting of 3,200 spiking neurons fully-connected to a similar sized population of memory neurons), which we simulate and characterise. Design considerations and clarification of the role of parameters under the control of the designer are explored.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源