A Deep Unsupervised Feature Learning Spiking Neural Network With Binarized Classification Layers for the EMNIST Classification

Ruthvik Vaila, John Chiasson, Vishal Saxena

Research output: Contribution to journalArticlepeer-review

18 Scopus citations

Abstract

End user AI is trained on large server farms with data collected from the users. With ever increasing demand for IoT devices, there is a need for deep learning approaches that can be implemented at the Edge in an energy efficient manner. In this work we approach this using spiking neural networks. The unsupervised learning technique of spike timing dependent plasticity (STDP) and binary activations are used to extract features from spiking input data. Gradient descent (backpropagation) is used only on the output layer to perform training for classification. The accuracies obtained for the balanced EMNIST data set compare favorably with other approaches. The effect of the stochastic gradient descent (SGD) approximations on learning capabilities of our network are also explored.

Original languageEnglish
Pages (from-to)124-135
Number of pages12
JournalIEEE Transactions on Emerging Topics in Computational Intelligence
Volume6
Issue number1
DOIs
StatePublished - 1 Feb 2022

Keywords

  • Binary Activations
  • EMNIST
  • Reduced Multiplications
  • Spiking Networks
  • STDP
  • Surrogate Gradients

Fingerprint

Dive into the research topics of 'A Deep Unsupervised Feature Learning Spiking Neural Network With Binarized Classification Layers for the EMNIST Classification'. Together they form a unique fingerprint.

Cite this