Anti-Hebbian synapses as a linear equation solver

Kechen Zhang, Giorgio Ganis, Martin I. Sereno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

It is known that Hebbian synapses, with appropriate weight normalization, extract the first principal component of the input patterns. Anti-Hebb rules have been used in combination with Hebb rules to extract additional principal components or generate sparse codes. Here we show that the simple anti-Hebbian synapses alone can support an important computational function: solving simultaneous linear equations. During repetitive learning with a simple anti-Hebb rule, the weights onto an output unit always converge to the exact solution of the linear equations whose coefficients correspond to the input patterns and whose constant terms correspond to the biases, provided that the solution exists. If there are more equations than unknowns and no solution exists, the weights approach the values obtained by using the Moore-Penrose generalized inverse (pseudoinverse). No explicit matrix inversion is involved and there is no need to normalize weights. Mathematically, the anti-Hebb rule may be regarded as an iterative algorithm for learning a special case of the linear associative mapping. Since solving systems of linear equations is a very basic computational problem to which many other problems are often reduced, our interpretation suggests a potentially general computational role for the anti-Hebbian synapses and a certain type of long-term depression (LTD).

Original languageEnglish (US)
Title of host publication1997 IEEE International Conference on Neural Networks, ICNN 1997
Pages387-389
Number of pages3
DOIs
StatePublished - Dec 1 1997
Externally publishedYes
Event1997 IEEE International Conference on Neural Networks, ICNN 1997 - Houston, TX, United States
Duration: Jun 9 1997Jun 12 1997

Publication series

NameIEEE International Conference on Neural Networks - Conference Proceedings
Volume1
ISSN (Print)1098-7576

Conference

Conference1997 IEEE International Conference on Neural Networks, ICNN 1997
CountryUnited States
CityHouston, TX
Period6/9/976/12/97

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Anti-Hebbian synapses as a linear equation solver'. Together they form a unique fingerprint.

  • Cite this

    Zhang, K., Ganis, G., & Sereno, M. I. (1997). Anti-Hebbian synapses as a linear equation solver. In 1997 IEEE International Conference on Neural Networks, ICNN 1997 (pp. 387-389). [611699] (IEEE International Conference on Neural Networks - Conference Proceedings; Vol. 1). https://doi.org/10.1109/ICNN.1997.611699