### Abstract

It is known that Hebbian synapses, with appropriate weight normalization, extract the first principal component of the input patterns. Anti-Hebb rules have been used in combination with Hebb rules to extract additional principal components or generate sparse codes. Here we show that the simple anti-Hebbian synapses alone can support an important computational function: solving simultaneous linear equations. During repetitive learning with a simple anti-Hebb rule, the weights onto an output unit always converge to the exact solution of the linear equations whose coefficients correspond to the input patterns and whose constant terms correspond to the biases, provided that the solution exists. If there are more equations than unknowns and no solution exists, the weights approach the values obtained by using the Moore-Penrose generalized inverse (pseudoinverse). No explicit matrix inversion is involved and there is no need to normalize weights. Mathematically, the anti-Hebb rule may be regarded as an iterative algorithm for learning a special case of the linear associative mapping. Since solving systems of linear equations is a very basic computational problem to which many other problems are often reduced, our interpretation suggests a potentially general computational role for the anti-Hebbian synapses and a certain type of long-term depression (LTD).

Original language | English (US) |
---|---|

Title of host publication | 1997 IEEE International Conference on Neural Networks, ICNN 1997 |

Pages | 387-389 |

Number of pages | 3 |

DOIs | |

State | Published - Dec 1 1997 |

Externally published | Yes |

Event | 1997 IEEE International Conference on Neural Networks, ICNN 1997 - Houston, TX, United States Duration: Jun 9 1997 → Jun 12 1997 |

### Publication series

Name | IEEE International Conference on Neural Networks - Conference Proceedings |
---|---|

Volume | 1 |

ISSN (Print) | 1098-7576 |

### Conference

Conference | 1997 IEEE International Conference on Neural Networks, ICNN 1997 |
---|---|

Country | United States |

City | Houston, TX |

Period | 6/9/97 → 6/12/97 |

### ASJC Scopus subject areas

- Software

## Fingerprint Dive into the research topics of 'Anti-Hebbian synapses as a linear equation solver'. Together they form a unique fingerprint.

## Cite this

*1997 IEEE International Conference on Neural Networks, ICNN 1997*(pp. 387-389). [611699] (IEEE International Conference on Neural Networks - Conference Proceedings; Vol. 1). https://doi.org/10.1109/ICNN.1997.611699