Sanger's network

A Sanger's network is a neural network model for online Principal Component extraction proposed by T. D. Sanger in Optimal Unsupervised Learning in a Single-Layer Linear Feedforward Neural NetworkSanger T. D., Neural Networks, 1989/2. The author started with the standard version of Hebb's rule and modified it to be able to extract a variable number of principal components (v1, v2, ..., vm) in descending order (λ1 > λ2 > ... > λm). The resulting approach, which is a natural extension of Oja's rule, has been called the Generalized Hebbian Rule (GHA) (or Learning). The structure of the network is represented in the following diagram:

The network is fed with samples extracted from an n-dimensional dataset:

The m output neurons ...

Get Mastering Machine Learning Algorithms now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.