O'Reilly logo

Discovering Knowledge in Data: An Introduction to Data Mining, 2nd Edition by Daniel T. Larose

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 9Neural Networks

  1. 9.1 Input and Output Encoding
  2. 9.2 Neural Networks for Estimation and Prediction
  3. 9.3 Simple Example of a Neural Network
  4. 9.4 Sigmoid Activation Function
  5. 9.5 Back-Propagation
  6. 9.6 Termination Criteria
  7. 9.7 Learning Rate
  8. 9.8 Momentum Term
  9. 9.9 Sensitivity Analysis
  10. 9.10 Application of Neural Network Modeling
    1. The R Zone
    2. References
    3. Exercises
    4. Hands-On Analysis

The inspiration for neural networks was the recognition that complex learning systems in animal brains consisted of closely interconnected sets of neurons. Although a particular neuron may be relatively simple in structure, dense networks of interconnected neurons could perform complex learning tasks such as classification and pattern recognition. The human brain, for example, contains approximately 1011 neurons, each connected on average to 10,000 other neurons, making a total of 1,000,000,000,000,000 = 1015 synaptic connections. Artificial neural networks (hereafter, neural networks) represent an attempt at a very basic level to imitate the type of nonlinear learning that occurs in the networks of neurons found in nature.

As shown in Figure 9.1, a real neuron uses dendrites to gather inputs from other neurons and combines the input information, generating a nonlinear response (“firing”) when some threshold is reached, which it sends to other neurons using the axon. Figure 9.1 also shows an artificial neuron model used in most neural networks. The inputs (xi) are collected from upstream neurons (or the ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required