Scribd
Upload
75 views1 page

Chapter 1. Introduction: Cybernetics (Connectionism + Neural Networks)

This chapter introduces the topic of artificial neural networks and their historical development. It describes three waves of neural network research from the 1940s to present day, as measured by frequencies of related terms in Google Books. The first wave started in the 1940s with early biological learning theories. The second wave began in the 1980s focusing on connectionist approaches and backpropagation. The current third wave of deep learning started around 2006.

Uploaded by

Stefanescu Alexandru
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
75 views1 page

Chapter 1. Introduction: Cybernetics (Connectionism + Neural Networks)

This chapter introduces the topic of artificial neural networks and their historical development. It describes three waves of neural network research from the 1940s to present day, as measured by frequencies of related terms in Google Books. The first wave started in the 1940s with early biological learning theories. The second wave began in the 1980s focusing on connectionist approaches and backpropagation. The current third wave of deep learning started around 2006.

Uploaded by

Stefanescu Alexandru
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 1

CHAPTER 1.

INTRODUCTION

0.000250
Frequency of Word or Phrase

cybernetics
0.000200
(connectionism + neural networks)
0.000150

0.000100

0.000050

0.000000
1940 1950 1960 1970 1980 1990 2000
Year

Figure 1.7: The figure shows two of the three historical waves of artificial neural nets
research, as measured by the frequency of the phrases “cybernetics” and “connectionism” or
“neural networks” according to Google Books (the third wave is too recent to appear). The
first wave started with cybernetics in the 1940s–1960s, with the development of theories
of biological learning (McCulloch and Pitts, 1943; Hebb, 1949) and implementations of
the first models such as the perceptron (Rosenblatt, 1958) allowing the training of a single
neuron. The second wave started with the connectionist approach of the 1980–1995 period,
with back-propagation (Rumelhart et al., 1986a) to train a neural network with one or two
hidden layers. The current and third wave, deep learning, started around 2006 (Hinton
et al., 2006; Bengio et al., 2007; Ranzato et al., 2007a), and is just now appearing in book
form as of 2016. The other two waves similarly appeared in book form much later than
the corresponding scientific activity occurred.

14

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy