Scribd
Upload
6 views15 pages

Hopfield Neural Networks

Hopfield Neural Networks, invented by John Hopfield in 1982, function as content-addressable memory systems that can store and recover patterns similar to human memory. They exhibit robustness by maintaining memory recall despite neuron loss and guarantee convergence to stable patterns over time. The document discusses their properties, applications, mathematical modeling, and limitations.

Uploaded by

crazythings571
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
6 views15 pages

Hopfield Neural Networks

Hopfield Neural Networks, invented by John Hopfield in 1982, function as content-addressable memory systems that can store and recover patterns similar to human memory. They exhibit robustness by maintaining memory recall despite neuron loss and guarantee convergence to stable patterns over time. The document discusses their properties, applications, mathematical modeling, and limitations.

Uploaded by

crazythings571
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 15

Hopfield Neural Networks

Introduction to Hopfield networks


Properties
• Is able to store certain patterns in a similar fashion as human brain
• Given partial information, the full pattern can be recovered
• Robustness
■ during an average lifetime many neurons will die but we do not suffer a catastrophic loss of individual
memories (by the time we die we may have lost 20 percent of our original neurons).
• Guarantee of convergence
■ We are guaranteed that the pattern will settle down after a long enough time to some fixed pattern.
■ In the language of memory recall, if we start the network off with a pattern of firing which
approximates one of the "stable firing patterns" (memories) it will "under its own steam" end up in the
nearby well in the energy surface thereby recalling the original perfect memory.

3
Hopfield network
1. Invented by John Hopfield in 1982.
2. Content-addressable memory with binary threshold nodes (-1,1 or 0,1)
3. wij=wji, wii=0
Introduction to Hopfield networks
Major Applications
Mathematical modeling
Mathematical modeling
Weight updation
• Assumptions:
• The network has N units (nodes)
• The weight from node i to node j is ωij
• ωij = ωji
• Each node has a threshold / bias value associated with it, bi
• We have M known patterns pi = (pi1,…,piN), i=1..M, each of which has N
elements

9
Learning through simple example
Learning through simple example
Learning through simple example
Flow chart of overall process
Shortcomings
Limitations

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy