Neural
Download as PPTX, PDF1 like450 views
The document discusses the evolution of artificial neural networks, originating from the 1950s and gaining prominence in the 1980s, with various applications including speech and face recognition. It compares the functional attributes of biological brains and traditional computers, highlighting significant differences in structure, processing, energy use, and learning capabilities. Additionally, it covers learning mechanisms in the brain, particularly Hebb's postulate and long-term potentiation as foundational principles.
Neural
- 1. INTRODUCTION TO ARTIFICIAL NEURAL NETWORKS AND LEARNING ALGORITHMS
- 2. Neural Network History • History traces back to the 50’s but became popular in the 80’s with work by Rumelhart, Hinton, and Mclelland – A General Framework for Parallel Distributed Processing in Parallel Distributed Processing: Explorations in the Microstructure of Cognition • Peaked in the 90’s. Today: – Hundreds of variants – Less a model of the actual brain than a useful tool, but still some debate • Numerous applications – Handwriting, face, speech recognition – Vehicles that drive themselves – Models of reading, sentence production, dreaming • Debate for philosophers and cognitive scientists – Can human consciousness or cognitive abilities be explained by a connectionist model or does it require the manipulation of symbols?
- 3. Comparison of Brains and Traditional Computers • 200 billion neurons, 32 trillion synapses • Element size: 10-6m • Energy use: 25W • Processing speed: 100 Hz • Parallel, Distributed • Fault Tolerant • Learns: Yes • Intelligent/Conscious: Usually • 1 billion bytes RAM but trillions of bytes on disk • Element size: 10-9 m • Energy watt: 30-90W (CPU) • Processing speed: 109 Hz • Serial, Centralized • Generally not Fault Tolerant • Learns: Some • Intelligent/Conscious: Generally No
- 4. Biological Inspiration Idea : To make the computer more robust, intelligent, and learn, … Let’s model our computer software (and/or hardware) after the brain
- 7. Neurons in the Brain • Although heterogeneous, at a low level the brain is composed of neurons – A neuron receives input from other neurons (generally thousands) from its synapses – Inputs are approximately summed – When the input exceeds a threshold the neuron sends an electrical spike that travels that travels from the body, down the axon, to the next neuron(s)
- 8. Learning in the Brain • Brains learn – Altering strength between neurons – Creating/deleting connections • Hebb’s Postulate (Hebbian Learning) – When an axon of cell A is near enough to excite a cell B and repeatedly or persistently takes part in firing it, some growth process or metabolic change takes place in one or both cells such that A's efficiency, as one of the cells firing B, is increased. • Long Term Potentiation (LTP) – Cellular basis for learning and memory – LTP is the long-lasting strengthening of the connection between two nerve cells in response to stimulation – Discovered in many regions of the cortex