Deep Learning A-Z™: Artificial Neural Networks (ANN) - How do Neural Networks Learn
1 like1,381 views
The document discusses cost functions used in neural networks. It defines the mean squared error cost function as C = 1/2(ŷ-y)2, where ŷ is the predicted output and y is the actual output. It explains that the total cost C is calculated as the sum of the individual costs over all training examples, and that adjusting the weights w1, w2, wm serves to minimize this cost during training.
Related topics:1 of 13
More Related Content
What's hot (20)
Ad
Similar to Deep Learning A-Z™: Artificial Neural Networks (ANN) - How do Neural Networks Learn (20)
Ad
More from Kirill Eremenko (16)
Recently uploaded (20)
Deep Learning A-Z™: Artificial Neural Networks (ANN) - How do Neural Networks Learn
- 3. © SuperDataScienceDeep Learning A-Z y Input value 1 Input value 2 Input value m X1 X2 Xm w1 w2 wm Output value y Actual value ŷ
- 4. © SuperDataScienceDeep Learning A-Z Input value 1 Input value 2 Input value m ŷ X1 X2 Xm w1 w2 wm Output value y Actual value C = ½(ŷ- y)2 ŷ y C
- 5. © SuperDataScienceDeep Learning A-Z Input value 1 Input value 2 Input value m Output value Actual value X1 X2 Xm w1 w2 wm ŷ y ŷ y C
- 6. © SuperDataScienceDeep Learning A-Z Input value 1 Input value 2 Input value m X1 X2 Xm w1 w2 wm Output value Actual value ŷ y C = ½(ŷ- y)2 ŷ y C
- 7. © SuperDataScienceDeep Learning A-Z Input value 1 Input value 2 Input value m X1 X2 Xm w1 w2 wm Output value Actual value ŷ y C = ½(ŷ- y)2 ŷ y C
- 8. © SuperDataScienceDeep Learning A-Z Input value 1 Input value 2 Input value m X1 X2 Xm w1 w2 wm Output value Actual value ŷ y C = ½(ŷ- y)2 ŷ y C
- 9. © SuperDataScienceDeep Learning A-Z Input value 1 Input value 2 Input value m X1 X2 Xm w1 w2 wm Output value Actual value ŷ y C = ½(ŷ- y)2 ŷ y C
- 10. © SuperDataScienceDeep Learning A-Z Input value 1 Input value 2 Input value m X1 X2 Xm w1 w2 wm Output value Actual value ŷ y C = ½(ŷ- y)2 ŷ y C
- 11. © SuperDataScienceDeep Learning A-Z Input value 1 Input value 2 Input value m X1 X2 Xm w1 w2 wm Output value Actual value ŷ y C = ½(ŷ- y)2 ŷ y C
- 12. © SuperDataScienceDeep Learning A-Z C = ∑ ½(ŷ- y)2 X1 X2 Xm w1 w2 wm ŷ y X1 X2 Xm w1 w2 wm ŷ y X1 X2 Xm w1 w2 wm ŷ y X1 X2 Xm w1 w2 wm ŷ y X1 X2 Xm w1 w2 wm ŷ y X1 X2 Xm w1 w2 wm ŷ y X1 X2 Xm w1 w2 wm ŷ y X1 X2 Xm w1 w2 wm ŷ y ŷ y C ŷ y ŷ y ŷ y ŷ y ŷ y ŷ y ŷ y Adjust w1, w2, w3
- 13. © SuperDataScienceDeep Learning A-Z A list of cost functions used in neural networks, alongside applications CrossValidated (2015) Link: http://stats.stackexchange.com/questions/154879/a-list-of-cost-functions- used-in-neural-networks-alongside-applications Additional Reading: