Gradient Descent. How NN learns
Download as PPTX, PDF3 likes1,484 views
This document discusses the fundamentals of neural networks, including cost functions, gradient descent, and backpropagation. It provides links to additional resources for further understanding of machine learning concepts. The content is aimed at introducing readers to how neural networks learn and their underlying principles.
Gradient Descent. How NN learns
- 1. Gradient Descent. How NN learns by Anatolii Shkurpylo, Software Developer
- 2. www.eliftech.com ▪ Interesting intro ▪ Recap basics of Neural Network ▪ Cost Function ▪ Gradient Descent ▪ Backpropagation ▪ Links
- 4. www.eliftech.com Types of Machine Learning
- 5. www.eliftech.com Blizzard and Google betray humanity with StarCraft 2 tools
- 7. www.eliftech.com Input layer 2 hidden layers Output layer ... 28 * 28 px vector 784d
- 10. www.eliftech.com Cost Function (Loss or objective function) C =cost
- 11. www.eliftech.com Cost function by Linear regression example
- 12. www.eliftech.com Quadratic or MSE function
- 14. www.eliftech.com Cost Function (Loss or objective function)
- 15. www.eliftech.com Gradient Descent of cost function C(v1, v2)
- 16. www.eliftech.com Gradient Descent of cost function
- 21. www.eliftech.com
- 22. www.eliftech.com Links ▪ http://neuralnetworksanddeeplearning.com/index.html ▪ https://www.analyticsvidhya.com/blog/2017/01/introduction-to-reinforcement- learning-implementation/ ▪ https://deepmind.com/blog/deepmind-and-blizzard-open-starcraft-ii-ai-research- environment/ ▪ http://www.3blue1brown.com/ ▪ https://www.khanacademy.org/math/ap-calculus-ab/ab-derivative-rules/ab-chain- rule/v/chain-rule-introduction ▪ https://www.coursera.org/learn/machine-learning ▪ https://github.com/mnielsen/neural-networks-and-deep- learning/blob/master/src/network.py
- 23. www.eliftech.com Thank you for attention! Find us at eliftech.com Have a question? Contact us: info@eliftech.com