Ceci n’est pas un canard - Machine Learning and Generative Adversarial Networks
0 likes142 views
The document discusses generative adversarial networks (GANs) and their application in machine learning, particularly in generating images and data. It highlights techniques such as convolutional neural networks (CNNs) for data normalization and explores various use cases, including stock market predictions and generating training data. The presentation concludes with a defense mechanism against GANs and invites questions from the audience.
![IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6,
2020 / © 2020 IBM Corporation
Convolutional Neural Networks (CNNs)
9
k = np.array([[0,1,0],
[1,1,1],
[0,1,0]])
newim = ndimage.convolve(
im, k,
mode='constant’,
cval=0.0)](https://image.slidesharecdn.com/20200806-thursdaysmatter-cecinestpasuncanard-200809104547/85/Ceci-n-est-pas-un-canard-Machine-Learning-and-Generative-Adversarial-Networks-9-320.jpg)
Ceci n’est pas un canard - Machine Learning and Generative Adversarial Networks
- 1. Ceci N'est Pas Un Canard – Machine Learning and Generative Adversarial Networks Matt Hamilton Developer Advocate Thursday’s Matter August 06, 2020
- 2. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation 2
- 3. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Can I train a computer to draw a duck? 3
- 4. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Generative Adversarial Networks (GANs) 4
- 5. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Generative Adversarial Networks (GANs) 5 • White • Male • 40s • Black long sleeved shirt • Blue trousers • Mask over eyes • Short, grey hair
- 6. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Generative Adversarial Networks (GANs) 6 • White • Male • 40s • Black long sleeved shirt • Blue trousers • Mask over eyes • Short, grey hair
- 7. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Generative Adversarial Networks (GANs) 7 ✓ ✕
- 8. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Convolutional Neural Networks (CNNs) 8 https://en.wikipedia.org/wiki/Convolutional_neural_network#/media/File:Typical_cnn.png
- 9. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Convolutional Neural Networks (CNNs) 9 k = np.array([[0,1,0], [1,1,1], [0,1,0]]) newim = ndimage.convolve( im, k, mode='constant’, cval=0.0)
- 10. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Ducks! 10
- 11. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation From out of the noise… 11 Epoch 24 Epoch 100 Epoch 250 Epoch 300
- 12. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Learning instability 12 Unstable Lower learning rate
- 13. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Learning 13
- 14. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Modern art? 14 • Has learned the basic features • Not bad considering we had such varied input
- 15. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Ceci n'est pas un Matt 15 • iOS has built in image recognition and clustering. • Has grouped all the images of me already
- 16. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Initial attempts 16
- 17. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation OpenCV 17 OpenCV's application areas include: • 2D and 3D feature toolkits • Egomotion estimation • Facial recognition system • Gesture recognition • Human–computer interaction (HCI) • Mobile robotics • Motion understanding • Object identification • Segmentation and recognition • Stereopsis stereo vision: depth perception • Structure from motion (SFM) • Motion tracking • Augmented reality
- 18. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Normalizing the input 18 Original Normalized
- 19. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation 19
- 20. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Other uses of GANs 20 – Predicting stock market data • Generator generates ‘fake’ data • Discriminator learns to tell it from real data – Generating additional training data for other algorithms • Make me more dogs!
- 21. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Super-scaling video 21
- 22. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation StyleGAN 22
- 23. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation StyleGAN 23
- 24. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation This Person Does Not Exist 24
- 25. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Defense – GANs vs GANs 25 Fawkes: http://sandlab.cs.uchicago.edu/fawkes/
- 26. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Defense – GANs vs GANs 26
- 27. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Test of Fawkes 27 Original Cloaked
- 28. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation Thank you. Questions? 28 Matt Hamilton Developer Advocate hammertoe@ibm.com @hammertoe
- 29. IBM Developer Advocate / Ceci n'est pas un canard - Machine Learning and Generative Adversarial Networks / August 6, 2020 / © 2020 IBM Corporation 29