SlideShare a Scribd company logo
GAN
Generative Adversarial Networks from scratch
For 수알못(Na)
Generative Model
Generative Model 1D example
[0, 1]
http://m.blog.naver.com/atelierjpro/22098475
8512
Generative Adversarial Nets
GAN started by Ian Goodfellow
[https://arxiv.org/abs/1406.2661]
GAN used for generating realistic data
( usually, for images )
Generative Adversarial Nets
By Ian Goodfellow ( 2014. 06 ) OpenAI
https://arxiv.org/pdf/1406.2661.pdf
경찰과 도둑 (유즈맵 아님)
GAN : How does it works?
Random NoiseInput : Random Noise
Output: Realistic Image
Discriminator
Network
GAN : How does it works?
< Traditional Training Model >
GAN : How does it works?
< GAN Training Model > MAIN IDEA : Just showing lot’s of images
Initial
Trained
GAN : How does it works?
< GAN Training Model > MAIN IDEA : Just showing lot’s of images
Generative Model 1D example
http://m.blog.naver.com/atelierjpro/22098475
8512
Generative Model 1D example
http://m.blog.naver.com/atelierjpro/22098475
8512
g = G(z) # z is uniform distribution
Generative Function
Input : Uniform distribution
Output : Real Data
Generative Model 1D example
http://m.blog.naver.com/atelierjpro/22098475
8512
g = G(z) # z is uniform distribution
Generative Function : G is neural network
Input : Uniform distribution
Output : Real Data
Not Trained Model
(yellow)
Generative Model 1D example
http://m.blog.naver.com/atelierjpro/22098475
8512
(0 || 1) = D(d) # d is data ( from gen func or real data )
Discriminator : D is neural network
Input : Data
Output : real or fake
Black is D ( input from not trained G )
Yellow is G ( not trained ) - 1
Red is input of G
Blue is Real Data
Discriminator가 잘 구분함
( G와 Real이 완전이 분리)
Generative Model 1D example
http://m.blog.naver.com/atelierjpro/22098475
8512
(0 || 1) = D(d) # d is data ( from gen func or real data )
Discriminator : D is neural network
Input : Data
Output : real or fake
Black is D ( input from not trained G )
Yellow is G ( not trained ) - 2
Red is input of G
Blue is Real Data
Discriminator가 잘 구분 못함
( G와 Real이 섞여있음)
GAN 1D test
GAN EXAMPLES
STACKGAN, Pix2Pix etc..
STACKGAN MODEL
Text to Image
( not searching from db, drawing from probability distribution )
Pix2pix
https://affinelayer.com/pixsrv/
Image to Image
CycleGAN
https://github.com/junyanz/CycleGAN
Image to Image
(Zebra는 다른 환경에서 살기 때문에 배경도 Africa처럼 보이는 것을 확인가능)
Apple’s First Paper
Learning from Simulated and Unsupervised Images through Adversarial Training
https://arxiv.org/abs/1612.07828
Image to Image
Fake to REAL
GAME THEORY 한장 요약
존 폰 노이만 (사기 캐릭)
GAN Architecture
GAN Architecture
AdamOptimizer(g_loss)
AdamOptimizer(d_loss)
loss = sigmoid_cross_entropy(D_out, labels) # D_out = ( 0 || 1)
p = sigmoid(logits)
loss =cross_entropy(logits, labels * 0.9) # training skill
d_loss = cross_entropy(logits, labels)
g_loss = cross_entropy(logits, flipped_labels
Flipped Labels: 0 -> 1 | 1 -> 0
참고보면 좋은 자료
https://www.slideshare.net/ssuser7e10e4/wasserstein-gan-i : 전 수학을 몰라욧! ( GAN 수학 )
Udacity deep learning nanodegree
https://en.wikipedia.org/wiki/Generative_model ( Thanks WIKI )

More Related Content

PPTX
Generative Adversarial Networks (GAN)
PDF
Generative Adversarial Networks
PPTX
A (Very) Gentle Introduction to Generative Adversarial Networks (a.k.a GANs)
PDF
Introduction to Generative Adversarial Networks (GANs)
PDF
Generative adversarial networks
PDF
Generative Adversarial Networks (GANs) - Ian Goodfellow, OpenAI
PDF
Image-to-Image Translation with Conditional Adversarial Nets (UPC Reading Group)
PPTX
Diffusion models beat gans on image synthesis
Generative Adversarial Networks (GAN)
Generative Adversarial Networks
A (Very) Gentle Introduction to Generative Adversarial Networks (a.k.a GANs)
Introduction to Generative Adversarial Networks (GANs)
Generative adversarial networks
Generative Adversarial Networks (GANs) - Ian Goodfellow, OpenAI
Image-to-Image Translation with Conditional Adversarial Nets (UPC Reading Group)
Diffusion models beat gans on image synthesis

What's hot (20)

PPTX
Generative Adversarial Networks (GANs)
PDF
Generative Adversarial Networks and Their Applications
PDF
GANs and Applications
PDF
1시간만에 GAN(Generative Adversarial Network) 완전 정복하기
PDF
Photo-realistic Single Image Super-resolution using a Generative Adversarial ...
PPTX
A friendly introduction to GANs
PDF
Generative Adversarial Networks and Their Medical Imaging Applications
PDF
Introduction To Generative Adversarial Networks GANs
PDF
Single Image Super Resolution Overview
PDF
GAN - Theory and Applications
PDF
A Short Introduction to Generative Adversarial Networks
PDF
Finding connections among images using CycleGAN
PDF
Neural networks and deep learning
PDF
Evolution of the StyleGAN family
PDF
Generative adversarial networks
PPTX
CNN Tutorial
PPTX
GANs Presentation.pptx
PPTX
Autoencoders in Deep Learning
PDF
Deep Learning for Computer Vision: Generative models and adversarial training...
PDF
Unsupervised learning represenation with DCGAN
Generative Adversarial Networks (GANs)
Generative Adversarial Networks and Their Applications
GANs and Applications
1시간만에 GAN(Generative Adversarial Network) 완전 정복하기
Photo-realistic Single Image Super-resolution using a Generative Adversarial ...
A friendly introduction to GANs
Generative Adversarial Networks and Their Medical Imaging Applications
Introduction To Generative Adversarial Networks GANs
Single Image Super Resolution Overview
GAN - Theory and Applications
A Short Introduction to Generative Adversarial Networks
Finding connections among images using CycleGAN
Neural networks and deep learning
Evolution of the StyleGAN family
Generative adversarial networks
CNN Tutorial
GANs Presentation.pptx
Autoencoders in Deep Learning
Deep Learning for Computer Vision: Generative models and adversarial training...
Unsupervised learning represenation with DCGAN
Ad

Similar to Basic Generative Adversarial Networks (20)

PDF
Gan 발표자료
PPTX
AutoEncoder&GAN Introduction
PDF
Introduction to GAN
PDF
[PR12] intro. to gans jaejun yoo
PDF
Variants of GANs - Jaejun Yoo
PPTX
Generative Adversarial Networks and Their Applications in Medical Imaging
PDF
PDF
Deep Generative Models II (DLAI D10L1 2017 UPC Deep Learning for Artificial I...
PPTX
iT Cafe - Generative Adversarial Network(GAN)
PPTX
GAN_SANTHOSH KUMAR_Architecture_in_network
PDF
Generative adversarial networks
PPTX
gan-190318135433 (1).pptx
PDF
그림 그리는 AI
PDF
InfoGAN and Generative Adversarial Networks
PDF
PDF
Generative Adversarial Networks GAN - Santiago Pascual - UPC Barcelona 2018
PPT
GNA 13552928 deep learning for GAN a.ppt
DOCX
Generative Adversarial Networks for machine learning and data scienece.docx
PPTX
Generative Adversarial Network (GAN)
PDF
Exploring Generative AI with GAN Models
Gan 발표자료
AutoEncoder&GAN Introduction
Introduction to GAN
[PR12] intro. to gans jaejun yoo
Variants of GANs - Jaejun Yoo
Generative Adversarial Networks and Their Applications in Medical Imaging
Deep Generative Models II (DLAI D10L1 2017 UPC Deep Learning for Artificial I...
iT Cafe - Generative Adversarial Network(GAN)
GAN_SANTHOSH KUMAR_Architecture_in_network
Generative adversarial networks
gan-190318135433 (1).pptx
그림 그리는 AI
InfoGAN and Generative Adversarial Networks
Generative Adversarial Networks GAN - Santiago Pascual - UPC Barcelona 2018
GNA 13552928 deep learning for GAN a.ppt
Generative Adversarial Networks for machine learning and data scienece.docx
Generative Adversarial Network (GAN)
Exploring Generative AI with GAN Models
Ad

More from Dong Heon Cho (20)

PDF
Forward-Forward Algorithm
PDF
What is Texture.pdf
PDF
PDF
Neural Radiance Field
PPTX
2020 > Self supervised learning
PDF
All about that pooling
PPTX
Background elimination review
PDF
Transparent Latent GAN
PPTX
Image matting atoc
PPTX
Multi object Deep reinforcement learning
PPTX
Multi agent reinforcement learning for sequential social dilemmas
PPTX
Multi agent System
PPTX
Hybrid reward architecture
PDF
Use Jupyter notebook guide in 5 minutes
PPTX
AlexNet and so on...
PDF
Deep Learning AtoC with Image Perspective
PDF
LOL win prediction
PDF
How can we train with few data
PDF
Domain adaptation gan
PPTX
Dense sparse-dense training for dnn and Other Models
Forward-Forward Algorithm
What is Texture.pdf
Neural Radiance Field
2020 > Self supervised learning
All about that pooling
Background elimination review
Transparent Latent GAN
Image matting atoc
Multi object Deep reinforcement learning
Multi agent reinforcement learning for sequential social dilemmas
Multi agent System
Hybrid reward architecture
Use Jupyter notebook guide in 5 minutes
AlexNet and so on...
Deep Learning AtoC with Image Perspective
LOL win prediction
How can we train with few data
Domain adaptation gan
Dense sparse-dense training for dnn and Other Models

Recently uploaded (20)

PPT
Chapter 2 METAL FORMINGhhhhhhhjjjjmmmmmmmmm
PPTX
Data_Analytics_and_PowerBI_Presentation.pptx
PPTX
Supervised vs unsupervised machine learning algorithms
PDF
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
PPTX
Business Ppt On Nestle.pptx huunnnhhgfvu
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
PPT
Reliability_Chapter_ presentation 1221.5784
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
PPTX
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
PPTX
Introduction to Knowledge Engineering Part 1
PPTX
Global journeys: estimating international migration
PDF
Introduction to Business Data Analytics.
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PPTX
Introduction-to-Cloud-ComputingFinal.pptx
PPTX
Moving the Public Sector (Government) to a Digital Adoption
PPTX
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
PPTX
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
PDF
Mega Projects Data Mega Projects Data
PPTX
CEE 2 REPORT G7.pptxbdbshjdgsgjgsjfiuhsd
Chapter 2 METAL FORMINGhhhhhhhjjjjmmmmmmmmm
Data_Analytics_and_PowerBI_Presentation.pptx
Supervised vs unsupervised machine learning algorithms
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
Business Ppt On Nestle.pptx huunnnhhgfvu
Acceptance and paychological effects of mandatory extra coach I classes.pptx
Reliability_Chapter_ presentation 1221.5784
IBA_Chapter_11_Slides_Final_Accessible.pptx
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
Introduction to Knowledge Engineering Part 1
Global journeys: estimating international migration
Introduction to Business Data Analytics.
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
Introduction-to-Cloud-ComputingFinal.pptx
Moving the Public Sector (Government) to a Digital Adoption
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
Mega Projects Data Mega Projects Data
CEE 2 REPORT G7.pptxbdbshjdgsgjgsjfiuhsd

Basic Generative Adversarial Networks