SlideShare a Scribd company logo

[Dl輪読会]Censoring Representation with Adversary

Deep Learning JP, profile picture
Deep Learning JP

2016/9/2 Deep Learning JP: http://deeplearning.jp/seminar-2/

Technology
Related topics:
Deep Learning
1 of 9
Download to read offline
1
2
3
4
5
6
7
8
9
Censoring Representation with Adversary D3岩澤
書誌情報 • ICLR2016 • Harrison Edwards & Amos Storkey • エディンバラ大学 • Citation:1 • 余談：5月にアップデートされて文がだいぶ読みやすくなって る
概要 • GANで利用されているAdversarial Trainingを画像生成以外に 使う • 具体的には，表現に含まれるべきでない情報を取り出す • 含まれるべきでない例： • Fairness：黒人/白人という情報で推薦結果を変えない • Image Anonymization：画像中に含まれる住所や氏名を消したい
Fairness, Image Anonymizationの難しさ • 例えば黒人/白人に依存しない推薦結果を与えたい場合を考える • この時、特徴にある黒人/白人という特徴量を落とせば一見良さ そうだがそれでは不十分 • なぜなら、他の特徴量が黒人、白人に関する情報量を持ってる 可能性があるから • 素性が、黒人/白人に依存しないようにする必要がある
Fairness, Image Anonymizationの難しさ2 • データの価値とFairness/プライバシーは究極的に対立する • 画像から機微情報を消したい場合 • 究極的には入力に依存しない特徴量を返す関数fを使えば機微情 報は消える • がデータの価値も同時に損なわれる • データの価値とプライバシー保護のバランスをとることが大事
提案手法 • 上を最適化 • 再構築誤差とクラス分類誤差は普通の誤差なので Fairness/Privacyを説明する • 以降Sとしては2値を考える • 例：黒人か白人か、機微情報を含むか含まないか 再構築誤差 Fairness/Privacy クラス分類誤差
D(S,R)の学習: Adversarial Training
アルゴリズム全体
• 興味持った方は，結果などは論文を参照したください! • https://arxiv.org/abs/1511.05897

More Related Content

PDF
[DL輪読会]Learning What and Where to Draw (NIPS’16)
Deep Learning JP
 
PDF
[DL輪読会]最新の深層強化学習
Deep Learning JP
 
PPTX
[DL輪読会]Exploiting Cyclic Symmetry in Convolutional Neural Networks
Deep Learning JP
 
PDF
[DL輪読会]Wasserstein GAN/Towards Principled Methods for Training Generative Adv...
Deep Learning JP
 
PPTX
[DL輪読会]Understanding deep learning requires rethinking generalization
Deep Learning JP
 
PDF
[Dl輪読会]bridging the gaps between residual learning, recurrent neural networks...
Deep Learning JP
 
PDF
[DL輪読会]Unsupervised Learning of 3D Structure from Images
Deep Learning JP
 
PDF
[輪読会]Multilingual Image Description with Neural Sequence Models
Deep Learning JP
 
[DL輪読会]Learning What and Where to Draw (NIPS’16)
Deep Learning JP
 
[DL輪読会]最新の深層強化学習
Deep Learning JP
 
[DL輪読会]Exploiting Cyclic Symmetry in Convolutional Neural Networks
Deep Learning JP
 
[DL輪読会]Wasserstein GAN/Towards Principled Methods for Training Generative Adv...
Deep Learning JP
 
[DL輪読会]Understanding deep learning requires rethinking generalization
Deep Learning JP
 
[Dl輪読会]bridging the gaps between residual learning, recurrent neural networks...
Deep Learning JP
 
[DL輪読会]Unsupervised Learning of 3D Structure from Images
Deep Learning JP
 
[輪読会]Multilingual Image Description with Neural Sequence Models
Deep Learning JP
 

Viewers also liked (16)

PPTX
[DL輪読会]Learning convolutional neural networks for graphs
Deep Learning JP
 
PPTX
[DL輪読会]Let there be color
Deep Learning JP
 
PPTX
[DL輪読会]TREE-STRUCTURED VARIATIONAL AUTOENCODER
Deep Learning JP
 
PDF
[Dl輪読会]dl hacks輪読
Deep Learning JP
 
PDF
[Dl輪読会]bayesian dark knowledge
Deep Learning JP
 
PDF
Iclr2016 vaeまとめ
Deep Learning JP
 
PDF
[DL輪読会]Combining Fully Convolutional and Recurrent Neural Networks for 3D Bio...
Deep Learning JP
 
PPTX
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
Deep Learning JP
 
PDF
[DL輪読会]Regularization with stochastic transformations and perturbations for d...
Deep Learning JP
 
PDF
[DL輪読会]QUASI-RECURRENT NEURAL NETWORKS
Deep Learning JP
 
PPTX
[DL輪読会]Unsupervised Cross-Domain Image Generation
Deep Learning JP
 
PPTX
[DL輪読会]Wavenet a generative model for raw audio
Deep Learning JP
 
PDF
[DL輪読会]StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generat...
Deep Learning JP
 
PDF
[Dl輪読会]introduction of reinforcement learning
Deep Learning JP
 
PDF
[DL輪読会]SeqGan Sequence Generative Adversarial Nets with Policy Gradient
Deep Learning JP
 
PDF
FinalReport
Katy Lee
 
[DL輪読会]Learning convolutional neural networks for graphs
Deep Learning JP
 
[DL輪読会]Let there be color
Deep Learning JP
 
[DL輪読会]TREE-STRUCTURED VARIATIONAL AUTOENCODER
Deep Learning JP
 
[Dl輪読会]dl hacks輪読
Deep Learning JP
 
[Dl輪読会]bayesian dark knowledge
Deep Learning JP
 
Iclr2016 vaeまとめ
Deep Learning JP
 
[DL輪読会]Combining Fully Convolutional and Recurrent Neural Networks for 3D Bio...
Deep Learning JP
 
[DL輪読会]Image-to-Image Translation with Conditional Adversarial Networks
Deep Learning JP
 
[DL輪読会]Regularization with stochastic transformations and perturbations for d...
Deep Learning JP
 
[DL輪読会]QUASI-RECURRENT NEURAL NETWORKS
Deep Learning JP
 
[DL輪読会]Unsupervised Cross-Domain Image Generation
Deep Learning JP
 
[DL輪読会]Wavenet a generative model for raw audio
Deep Learning JP
 
[DL輪読会]StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generat...
Deep Learning JP
 
[Dl輪読会]introduction of reinforcement learning
Deep Learning JP
 
[DL輪読会]SeqGan Sequence Generative Adversarial Nets with Policy Gradient
Deep Learning JP
 
FinalReport
Katy Lee
 
Ad

More from Deep Learning JP (20)

PPTX
【DL輪読会】AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Planners
Deep Learning JP
 
PPTX
【DL輪読会】事前学習用データセットについて
Deep Learning JP
 
PPTX
【DL輪読会】 "Learning to render novel views from wide-baseline stereo pairs." CVP...
Deep Learning JP
 
PPTX
【DL輪読会】Zero-Shot Dual-Lens Super-Resolution
Deep Learning JP
 
PPTX
【DL輪読会】BloombergGPT: A Large Language Model for Finance arxiv
Deep Learning JP
 
PPTX
【DL輪読会】マルチモーダル LLM
Deep Learning JP
 
PDF
【 DL輪読会】ToolLLM: Facilitating Large Language Models to Master 16000+ Real-wo...
Deep Learning JP
 
PPTX
【DL輪読会】AnyLoc: Towards Universal Visual Place Recognition
Deep Learning JP
 
PDF
【DL輪読会】Can Neural Network Memorization Be Localized?
Deep Learning JP
 
PPTX
【DL輪読会】Hopfield network　関連研究について
Deep Learning JP
 
PPTX
【DL輪読会】SimPer: Simple self-supervised learning of periodic targets( ICLR 2023 )
Deep Learning JP
 
PDF
【DL輪読会】RLCD: Reinforcement Learning from Contrast Distillation for Language M...
Deep Learning JP
 
PDF
【DL輪読会】"Secrets of RLHF in Large Language Models Part I: PPO"
Deep Learning JP
 
PPTX
【DL輪読会】"Language Instructed Reinforcement Learning for Human-AI Coordination "
Deep Learning JP
 
PPTX
【DL輪読会】Llama 2: Open Foundation and Fine-Tuned Chat Models
Deep Learning JP
 
PDF
【DL輪読会】"Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware"
Deep Learning JP
 
PPTX
【DL輪読会】Parameter is Not All You Need:Starting from Non-Parametric Networks fo...
Deep Learning JP
 
PDF
【DL輪読会】Drag Your GAN: Interactive Point-based Manipulation on the Generative ...
Deep Learning JP
 
PDF
【DL輪読会】Self-Supervised Learning from Images with a Joint-Embedding Predictive...
Deep Learning JP
 
PPTX
【DL輪読会】Towards Understanding Ensemble, Knowledge Distillation and Self-Distil...
Deep Learning JP
 
【DL輪読会】AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Planners
Deep Learning JP
 
【DL輪読会】事前学習用データセットについて
Deep Learning JP
 
【DL輪読会】 "Learning to render novel views from wide-baseline stereo pairs." CVP...
Deep Learning JP
 
【DL輪読会】Zero-Shot Dual-Lens Super-Resolution
Deep Learning JP
 
【DL輪読会】BloombergGPT: A Large Language Model for Finance arxiv
Deep Learning JP
 
【DL輪読会】マルチモーダル LLM
Deep Learning JP
 
【 DL輪読会】ToolLLM: Facilitating Large Language Models to Master 16000+ Real-wo...
Deep Learning JP
 
【DL輪読会】AnyLoc: Towards Universal Visual Place Recognition
Deep Learning JP
 
【DL輪読会】Can Neural Network Memorization Be Localized?
Deep Learning JP
 
【DL輪読会】Hopfield network　関連研究について
Deep Learning JP
 
【DL輪読会】SimPer: Simple self-supervised learning of periodic targets( ICLR 2023 )
Deep Learning JP
 
【DL輪読会】RLCD: Reinforcement Learning from Contrast Distillation for Language M...
Deep Learning JP
 
【DL輪読会】"Secrets of RLHF in Large Language Models Part I: PPO"
Deep Learning JP
 
【DL輪読会】"Language Instructed Reinforcement Learning for Human-AI Coordination "
Deep Learning JP
 
【DL輪読会】Llama 2: Open Foundation and Fine-Tuned Chat Models
Deep Learning JP
 
【DL輪読会】"Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware"
Deep Learning JP
 
【DL輪読会】Parameter is Not All You Need:Starting from Non-Parametric Networks fo...
Deep Learning JP
 
【DL輪読会】Drag Your GAN: Interactive Point-based Manipulation on the Generative ...
Deep Learning JP
 
【DL輪読会】Self-Supervised Learning from Images with a Joint-Embedding Predictive...
Deep Learning JP
 
【DL輪読会】Towards Understanding Ensemble, Knowledge Distillation and Self-Distil...
Deep Learning JP
 
Ad

[Dl輪読会]Censoring Representation with Adversary