Squeeze‐and‐Excitation Networks,
Hu+, '17
Agenda
概要
手法
実験/結果
概要
チャネル間の相互依存性を明示的に加えることでネットワークの表現力を上げる構造の
提案
Squeeze、Excitationの2つの機構を追加
既存の手法に追加するだけでよい
パラメタ数の増加は微量
ImageNetでSoTA
手法
Squeeze‐and‐Excitation Block(see Fig2,3)
F : transformation=Conv.層
F : sqeeze=Global average poolingで1×1×Cへ
F : Excitation=bottleneck構造(パラメタrでくびれ率を決める)
ここでチャネル間の関係性を考慮したweightを算出
: Uの各チャネルにF で算出したスカラ値s をかける
tr
sq
ex
X
~
ex c
Squeeze‐and‐Excitation Block
Squeeze‐and‐Excitation Block
実験結果1
SE構造を導入しても処理速度はほぼ変わらない
実験結果2

More Related Content

PPT
確率プロット
PDF
Deeplearning4.4 takmin
PDF
バイアス付きMMSE-STSA推定器の理論解析およびミュージカルノイズフリー雑音抑圧への拡張
PPTX
Graph Refinement based Tree Extraction using Mean-Field Networks and Graph Ne...
PDF
ICML2013読み会: Distributed training of Large-scale Logistic models
PPTX
ディープボルツマンマシン入門〜後半〜
PDF
Chapter 8 ボルツマンマシン - 深層学習本読み会
PDF
Prml5 6
確率プロット
Deeplearning4.4 takmin
バイアス付きMMSE-STSA推定器の理論解析およびミュージカルノイズフリー雑音抑圧への拡張
Graph Refinement based Tree Extraction using Mean-Field Networks and Graph Ne...
ICML2013読み会: Distributed training of Large-scale Logistic models
ディープボルツマンマシン入門〜後半〜
Chapter 8 ボルツマンマシン - 深層学習本読み会
Prml5 6

More from shima o (20)

PDF
[読会]Causal transfer random forest combining logged data and randomized expe...
PDF
[読会]P qk means-_ billion-scale clustering for product-quantized codes
PDF
[読会]Long tail learning via logit adjustment
PDF
[読会]A critical review of lasso and its derivatives for variable selection und...
PDF
[読会]Themis decentralized and trustless ad platform with reporting integrity
PDF
[読会]Logistic regression models for aggregated data
PDF
Introduction of introduction_to_group_theory
PDF
Dynamic filters in graph convolutional network
PDF
Nmp for quantum_chemistry
PDF
Dl study g_learning_to_remember_rare_events
PDF
連続最適化勉強会
PDF
ReviewNet_161122
PDF
finite time analysis of the multiarmed bandit problem
PDF
normalized online learning
PDF
logistic regression in rare events data
PDF
Joint optimization of bid and budget allocation in sponsored search
PDF
Towards a robust modeling of temporal interest change patterns for behavioral...
PDF
Real time bidding algorithms for performance-based display ad allocation
PDF
Fingind the right consumer - optimizing for conversion in display advertising...
PDF
Real time bid optimization with smooth budget delivery in online advertising
[読会]Causal transfer random forest combining logged data and randomized expe...
[読会]P qk means-_ billion-scale clustering for product-quantized codes
[読会]Long tail learning via logit adjustment
[読会]A critical review of lasso and its derivatives for variable selection und...
[読会]Themis decentralized and trustless ad platform with reporting integrity
[読会]Logistic regression models for aggregated data
Introduction of introduction_to_group_theory
Dynamic filters in graph convolutional network
Nmp for quantum_chemistry
Dl study g_learning_to_remember_rare_events
連続最適化勉強会
ReviewNet_161122
finite time analysis of the multiarmed bandit problem
normalized online learning
logistic regression in rare events data
Joint optimization of bid and budget allocation in sponsored search
Towards a robust modeling of temporal interest change patterns for behavioral...
Real time bidding algorithms for performance-based display ad allocation
Fingind the right consumer - optimizing for conversion in display advertising...
Real time bid optimization with smooth budget delivery in online advertising
Ad