SlideShare a Scribd company logo
Kaggle Amazon
contest
Dmitry Pranchuk
Kaggle Amazon Contest
Kaggle Amazon Contest
Labels Distribution
Co-occurence Matrixes
Weather Labels Most Common Labels
Rare Labels
Target Metric
Dataset
JPG (RGB) and TIFF (GeoTIFF = RGB + near infrared)

~40k train set

~60k test set (40k + 20k)
First Model
Keras

3 conv + 2 fc layers

Adam (lr = 1e-3, 1e-4, 1e-5)

sigmoid

binary loss

0.909 on LB
Augmentation
original 256x256
random crop 224x224
random rotate by 0, 90, 180 or 270 degree
random horizontal or/and vertical flip
Thresholds Optimization
Finetuning
Ensemble
1) 5-layers CNN (0.925)

2) VGG-16 (0.927)

3) VGG-19 (0.928)

4) ResNet-50 x 3 (0.925-0.927)

5) ResNet-50 (sigmoid for non-weather + softmax for weather) (0.923)

6) ResNet-50 (weather) + ResNet-50 (non-weather) (0.925)

7) LightGBM on the ResNet-50 features (0.920)

4-threshold voting

0.93042 on Public, 0.92915 on Private
Public/Private Correlation
Leaderboard Shake-up
Panorama
Haze Removal Using Dark Channel Prior
He, K., Sun, J., Tang, X.: Single Image Haze Removal Using Dark Channel Prior

IEEE Trans. Pattern Anal. Mach. Intell. (2011)
Lessons Learned
1) Manually check your submits

2) Save experiments results

3) Try not to start too late

4) Optimize your code

More Related Content

PPTX
A framework for practical fast matrix multiplication (BLIS retreat)
TXT
Pavement design method
PDF
Bode plot
PPTX
Esmaeilzade sampling
PDF
Timing requirements
PPTX
Sandia Fast Matmul
PPT
Bode plot
PPTX
A framework for practical fast matrix multiplication (BLIS retreat)
Pavement design method
Bode plot
Esmaeilzade sampling
Timing requirements
Sandia Fast Matmul
Bode plot

What's hot (20)

PDF
射頻電子實驗手冊 [實驗6] 阻抗匹配模擬
PDF
A Fast Implicit Gaussian Curvature Filter
PDF
電路學 - [第五章] 一階RC/RL電路
PPTX
Wk 12 fr bode plot nyquist may 9 2016
PDF
Stiffness matrix method for beam , examples ce525
PPT
Ee2365 nol part 2
PPT
NNet Final Project
PDF
Bode Plots
PDF
Análisis de-porticos-por-el-método-de-matriz-de-rigidez
DOCX
Principles of Communication (Intro to Oscillators)
PDF
PDF
Bode plot
PDF
Ece4510 notes09
PDF
電路學 - [第三章] 網路定理
PDF
射頻電子 - [第四章] 散射參數網路
PDF
[DL輪読会]近年のエネルギーベースモデルの進展
PDF
射頻電子 - [第六章] 低雜訊放大器設計
PPTX
Unit 4.pptx cs
PDF
Ece4510 notes10
PDF
[DL輪読会]近年のオフライン強化学習のまとめ —Offline Reinforcement Learning: Tutorial, Review, an...
射頻電子實驗手冊 [實驗6] 阻抗匹配模擬
A Fast Implicit Gaussian Curvature Filter
電路學 - [第五章] 一階RC/RL電路
Wk 12 fr bode plot nyquist may 9 2016
Stiffness matrix method for beam , examples ce525
Ee2365 nol part 2
NNet Final Project
Bode Plots
Análisis de-porticos-por-el-método-de-matriz-de-rigidez
Principles of Communication (Intro to Oscillators)
Bode plot
Ece4510 notes09
電路學 - [第三章] 網路定理
射頻電子 - [第四章] 散射參數網路
[DL輪読会]近年のエネルギーベースモデルの進展
射頻電子 - [第六章] 低雜訊放大器設計
Unit 4.pptx cs
Ece4510 notes10
[DL輪読会]近年のオフライン強化学習のまとめ —Offline Reinforcement Learning: Tutorial, Review, an...
Ad

Similar to Kaggle Amazon Contest (11)

PDF
CIFAR-10 for DAWNBench: Wide ResNets, Mixup Augmentation and "Super Convergen...
PDF
Boosting the Performance of Nested Spatial Mapping with Unequal Modulation in...
PDF
Mask-RCNN for Instance Segmentation
PPTX
Unsupervised selection of mother wavelets and parameter optimization
PDF
Pseudo Random Number Generators
PPTX
Gradient descent optimizer
PDF
OPTIMIZED RATE ALLOCATION OF HYPERSPECTRAL IMAGES IN COMPRESSED DOMAIN USING ...
PDF
GlobalLogic Machine Learning Webinar “Advanced Statistical Methods for Linear...
PDF
Presentation for the 21th EUROSTAR Users Conference - June 2013
PDF
Compact and safely: static DSL on Kotlin
PPTX
ImageNet classification with deep convolutional neural networks(2012)
CIFAR-10 for DAWNBench: Wide ResNets, Mixup Augmentation and "Super Convergen...
Boosting the Performance of Nested Spatial Mapping with Unequal Modulation in...
Mask-RCNN for Instance Segmentation
Unsupervised selection of mother wavelets and parameter optimization
Pseudo Random Number Generators
Gradient descent optimizer
OPTIMIZED RATE ALLOCATION OF HYPERSPECTRAL IMAGES IN COMPRESSED DOMAIN USING ...
GlobalLogic Machine Learning Webinar “Advanced Statistical Methods for Linear...
Presentation for the 21th EUROSTAR Users Conference - June 2013
Compact and safely: static DSL on Kotlin
ImageNet classification with deep convolutional neural networks(2012)
Ad

Recently uploaded (20)

PDF
Clinical guidelines as a resource for EBP(1).pdf
PDF
Lecture1 pattern recognition............
PDF
Fluorescence-microscope_Botany_detailed content
PPTX
SAP 2 completion done . PRESENTATION.pptx
PPTX
Introduction-to-Cloud-ComputingFinal.pptx
PDF
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
PPTX
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
PPT
Reliability_Chapter_ presentation 1221.5784
PDF
.pdf is not working space design for the following data for the following dat...
PPTX
Supervised vs unsupervised machine learning algorithms
PPTX
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
PDF
annual-report-2024-2025 original latest.
PPTX
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
PDF
Introduction to the R Programming Language
PPTX
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
PDF
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
PPTX
oil_refinery_comprehensive_20250804084928 (1).pptx
PPTX
STERILIZATION AND DISINFECTION-1.ppthhhbx
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
Clinical guidelines as a resource for EBP(1).pdf
Lecture1 pattern recognition............
Fluorescence-microscope_Botany_detailed content
SAP 2 completion done . PRESENTATION.pptx
Introduction-to-Cloud-ComputingFinal.pptx
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
Reliability_Chapter_ presentation 1221.5784
.pdf is not working space design for the following data for the following dat...
Supervised vs unsupervised machine learning algorithms
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
annual-report-2024-2025 original latest.
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
Introduction to the R Programming Language
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
oil_refinery_comprehensive_20250804084928 (1).pptx
STERILIZATION AND DISINFECTION-1.ppthhhbx
IBA_Chapter_11_Slides_Final_Accessible.pptx

Kaggle Amazon Contest