[notes] ImageNet Classification with Deep Convolutional Neual Network
2014-06-15 12:01
363 查看
Paper:
ImageNet Classification with Deep Convolutional Neual Network
Achievements:
The model addressed by Alex etl.
achieved top-1 and top-5 test error rate of
37.5% and
17.0% of classifying the 1.2 million high-resolution images in the
ImageNet LSVRC-2010 contest into the 1000 different classes.
Model Architecture:
model architecture plot:
contains eight learned layers five convolutional and
three fully-connected.
The kernels of the second, fourth, and fifth convolutional layers are connected only to those kernel maps in the previous layer which reside
on the same GPU. The kernels of the third convolutional layer are connected to all kernel maps in the second layer.
Response-normalization layers follow the
first and second convolutional layers.
Max-pooling layers, of the kind described in Section 3.4,
follow both response-normalization layers as well as the fifth convolutional layer. The
ReLU non-linearity is applied to the output of every convolutional and fully-connected layer.
Interesting Points:
ReLU Nonlinearity: speed-up, six times faster than an equivalent network with tanh neurons.
Overlapping Pooling: enhance accuracy and prevent overfitting, reduces the top-1 and top-5 error rates by 0.4% and 0.3%; training model with
overlapping pooling find it slightly more difficult to overfit.
Dropout:prevent overfitting, reduces complex co-adaptations of neurons, since a neuron cannot rely on the presence of particular other neurons. It is, therefore, forced to learn more robust
features that are useful in conjunction with many different random subsets of the other neurons.
ImageNet Classification with Deep Convolutional Neual Network
Achievements:
The model addressed by Alex etl.
achieved top-1 and top-5 test error rate of
37.5% and
17.0% of classifying the 1.2 million high-resolution images in the
ImageNet LSVRC-2010 contest into the 1000 different classes.
Model Architecture:
model architecture plot:
contains eight learned layers five convolutional and
three fully-connected.
The kernels of the second, fourth, and fifth convolutional layers are connected only to those kernel maps in the previous layer which reside
on the same GPU. The kernels of the third convolutional layer are connected to all kernel maps in the second layer.
Response-normalization layers follow the
first and second convolutional layers.
Max-pooling layers, of the kind described in Section 3.4,
follow both response-normalization layers as well as the fifth convolutional layer. The
ReLU non-linearity is applied to the output of every convolutional and fully-connected layer.
Interesting Points:
ReLU Nonlinearity: speed-up, six times faster than an equivalent network with tanh neurons.
Overlapping Pooling: enhance accuracy and prevent overfitting, reduces the top-1 and top-5 error rates by 0.4% and 0.3%; training model with
overlapping pooling find it slightly more difficult to overfit.
Dropout:prevent overfitting, reduces complex co-adaptations of neurons, since a neuron cannot rely on the presence of particular other neurons. It is, therefore, forced to learn more robust
features that are useful in conjunction with many different random subsets of the other neurons.
相关文章推荐
- [notes] ImageNet Classification with Deep Convolutional Neual Network
- [notes] ImageNet Classification with Deep Convolutional Neual NetworkPaper: ImageNet Classification
- 深度学习研究理解4:ImageNet Classification with Deep Convolutional Neural Network
- ImageNet classification with deep convolutional neural network
- 《ImageNet Classification with Deep Convolutional Neural Network》
- ImageNet Classification with Deep Convolutional Neural Network(转)
- ImageNet Classification with Deep Convolutional nerual network
- ImageNet Classification with Deep Convolutional Neural Network 翻译
- ImageNet Classification with Deep Convolutional Neural Network解读
- ImageNet Classification with Deep Convolutional Neural Networks
- ImageNet Classification with Deep Convolutional Neural Networks笔记(摘要版)
- ImageNet Classification with Deep Convolutional Neural Networks 论文学习
- ImageNet Classification with Deep Convolutional Neural Networks泛读总结
- ImageNet Classification with Deep Convolutional Neural Networks阅读笔记
- 2016.4.5 ImageNet Classification with Deep Convolutional Neural Networks
- 论文阅读(1)——ImageNet Classification with Deep Convolutional Neural Networks
- ImageNet Classification with Deep Convolutional Neural Networks论文笔记
- Deep Learning 读书笔记(五):ImageNet Classification with Deep Convolutional Neural Networks
- ImageNet Classification with deep convolutional neural networks
- Deep learning论文笔记一:ImageNet Classification with Deep Convolutional Neural Networks