CNN入门系列(2)——Pooling Layer
2016-12-06 10:21
141 查看
参考:cs231n
这个系列写的是我对cs231n的一些翻译和理解
————————————————————————————————————————————
It is common to periodically insert a Pooling layer in-between successive Conv layers in a ConvNet architecture. Its function is to progressively reduce the spatial size of the representation to reduce the amount of parameters and computation in the network, and hence to also control overfitting. The Pooling Layer operates independently on every depth slice of the input and resizes it spatially, using the MAX operation. The most common form is a pooling layer with filters of size 2x2 applied with a stride of 2 downsamples every depth slice in the input by 2 along both width and height, discarding 75% of the activations. Every MAX operation would in this case be taking a max over 4 numbers (little 2x2 region in some depth slice). The depth dimension remains unchanged. More generally, the pooling layer
简单来说就是,在连续的卷积层之间插入汇聚层可以有效地减少参数的数量。拿最简单的汇聚层——max pooling来说,我们将四个相邻的点合并为一个点,新产生的点的像素值是这四个点中像素值最大的点的像素值。如果移动时的步长恰好等于汇聚层的尺寸(在这里stride=2),那么一个卷积后产生的feature map的参数会降为原来的1/4,大大减小了参数的数量。
参考一张图片
来自:http://www.cnblogs.com/hellocwh/p/5564568.html
我们可以看到,经过一层层的layer后,数据已经从最初的像一张纸一样又宽又薄的样子,变成了像一支笔一样又窄又厚的样子。(depth是因为卷积核的数量增加所以增大,width和height是因为pooling所以减少)
上一张干货图:介绍两种其他的池化函数:均值池化和p范数池化
来自:[]http://blog.csdn.net/taigw/article/details/50612963]
这个系列写的是我对cs231n的一些翻译和理解
————————————————————————————————————————————
Pooling layer
先看cs231n上的描述:It is common to periodically insert a Pooling layer in-between successive Conv layers in a ConvNet architecture. Its function is to progressively reduce the spatial size of the representation to reduce the amount of parameters and computation in the network, and hence to also control overfitting. The Pooling Layer operates independently on every depth slice of the input and resizes it spatially, using the MAX operation. The most common form is a pooling layer with filters of size 2x2 applied with a stride of 2 downsamples every depth slice in the input by 2 along both width and height, discarding 75% of the activations. Every MAX operation would in this case be taking a max over 4 numbers (little 2x2 region in some depth slice). The depth dimension remains unchanged. More generally, the pooling layer
简单来说就是,在连续的卷积层之间插入汇聚层可以有效地减少参数的数量。拿最简单的汇聚层——max pooling来说,我们将四个相邻的点合并为一个点,新产生的点的像素值是这四个点中像素值最大的点的像素值。如果移动时的步长恰好等于汇聚层的尺寸(在这里stride=2),那么一个卷积后产生的feature map的参数会降为原来的1/4,大大减小了参数的数量。
参考一张图片
来自:http://www.cnblogs.com/hellocwh/p/5564568.html
我们可以看到,经过一层层的layer后,数据已经从最初的像一张纸一样又宽又薄的样子,变成了像一支笔一样又窄又厚的样子。(depth是因为卷积核的数量增加所以增大,width和height是因为pooling所以减少)
上一张干货图:介绍两种其他的池化函数:均值池化和p范数池化
来自:[]http://blog.csdn.net/taigw/article/details/50612963]
相关文章推荐
- 人脸检测及识别python实现系列(4)——卷积神经网络(CNN)入门
- Asp组件初级入门与精通系列之三
- Record Management System从入门到精通系列之一
- Asp组件中级入门与精通系列之五
- [Eclipse]GEF入门系列(序)
- [Eclipse]GEF入门系列(四、其他功能)
- [Eclipse]GEF入门系列(一、Draw2D)
- Asp组件中级入门与精通系列之六
- Struts入门文章系列(链接)及学习笔记
- Budi Kurniawan写的Struts入门系列终于看完了
- Record Management System从入门到精通系列之二
- Asp组件初级入门与精通系列之六
- Asp组件中级入门与精通系列之三
- Asp组件中级入门与精通系列之四
- Asp组件初级入门与精通系列之七
- Record Management System从入门到精通系列之三
- Asp组件初级入门与精通系列之一
- Asp组件初级入门与精通系列之五
- Asp组件中级入门与精通系列之七
- [Eclipse]GEF入门系列(三、应用实例)