Torch implementation of MobileNet (https://arxiv.org/abs/1704.04861), implemented by Jaewoo Song.
- MobileNet uses depthwise separable convolutions. They are implemented differently in Torch.
- Only
nn
module has function namednn.SpatialDepthWiseConvolution()
. - On the other hand,
cudnn
module's functioncudnn.SpatialConvolution()
has one more parameter than its equivalent innn
. By settingnInputPlane
, the very last parameter, one can implement depthwise separable convolutions.
- It is much faster to train the
cudnn
version. Training thenn
version is really slow. - But under the circumstances without GPUs,
nn
version is the only choice.