Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Updated mshadow submodule #6681

Merged
merged 1 commit into from
Jun 13, 2017
Merged

Updated mshadow submodule #6681

merged 1 commit into from
Jun 13, 2017

Conversation

arikpoz
Copy link
Contributor

@arikpoz arikpoz commented Jun 13, 2017

This will finally fix the bug in LRN layer, see dmlc/mshadow#257

@arikpoz arikpoz mentioned this pull request Jun 13, 2017
Merged
@arikpoz
Copy link
Contributor Author

arikpoz commented Jun 13, 2017

Note, the effect of this fix can be seen in the output of the compare_layers script I recently added #6680 when running on the bvlc_googlenet network.

See right most columns in following outputs.

Before fix:

***** Network Outputs *********************************************************************************************************************
INFO:root:  CAFFE                                     MXNET                                     Type      Mean(diff)   Max(diff)  Note
INFO:root:  data                                      data                                      output       0.00000     0.00000   
INFO:root:  conv1/7x7_s2                              conv1_relu_7x7_output                     output       0.00001     0.00171   
INFO:root:  pool1/3x3_s2                              pool1_3x3_s2_output                       output       0.00002     0.00171   
INFO:root:  pool1/norm1                               pool1_norm1_output                        output       0.46372   110.11273   
INFO:root:  conv2/3x3_reduce                          conv2_relu_3x3_reduce_output              output       1.57429    81.37708   
INFO:root:  conv2/3x3                                 conv2_relu_3x3_output                     output       0.98427   102.84904   
INFO:root:  conv2/norm2                               conv2_norm2_output                        output       0.76054    79.32774   
INFO:root:  pool2/3x3_s2                              pool2_3x3_s2_output                       output       1.93457    70.62540   
INFO:root:  inception_3a/1x1                          inception_3a_relu_1x1_output              output       2.36920    92.84397   
INFO:root:  inception_3a/3x3_reduce                   inception_3a_relu_3x3_reduce_output       output       1.74815    44.56551   
INFO:root:  inception_3a/3x3                          inception_3a_relu_3x3_output              output       1.69199    50.14515   
INFO:root:  inception_3a/5x5_reduce                   inception_3a_relu_5x5_reduce_output       output       3.55452    76.16289   
INFO:root:  inception_3a/5x5                          inception_3a_relu_5x5_output              output       2.76134   102.35570   
INFO:root:  inception_3a/pool                         inception_3a_pool_output                  output       2.79884    60.41054   
INFO:root:  inception_3a/pool_proj                    inception_3a_relu_pool_proj_output        output       1.56058    28.01734   
INFO:root:  inception_3a/output                       inception_3a_output_output                output       1.97854   102.35570   
INFO:root:  inception_3b/1x1                          inception_3b_relu_1x1_output              output       0.76349    83.87667   
INFO:root:  inception_3b/3x3_reduce                   inception_3b_relu_3x3_reduce_output       output       1.73628    90.21630   
INFO:root:  inception_3b/3x3                          inception_3b_relu_3x3_output              output       0.42795    45.80695   
INFO:root:  inception_3b/5x5_reduce                   inception_3b_relu_5x5_reduce_output       output       2.13446    47.07189   
INFO:root:  inception_3b/5x5                          inception_3b_relu_5x5_output              output       0.46316    37.99985   
INFO:root:  inception_3b/pool                         inception_3b_pool_output                  output       3.93022    99.17555   
INFO:root:  inception_3b/pool_proj                    inception_3b_relu_pool_proj_output        output       0.64087    34.12976   
INFO:root:  inception_3b/output                       inception_3b_output_output                output       0.55286    83.87667   
INFO:root:  pool3/3x3_s2                              pool3_3x3_s2_output                       output       1.64343    80.79987   
INFO:root:  inception_4a/1x1                          inception_4a_relu_1x1_output              output       0.62219    43.19994   
INFO:root:  inception_4a/3x3_reduce                   inception_4a_relu_3x3_reduce_output       output       2.10323    45.07881   
INFO:root:  inception_4a/3x3                          inception_4a_relu_3x3_output              output       0.44296    40.90309   
INFO:root:  inception_4a/5x5_reduce                   inception_4a_relu_5x5_reduce_output       output       2.52499    40.98933   
INFO:root:  inception_4a/5x5                          inception_4a_relu_5x5_output              output       0.55781    21.55870   
INFO:root:  inception_4a/pool                         inception_4a_pool_output                  output       3.45759    80.79987   
INFO:root:  inception_4a/pool_proj                    inception_4a_relu_pool_proj_output        output       0.73236    30.70652   
INFO:root:  inception_4a/output                       inception_4a_output_output                output       0.55711    43.19994   
INFO:root:  inception_4b/1x1                          inception_4b_relu_1x1_output              output       0.95470    22.59966   
INFO:root:  inception_4b/3x3_reduce                   inception_4b_relu_3x3_reduce_output       output       0.90856    30.82187   
INFO:root:  inception_4b/3x3                          inception_4b_relu_3x3_output              output       0.58574    25.93250   
INFO:root:  inception_4b/5x5_reduce                   inception_4b_relu_5x5_reduce_output       output       1.23197    17.08347   
INFO:root:  inception_4b/5x5                          inception_4b_relu_5x5_output              output       0.62750    13.77544   
INFO:root:  inception_4b/pool                         inception_4b_pool_output                  output       1.69023    43.19994   
INFO:root:  inception_4b/pool_proj                    inception_4b_relu_pool_proj_output        output       1.03659    28.98124   
INFO:root:  inception_4b/output                       inception_4b_output_output                output       0.76262    28.98124   
INFO:root:  inception_4c/1x1                          inception_4c_relu_1x1_output              output       0.92764    29.32315   
INFO:root:  inception_4c/3x3_reduce                   inception_4c_relu_3x3_reduce_output       output       0.78318    17.43432   
INFO:root:  inception_4c/3x3                          inception_4c_relu_3x3_output              output       0.41111    15.69267   
INFO:root:  inception_4c/5x5_reduce                   inception_4c_relu_5x5_reduce_output       output       0.72633    10.58163   
INFO:root:  inception_4c/5x5                          inception_4c_relu_5x5_output              output       0.39562    10.16849   
INFO:root:  inception_4c/pool                         inception_4c_pool_output                  output       1.49089    28.98124   
INFO:root:  inception_4c/pool_proj                    inception_4c_relu_pool_proj_output        output       0.49451    15.50359   
INFO:root:  inception_4c/output                       inception_4c_output_output                output       0.54873    29.32315   
INFO:root:  inception_4d/1x1                          inception_4d_relu_1x1_output              output       0.28862    23.74649   
INFO:root:  inception_4d/3x3_reduce                   inception_4d_relu_3x3_reduce_output       output       0.48223    15.71540   
INFO:root:  inception_4d/3x3                          inception_4d_relu_3x3_output              output       0.20025    15.01653   
INFO:root:  inception_4d/5x5_reduce                   inception_4d_relu_5x5_reduce_output       output       0.56576     9.49855   
INFO:root:  inception_4d/5x5                          inception_4d_relu_5x5_output              output       0.11895     7.20841   
INFO:root:  inception_4d/pool                         inception_4d_pool_output                  output       1.10947    29.32315   
INFO:root:  inception_4d/pool_proj                    inception_4d_relu_pool_proj_output        output       0.29822    12.60340   
INFO:root:  inception_4d/output                       inception_4d_output_output                output       0.22102    23.74649   
INFO:root:  inception_4e/1x1                          inception_4e_relu_1x1_output              output       0.09393    14.50028   
INFO:root:  inception_4e/3x3_reduce                   inception_4e_relu_3x3_reduce_output       output       0.27933     9.98861   
INFO:root:  inception_4e/3x3                          inception_4e_relu_3x3_output              output       0.05261     5.85155   
INFO:root:  inception_4e/5x5_reduce                   inception_4e_relu_5x5_reduce_output       output       0.45386     7.55464   
INFO:root:  inception_4e/5x5                          inception_4e_relu_5x5_output              output       0.05763     5.48851   
INFO:root:  inception_4e/pool                         inception_4e_pool_output                  output       0.54132    23.74649   
INFO:root:  inception_4e/pool_proj                    inception_4e_relu_pool_proj_output        output       0.18000     6.79393   
INFO:root:  inception_4e/output                       inception_4e_output_output                output       0.08570    14.50028   
INFO:root:  pool4/3x3_s2                              pool4_3x3_s2_output                       output       0.20415    14.50028   
INFO:root:  inception_5a/1x1                          inception_5a_relu_1x1_output              output       0.17101     5.82104   
INFO:root:  inception_5a/3x3_reduce                   inception_5a_relu_3x3_reduce_output       output       0.24483     3.98062   
INFO:root:  inception_5a/3x3                          inception_5a_relu_3x3_output              output       0.06216     2.79512   
INFO:root:  inception_5a/5x5_reduce                   inception_5a_relu_5x5_reduce_output       output       0.31228     3.42185   
INFO:root:  inception_5a/5x5                          inception_5a_relu_5x5_output              output       0.07681     2.21374   
INFO:root:  inception_5a/pool                         inception_5a_pool_output                  output       0.46180    11.50761   
INFO:root:  inception_5a/pool_proj                    inception_5a_relu_pool_proj_output        output       0.14396     4.72373   
INFO:root:  inception_5a/output                       inception_5a_output_output                output       0.11049     5.82104   
INFO:root:  inception_5b/1x1                          inception_5b_relu_1x1_output              output       0.04564     2.07587   
INFO:root:  inception_5b/3x3_reduce                   inception_5b_relu_3x3_reduce_output       output       0.06152     1.86275   
INFO:root:  inception_5b/3x3                          inception_5b_relu_3x3_output              output       0.03832     1.26659   
INFO:root:  inception_5b/5x5_reduce                   inception_5b_relu_5x5_reduce_output       output       0.10522     2.09474   
INFO:root:  inception_5b/5x5                          inception_5b_relu_5x5_output              output       0.03710     1.26657   
INFO:root:  inception_5b/pool                         inception_5b_pool_output                  output       0.24547     5.82104   
INFO:root:  inception_5b/pool_proj                    inception_5b_relu_pool_proj_output        output       0.04506     2.99514   
INFO:root:  inception_5b/output                       inception_5b_output_output                output       0.04176     2.99514   
INFO:root:  pool5/7x7_s1                              pool5_drop_7x7_s1_output                  output       0.02977     0.48131   
INFO:root:  loss3/classifier                          loss3_classifier_output                   output       0.06567     0.28562   
INFO:root:  prob                                      prob_output                               output       0.00003     0.00989

After fix:

***** Network Outputs *********************************************************************************************************************
INFO:root:  CAFFE                                     MXNET                                     Type      Mean(diff)   Max(diff)  Note
INFO:root:  data                                      data                                      output       0.00000     0.00000   
INFO:root:  conv1/7x7_s2                              conv1_relu_7x7_output                     output       0.00000     0.00061   
INFO:root:  pool1/3x3_s2                              pool1_3x3_s2_output                       output       0.00001     0.00061   
INFO:root:  pool1/norm1                               pool1_norm1_output                        output       0.00001     0.00095   
INFO:root:  conv2/3x3_reduce                          conv2_relu_3x3_reduce_output              output       0.00001     0.00111   
INFO:root:  conv2/3x3                                 conv2_relu_3x3_output                     output       0.00001     0.00101   
INFO:root:  conv2/norm2                               conv2_norm2_output                        output       0.00001     0.00099   
INFO:root:  pool2/3x3_s2                              pool2_3x3_s2_output                       output       0.00001     0.00083   
INFO:root:  inception_3a/1x1                          inception_3a_relu_1x1_output              output       0.00002     0.00066   
INFO:root:  inception_3a/3x3_reduce                   inception_3a_relu_3x3_reduce_output       output       0.00001     0.00050   
INFO:root:  inception_3a/3x3                          inception_3a_relu_3x3_output              output       0.00001     0.00057   
INFO:root:  inception_3a/5x5_reduce                   inception_3a_relu_5x5_reduce_output       output       0.00002     0.00058   
INFO:root:  inception_3a/5x5                          inception_3a_relu_5x5_output              output       0.00001     0.00076   
INFO:root:  inception_3a/pool                         inception_3a_pool_output                  output       0.00002     0.00083   
INFO:root:  inception_3a/pool_proj                    inception_3a_relu_pool_proj_output        output       0.00001     0.00036   
INFO:root:  inception_3a/output                       inception_3a_output_output                output       0.00001     0.00076   
INFO:root:  inception_3b/1x1                          inception_3b_relu_1x1_output              output       0.00001     0.00076   
INFO:root:  inception_3b/3x3_reduce                   inception_3b_relu_3x3_reduce_output       output       0.00001     0.00062   
INFO:root:  inception_3b/3x3                          inception_3b_relu_3x3_output              output       0.00000     0.00040   
INFO:root:  inception_3b/5x5_reduce                   inception_3b_relu_5x5_reduce_output       output       0.00002     0.00042   
INFO:root:  inception_3b/5x5                          inception_3b_relu_5x5_output              output       0.00000     0.00055   
INFO:root:  inception_3b/pool                         inception_3b_pool_output                  output       0.00003     0.00076   
INFO:root:  inception_3b/pool_proj                    inception_3b_relu_pool_proj_output        output       0.00001     0.00041   
INFO:root:  inception_3b/output                       inception_3b_output_output                output       0.00000     0.00076   
INFO:root:  pool3/3x3_s2                              pool3_3x3_s2_output                       output       0.00001     0.00076   
INFO:root:  inception_4a/1x1                          inception_4a_relu_1x1_output              output       0.00001     0.00055   
INFO:root:  inception_4a/3x3_reduce                   inception_4a_relu_3x3_reduce_output       output       0.00002     0.00037   
INFO:root:  inception_4a/3x3                          inception_4a_relu_3x3_output              output       0.00000     0.00034   
INFO:root:  inception_4a/5x5_reduce                   inception_4a_relu_5x5_reduce_output       output       0.00002     0.00043   
INFO:root:  inception_4a/5x5                          inception_4a_relu_5x5_output              output       0.00000     0.00022   
INFO:root:  inception_4a/pool                         inception_4a_pool_output                  output       0.00003     0.00076   
INFO:root:  inception_4a/pool_proj                    inception_4a_relu_pool_proj_output        output       0.00001     0.00031   
INFO:root:  inception_4a/output                       inception_4a_output_output                output       0.00000     0.00055   
INFO:root:  inception_4b/1x1                          inception_4b_relu_1x1_output              output       0.00001     0.00037   
INFO:root:  inception_4b/3x3_reduce                   inception_4b_relu_3x3_reduce_output       output       0.00001     0.00031   
INFO:root:  inception_4b/3x3                          inception_4b_relu_3x3_output              output       0.00001     0.00021   
INFO:root:  inception_4b/5x5_reduce                   inception_4b_relu_5x5_reduce_output       output       0.00001     0.00016   
INFO:root:  inception_4b/5x5                          inception_4b_relu_5x5_output              output       0.00001     0.00015   
INFO:root:  inception_4b/pool                         inception_4b_pool_output                  output       0.00001     0.00055   
INFO:root:  inception_4b/pool_proj                    inception_4b_relu_pool_proj_output        output       0.00001     0.00024   
INFO:root:  inception_4b/output                       inception_4b_output_output                output       0.00001     0.00037   
INFO:root:  inception_4c/1x1                          inception_4c_relu_1x1_output              output       0.00001     0.00029   
INFO:root:  inception_4c/3x3_reduce                   inception_4c_relu_3x3_reduce_output       output       0.00001     0.00017   
INFO:root:  inception_4c/3x3                          inception_4c_relu_3x3_output              output       0.00000     0.00021   
INFO:root:  inception_4c/5x5_reduce                   inception_4c_relu_5x5_reduce_output       output       0.00001     0.00018   
INFO:root:  inception_4c/5x5                          inception_4c_relu_5x5_output              output       0.00000     0.00018   
INFO:root:  inception_4c/pool                         inception_4c_pool_output                  output       0.00001     0.00037   
INFO:root:  inception_4c/pool_proj                    inception_4c_relu_pool_proj_output        output       0.00000     0.00022   
INFO:root:  inception_4c/output                       inception_4c_output_output                output       0.00000     0.00029   
INFO:root:  inception_4d/1x1                          inception_4d_relu_1x1_output              output       0.00000     0.00021   
INFO:root:  inception_4d/3x3_reduce                   inception_4d_relu_3x3_reduce_output       output       0.00000     0.00019   
INFO:root:  inception_4d/3x3                          inception_4d_relu_3x3_output              output       0.00000     0.00016   
INFO:root:  inception_4d/5x5_reduce                   inception_4d_relu_5x5_reduce_output       output       0.00001     0.00009   
INFO:root:  inception_4d/5x5                          inception_4d_relu_5x5_output              output       0.00000     0.00011   
INFO:root:  inception_4d/pool                         inception_4d_pool_output                  output       0.00001     0.00029   
INFO:root:  inception_4d/pool_proj                    inception_4d_relu_pool_proj_output        output       0.00000     0.00023   
INFO:root:  inception_4d/output                       inception_4d_output_output                output       0.00000     0.00023   
INFO:root:  inception_4e/1x1                          inception_4e_relu_1x1_output              output       0.00000     0.00013   
INFO:root:  inception_4e/3x3_reduce                   inception_4e_relu_3x3_reduce_output       output       0.00000     0.00008   
INFO:root:  inception_4e/3x3                          inception_4e_relu_3x3_output              output       0.00000     0.00007   
INFO:root:  inception_4e/5x5_reduce                   inception_4e_relu_5x5_reduce_output       output       0.00000     0.00007   
INFO:root:  inception_4e/5x5                          inception_4e_relu_5x5_output              output       0.00000     0.00006   
INFO:root:  inception_4e/pool                         inception_4e_pool_output                  output       0.00001     0.00023   
INFO:root:  inception_4e/pool_proj                    inception_4e_relu_pool_proj_output        output       0.00000     0.00013   
INFO:root:  inception_4e/output                       inception_4e_output_output                output       0.00000     0.00013   
INFO:root:  pool4/3x3_s2                              pool4_3x3_s2_output                       output       0.00000     0.00013   
INFO:root:  inception_5a/1x1                          inception_5a_relu_1x1_output              output       0.00000     0.00009   
INFO:root:  inception_5a/3x3_reduce                   inception_5a_relu_3x3_reduce_output       output       0.00000     0.00006   
INFO:root:  inception_5a/3x3                          inception_5a_relu_3x3_output              output       0.00000     0.00004   
INFO:root:  inception_5a/5x5_reduce                   inception_5a_relu_5x5_reduce_output       output       0.00000     0.00004   
INFO:root:  inception_5a/5x5                          inception_5a_relu_5x5_output              output       0.00000     0.00002   
INFO:root:  inception_5a/pool                         inception_5a_pool_output                  output       0.00001     0.00013   
INFO:root:  inception_5a/pool_proj                    inception_5a_relu_pool_proj_output        output       0.00000     0.00007   
INFO:root:  inception_5a/output                       inception_5a_output_output                output       0.00000     0.00009   
INFO:root:  inception_5b/1x1                          inception_5b_relu_1x1_output              output       0.00000     0.00004   
INFO:root:  inception_5b/3x3_reduce                   inception_5b_relu_3x3_reduce_output       output       0.00000     0.00003   
INFO:root:  inception_5b/3x3                          inception_5b_relu_3x3_output              output       0.00000     0.00002   
INFO:root:  inception_5b/5x5_reduce                   inception_5b_relu_5x5_reduce_output       output       0.00000     0.00003   
INFO:root:  inception_5b/5x5                          inception_5b_relu_5x5_output              output       0.00000     0.00001   
INFO:root:  inception_5b/pool                         inception_5b_pool_output                  output       0.00000     0.00009   
INFO:root:  inception_5b/pool_proj                    inception_5b_relu_pool_proj_output        output       0.00000     0.00003   
INFO:root:  inception_5b/output                       inception_5b_output_output                output       0.00000     0.00004   
INFO:root:  pool5/7x7_s1                              pool5_drop_7x7_s1_output                  output       0.00000     0.00001   
INFO:root:  loss3/classifier                          loss3_classifier_output                   output       0.00000     0.00000   
INFO:root:  prob                                      prob_output                               output       0.00000     0.00000

@arikpoz
Copy link
Contributor Author

arikpoz commented Jun 13, 2017

Not sure why continuous-integration/jenkins/pr-head failed..

@piiswrong piiswrong merged commit c43c901 into apache:master Jun 13, 2017
yijiezh pushed a commit to yijiezh/mxnet that referenced this pull request Jun 15, 2017
@arikpoz @yijiezh
updated version used of mshadow submodule (apache#6681)
bb85dba
Guneet-Dhillon pushed a commit to Guneet-Dhillon/mxnet that referenced this pull request Sep 13, 2017
@arikpoz @piiswrong
updated version used of mshadow submodule (apache#6681)
c7f19b7
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@arikpoz @piiswrong