I put inner_product_layer and  LabelSpecificAdd together,but it gets worse result. 

Hi,thanks for your work. Did you ever try to put it together?  I think put it together shouldn't make it worse. But , when I use it to train lenet(dataset:mnist) , it actually  get worse result.