decreasing the amount of ram used on gpu

[omerbrandis]

Hello,

I'm trying to decrease the amount of ram used on the gpu for inference.

i've used the supplied cfgs.py that uses resnet101,
it uses up about 6G during training,
then i've frozen the graph -> created a 190MB frozen file,
i then use this frozen file from CPP , it consumes about 800MB on gpu for inference.

i then tried using the cfgs_res50.py, this lead to 3.5G of ram using on gpu during training,
a 115MB frozen graph file, and ram consumed on gpu during inference (from cpp) has not decreased significantly ( about 720M).

can you suggest a method to decrease the ram consumption on gpu ?
( maybe some other property of the network ? )

thanks,
Omer.