Mediocre Performance for Testing Speed

[Connor323]

Hi Jacob! Thanks for your impressive work. I ran your code pruning VGG16 by removing 60% filters. However, the runtime for testing only speeds up from 0.64sec/image to 0.39sec/image, which is about 1.6x faster. I'm not sure if the way I monitor the runtime is correct. My current approach is setting the starting point before the forward pass in the test function (above the line 144) and setting the end point after the prediction (below the line 145). Also, I'm currently using CPU for training and testing; so I'm not sure if it has some adverse effect with respect to GPU.

Thanks!