unreasonable gpu performance of pytorch

[GiggleLiu]

It does not even scale from intermediate scale to large scale.

1. make sure the data are not reused (the same data to same function may not invoke reevaluation).
2. make sure data are syncronized after evaluation.