Token keep ratio setting

[King4819]

Hi, I want to ask that is there any specific reason for the token keep ratio setting ?

[1, 1, 1, 0.7, 0.7, 0.7, 0.7^2, 0.7^2, 0.7^2, 0.7^3, 0.7^3, 0.7^3] for DeiT 12 layers

Is it related to prune FLOPs ratio, such as keep ratio 0.7 will get approximately prune FLOPs ratio of 30%

Thanks !!!