imagenet experiments

[JunMa11]

Dear Authors,

Thanks for sharing the amazing work!

Do you have plans to release the code for imagenet experiments?

[sukjunhwang]

Thank you for your interest in our work! We don't have concrete plans for it, but everything needed for ImageNet is in https://github.com/state-spaces/s4, and you can simply use Hydra as a drop-in replacement for ViT :)

[JunMa11]

Hi @sukjunhwang ,

Thanks for your swift response. could you please share the parameter settings of d_state, d_conv, and expand in ViT experiments?

[sukjunhwang]

It's the default configuration used in https://github.com/goombalab/hydra/blob/main/hydra/modules/hydra.py.
If you were to use the S4 repo, you should add a line in the config, which I just made a PR right now.