Pytorch implementation of GDPolyak experiments from preprint [1].
Experiments Notebook: experiments.ipynb
$ git clone https://github.com/damek/GDPolyak.py.git
$ python -m pip install -e .[1]: D. Davis, D. Drusvyatskiy, and L. Jiang. Gradient descent with adaptive stepsize converges (nearly) linearly under fourth-order growth (2024). https://arxiv.org/abs/2409.19791