Search results

Error when using DDP

Status: Open.

#49 In lessw2020/Ranger21;

· smartbarbarian opened on May 8, 2023

learning rate scheduler

Status: Open.

#48 In lessw2020/Ranger21;

· shyhyawJou opened on Jan 8, 2023

Recommended settings for transformers?

Status: Open.

#47 In lessw2020/Ranger21;

· OhadRubin opened on Sep 17, 2022

Nice name of your project)

Status: Open.

#45 In lessw2020/Ranger21;

· Ranger21 opened on Jun 1, 2022

What it the best hyper-parameter setting?

Status: Open.

#42 In lessw2020/Ranger21;

· NoOneUST opened on May 2, 2022

Gradient normalization lowers the maximum learning rate that can converge.

Status: Open.

#41 In lessw2020/Ranger21;

· Handagot opened on Apr 21, 2022

Not support pytorch _1.3.1

Status: Open.

#39 In lessw2020/Ranger21;

· huangnengCSU opened on Mar 19, 2022

Require an documentation

Status: Open.

#38 In lessw2020/Ranger21;

· huangnengCSU opened on Dec 28, 2021

decouple the lr scheduler and optimizer?

Status: Open.

#36 In lessw2020/Ranger21;

· hiyyg opened on Nov 1, 2021

sample usage in fastai

Status: Open.

#35 In lessw2020/Ranger21;

· nikky4D opened on Sep 27, 2021

RuntimeError: hit nan for variance_normalized

Status: Open.

#30 In lessw2020/Ranger21;

· gcp opened on Aug 31, 2021

About gradient normalization

Status: Open.

#29 In lessw2020/Ranger21;

· julightzhong10 opened on Aug 17, 2021