Bfloat zero#1

Open

mali-git wants to merge 16 commits intomasterfrom

Commits on Sep 7, 2022

Allreduce bfloat in fp32 in zero
Samuel Weinbach
committed
Tied grad reduce for bfloat
Samuel Weinbach
committed

Commits on Sep 20, 2022

Commits on Oct 24, 2022

Commits on Oct 25, 2022

Commits on Oct 26, 2022

Commits on Nov 8, 2022

Commits on Nov 29, 2022