Search results

Replace jax.scipy.stats.norm.cdf with jax.scipy.special.ndtr for improved efficiency

Status: Open.

#200 In google-research/vmoe;

· SaFE-APIOpt opened on Apr 21, 2025

i came here for the code of SPARSE UPCYCLING: TRAINING MIXTURE-OF-EXPERTS FROM DENSE CHECKPOINTS

Status: Open.

#188 In google-research/vmoe;

· sorobedio opened on Oct 16, 2024

Shape mismatch running <code>vmoe_b16_imagenet21k_randaug_strong_ft_ilsvrc2012</code> checkpoint

Status: Open.

#182 In google-research/vmoe;

· seliayeu opened on Aug 15, 2024

Here are some questions about soft MoE

Status: Open.

#176 In google-research/vmoe;

· t5862755 opened on Jun 27, 2024

How to use other checkpoints to evaluate the model's accuracy on different datasets, including utilizing gs://vmoe_checkpoints/eee_s32_last2_ilsvrc2012_ft_cifar100 to test datasets other than CIFAR-100?

Status: Open.

#160 In google-research/vmoe;

· guoyan223 opened on Jan 27, 2024

Loading Saved Checkpoint After Finetuning

Status: Open.

#148 In google-research/vmoe;

· nowazrabbani opened on Oct 9, 2023

module 'vmoe.checkpoints.partitioned' has no attribute 'Mesh'

Status: Open.

#137 In google-research/vmoe;

· nathanlmz opened on Jul 27, 2023

Question: have you tried patch-expert assignment level for BPR?

Status: Open.

#49 In google-research/vmoe;

· kaikai23 opened on Oct 29, 2022

How do I use the checkpoints from Google Cloud?

Status: Open.

#3 In google-research/vmoe;

· BDHU opened on Jan 21, 2022