Search results

Support simulation of MoE model and Expert Parallelism

Status: Open.

#75 In microsoft/vidur;

· Horacehxw opened on Oct 23, 2025

In a multi-round conversation, what does the trace of the n-th round represent？

Status: Open.

#73 In microsoft/vidur;

· JiinnW opened on Oct 20, 2025

Potential Issue Regarding Profiling

Status: Open.

#72 In microsoft/vidur;

· cspr2333 opened on Oct 20, 2025

Support for speculative decoding?

Status: Open.

#69 In microsoft/vidur;

· MaoZiming opened on Aug 6, 2025

Questions on CPU Overheads & KV Cache Aware Routing

Status: Open.

#63 In microsoft/vidur;

· ItamarGefen opened on Jul 24, 2025

Current vidur backend support

Status: Open.

#60 In microsoft/vidur;

· nba556677go opened on Jul 4, 2025

Support Dynamic Replica Adjustment at Runtime Without Service Interruption

Status: Open.

#55 In microsoft/vidur;

· mayuqing111 opened on Jun 20, 2025

Regarding the calculation of the duration in the profiling phase

Status: Open.

#53 In microsoft/vidur;

· doudouxx opened on Apr 12, 2025

Adapting Vidur to vLLM and Profiling CPU Overhead

Status: Open.

#51 In microsoft/vidur;

· duanzhaol opened on Mar 14, 2025

ImportError: cannot import name 'pos_encoding_ops' from 'sarathi' (/app/software1/vidur/sarathi/__init__.py)

Status: Open.

#50 In microsoft/vidur;

· tianhao909 opened on Feb 14, 2025

hello; how to fix this error; errno: 97 - Address family not supported by protocol

Status: Open.

#49 In microsoft/vidur;

· tianhao909 opened on Feb 14, 2025

Regarding the judgment condition for TFFTViolationLowMemoryCase

Status: Open.

#47 In microsoft/vidur;

· PshySimon opened on Dec 16, 2024