Skip to content

[FEAT]: implement real speculative decoding(SD) and multi-step reasoning(MS) #12

@Monstertail

Description

@Monstertail

Description

We simulate SD and MS in deft paper v2. I think we should support real SD and MS for rebuttal. @chiakicage @tlin-taolin what do you think?

Additional Information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestpriority-1priority of the issue

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions