Skip to content

[FEAT]: implement KV cache manager #11

@Monstertail

Description

@Monstertail

Description

some features to support:

  1. paged mem;
  2. tree-structured mem manager?. Shall we refer to the radix tree? @chiakicage

Additional Information

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestpriority-0priority of the issue

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions