Skip to content

[FEAT]: implement KV cache manager #11

New issue
New issue
Open
Open
[FEAT]: implement KV cache manager#11
Assignees
Monstertail
Labels
enhancementNew feature or requestpriority-0priority of the issue
Milestone
deft kv manager with demo
@Monstertail

Description

@Monstertail
Monstertail
opened on Jun 24, 2024

Description

some features to support:

  1. paged mem;
  2. tree-structured mem manager?. Shall we refer to the radix tree? @chiakicage

Additional Information

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestpriority-0priority of the issue

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions