Future Updates and document Inquiry

[ryan910707]

Hello,

Thank you for sharing your work. I found the RDMA-based optimizations in your paper very interesting and would love to explore the implementation further. I am interested in running the project and understanding its details.

Could you let me know if this repository will receive future updates and provide related documents? Also, what is the current status of this repository?

Looking forward to your response!

Best regards,
yi syuan

[cctry]

Hi,

I am working with other authors to complete it. To run this, you can install the RDMA library at https://github.com/rainj-me/rdma-transport. Then you can run KVDirect/decode_worker.py and KVDirect/prefill_worker.py to launch the works.

Note that this requires the IB network, and we did not test this on other hardware. The open-sourced RDMA library have some minor bugs. Please let me know if you encounter any and I will ask them to release a newer version.

[ryan910707]

Hi,

Thank you for your reply.
I'm also very interested in the push/pull mode you mentioned in the paper. I would like to ask how you implemented these two communication methods, and which part of the code I can refer to. Also, is there a benchmark for comparison with push/pull mode?

Thank you!