Rotary Encoding learning

usage

python setup.py build_ext --inplace

import torch
import rope
q = torch.randn(8,1,64).cuda() # NHD layout
q = rope.ops.rotary_pos_encoding(q)

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
cmake		cmake
csrc		csrc
rope		rope
.gitignore		.gitignore
CMakeLists.txt		CMakeLists.txt
README.md		README.md
setup.py		setup.py
test.ipynb		test.ipynb