Skip to content

Project: Advanced Transformers #3

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jinmang2 wants to merge 15 commits into
base: master
Choose a base branch
from
Open

Project: Advanced Transformers #3

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
d7a7058
prepare project efficient-transformers
jinmang2 Apr 12, 2022
61911b2
make init and readme file
jinmang2 Apr 12, 2022
09747ff
add sinusoidal positional embedding (#12)
jinmang2 Apr 13, 2022
9ad2ebd
add alibi (#4)
jinmang2 Apr 13, 2022
da47ab9
add axial positional embedding (#7)
jinmang2 Apr 13, 2022
0ecddce
add rotary embedding (#5)
jinmang2 Apr 13, 2022
8af8703
prepare modules
jinmang2 Apr 13, 2022
99ccadb
remove unused function (#5)
jinmang2 Apr 14, 2022
df83694
rename korean_transformers -> advanced_transformers (#3)
jinmang2 Jun 21, 2022
983c42d
delete py file (#3)
jinmang2 Jun 21, 2022
c46e62c
add gelu activation functions (#16)
jinmang2 Jun 21, 2022
435457f
add common activation functions (#16)
jinmang2 Jun 21, 2022
c7e1205
add int gelu and quant activation function (#16)
jinmang2 Jun 21, 2022
4c8022a
rename ACT2FN keys for QuantAct (#16)
jinmang2 Jun 21, 2022
73d64e0
update readme (#3)
jinmang2 Jun 21, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 0 additions & 6 deletions .ipynb_checkpoints/Untitled-checkpoint.ipynb
View file
Open in desktop

This file was deleted.

6 changes: 0 additions & 6 deletions BART/.ipynb_checkpoints/Untitled-checkpoint.ipynb
View file
Open in desktop

This file was deleted.

6 changes: 0 additions & 6 deletions BART/.ipynb_checkpoints/Untitled1-checkpoint.ipynb
View file
Open in desktop

This file was deleted.

203 changes: 0 additions & 203 deletions BART/Untitled.ipynb
View file
Open in desktop

This file was deleted.

Loading