-
Notifications
You must be signed in to change notification settings - Fork 1
Description
我在复现的时候发现有两个依赖,一个要求tokenizers>=0.11.1,一个要求tokenizers<0.11
同时lsg-converter 0.1.9 需要 transformers>=4.36.1,而高版本transformers会出现ModuleNotFoundError: No module named 'transformers.modeling_attn_mask_utils'
ImportError: tokenizers>=0.11.1,!=0.11.3,<0.14 is required for a normal functioning of this module, but found tokenizers==0.21.1.
Try: pip install transformers -U or pip install -e '.[dev]' if you're working with git main
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
transformers 4.10.0 requires tokenizers<0.11,>=0.10.1, but you have tokenizers 0.11.1 which is incompatible.
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lsg-converter 0.1.9 requires transformers>=4.36.1, but you have transformers 4.9.0 which is incompatible.
ModuleNotFoundError: No module named 'transformers.modeling_attn_mask_utils'