Skip to content

Unfreeze transformer_lens version #10

@taufeeque9

Description

@taufeeque9

The rotary embedding issue is transformer_lens breaks the TinyStories codebook models. The issue was introduced in version 1.8.0 and so we have frozen transformer_lens' version at 1.7.0. Bump the version and update the mod_model_classes.py file once the issue gets resolved.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions