Skip to content

Gracefully handle new release of lm_eval #2326

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
shaahji merged 1 commit into from
Feb 12, 2026
Merged

Gracefully handle new release of lm_eval #2326

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion olive/evaluator/lmeval_ort.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,10 +13,15 @@
import torch.nn.functional as F
from lm_eval.api.model import TemplateLM
from lm_eval.api.registry import register_model
from lm_eval.models.utils import Collator, pad_and_concat
from lm_eval.models.utils import Collator
from tqdm import tqdm
from transformers import AutoConfig, AutoTokenizer

try:
from lm_eval.models.utils_hf import pad_and_concat # pylint: disable=ungrouped-imports
except ImportError:
from lm_eval.models.utils import pad_and_concat

from olive.common.onnx_io import get_io_config, get_io_dtypes, get_kv_info
from olive.common.utils import cleanup_memory

Expand Down
Loading