From 74e3ebbe82e977da4041e1ad0f0fdd13ead593a3 Mon Sep 17 00:00:00 2001 From: Mahmut CAVDAR <4072246+mcavdar@users.noreply.github.com> Date: Fri, 3 Oct 2025 13:29:46 +0200 Subject: [PATCH 1/2] Correct backend name from VLLM to accelerate in LightEval example --- chapters/en/chapter11/5.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/chapters/en/chapter11/5.mdx b/chapters/en/chapter11/5.mdx index 479521698..ee6139329 100644 --- a/chapters/en/chapter11/5.mdx +++ b/chapters/en/chapter11/5.mdx @@ -92,7 +92,7 @@ Example: `"mmlu|abstract_algebra|0|0"` evaluates on MMLU's abstract algebra task Let's set up an evaluation pipeline for our finetuned model. We will evaluate the model on set of sub tasks that relate to the domain of medicine. -Here's a complete example of evaluating on automatic benchmarks relevant to one specific domain using Lighteval with the VLLM backend: +Here's a complete example of evaluating on automatic benchmarks relevant to one specific domain using Lighteval with the accelerate backend: ```bash lighteval accelerate \ From 97683c99f3a2003de0cd192a6b9ba03e4db7cf87 Mon Sep 17 00:00:00 2001 From: Mahmut CAVDAR <4072246+mcavdar@users.noreply.github.com> Date: Fri, 3 Oct 2025 12:00:33 +0000 Subject: [PATCH 2/2] [ro] Correct backend name from VLLM to accelerate in LightEval example --- chapters/ro/chapter11/5.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/chapters/ro/chapter11/5.mdx b/chapters/ro/chapter11/5.mdx index 6093775dc..c17c46791 100644 --- a/chapters/ro/chapter11/5.mdx +++ b/chapters/ro/chapter11/5.mdx @@ -92,7 +92,7 @@ Exemplu: `"mmlu|abstract_algebra|0|0"` evaluează pe sarcina de algebră abstrac Să configurăm un pipeline de evaluare pentru modelul nostru ajustat fin. Vom evalua modelul pe un set de sub-sarcini care se raportează la domeniul medicinei. -Iată un exemplu complet de evaluare pe criterii de referință automate relevante pentru un domeniu specific folosind Lighteval cu backend-ul VLLM: +Iată un exemplu complet de evaluare pe criterii de referință automate relevante pentru un domeniu specific folosind Lighteval cu backend-ul accelerate: ```bash lighteval accelerate \