Project benchmark

EuroEval European languages · Test split · zero-shot

EuroEval · 4 configurations with published scores. Review each metric and its test conditions separately.

Report identity & conditions

Data as of2026-10-28· Report published—. See individual records for run dates and test conditions.

Leaderboard updated2026-10-27T10:35:11+01:00

Mean rank scores cover the European generative datasets; lower is better. Overall and language-specific scores are separate. Missing scores are not zero.
Test and validation splits, and few-shot and zero-shot prompts, have separate pages. Thinking modes and model types remain part of each run’s identity; matching names do not merge configurations.
The ± value is the half-width of a 95% bootstrap confidence interval. Charts sort by point estimate, but small differences with overlapping intervals do not establish superiority.
Hugging Face models are linked only when the official URL exactly matches the catalog identifier. Short names, API prefixes and thinking modes do not establish an exact version.
Model metadata, European values and hallucination rates are outside this page’s ranking metrics. This leaderboard does not measure general ability across all tasks or languages.
The EuroEval results repository and framework use the MIT License, Copyright © Dan Saattrup Smart and Alexandra Instituttet A/S. Full terms: /licenses/euroeval.txt.
Leaderboard updated: 2026-10-27 10:35:11 CET. This is not a model release date or an individual test date.
This page covers Test split with zero-shot prompts. Model types remain attached to individual records. Per-run test dates, framework versions and a common sample count are not stated and are not inferred.

Left metricRight metric

Compare metrics within the same report. Each chart explains its direction and scope.
Error bars show 95% confidence intervals.See the details for full values and run conditions.

Croatian mean rank score

Mean rank score for Croatian; lower is better. ± is the half-width of a 95% bootstrap confidence interval. Scores are not ranked across different datasets.: showing 1 of 1 records with values. See details for configurations and dates.

Chart data · 1 entries

Name	Rank score
swiss-ai/Apertus-v1.1-1.5B (zero-shot)	4.16 ± 0.01 (95% CI)

Danish mean rank score

Mean rank score for Danish; lower is better. ± is the half-width of a 95% bootstrap confidence interval. Scores are not ranked across different datasets.: showing 3 of 3 records with values. See details for configurations and dates.

Chart data · 3 entries

Name	Rank score
TrustLLMeu/trustllm-v2-8b-sft-8k@2aadff8653393e41abf583222164e279461a619f (zero-shot)	3.48 ± 0.02 (95% CI)
TrustLLMeu/trustllm-v2-8b-sft@f442f651172c1a97143738fc30c3a6342d1e8660 (zero-shot)	3.52 ± 0.03 (95% CI)
TrustLLMeu/trustllm-v2-8b-sft-mixb2-exp@f33c260efa853437a55d780ce5b910944b1395f6 (zero-shot)	3.54 ± 0.02 (95% CI)

Full results & model versions

4 / 40configurations have published scores in this scope. Scored configurations are listed; missing values remain “Not provided.” Different run configurations of the same model are listed separately.

TrustLLMeu/trustllm-v2-8b-sft@f442f651172c1a97143738fc30c3a6342d1e8660 (zero-shot)

Model reported by the benchmark

Test split · zero-shot · Instruction-tuned

Mean European-language rank score: Not provided
Danish mean rank score: 3.52 ± 0.03（95% CI）排名分
Dutch mean rank score: 3.27 ± 0.11（95% CI）排名分
English mean rank score: 3.16 ± 0.01（95% CI）排名分

More metrics

Albanian mean rank score: Not provided
Belarusian mean rank score: Not provided
Bosnian mean rank score: Not provided
Bulgarian mean rank score: Not provided
Catalan mean rank score: Not provided
Croatian mean rank score: Not provided
Czech mean rank score: Not provided
Estonian mean rank score: Not provided
Faroese mean rank score: 4.21 ± 0.02（95% CI）排名分
Finnish mean rank score: Not provided
French mean rank score: Not provided
German mean rank score: 3.53 ± 0.11（95% CI）排名分
Greek mean rank score: Not provided
Hungarian mean rank score: Not provided
Icelandic mean rank score: 3.7 ± 0.02（95% CI）排名分
Italian mean rank score: Not provided
Latvian mean rank score: Not provided
Lithuanian mean rank score: Not provided
Luxembourgish mean rank score: Not provided
Norwegian mean rank score: 3.38 ± 0.05（95% CI）排名分
Polish mean rank score: Not provided
Portuguese mean rank score: Not provided
Romanian mean rank score: Not provided
Serbian mean rank score: Not provided
Slovak mean rank score: Not provided
Slovene mean rank score: Not provided
Spanish mean rank score: Not provided
Swedish mean rank score: 3.29 ± 0.09（95% CI）排名分
Ukrainian mean rank score: Not provided

TrustLLMeu/trustllm-v2-8b-sft-8k@2aadff8653393e41abf583222164e279461a619f (zero-shot)

Model reported by the benchmark

Test split · zero-shot · Instruction-tuned

Mean European-language rank score: Not provided
Danish mean rank score: 3.48 ± 0.02（95% CI）排名分
Dutch mean rank score: 3.23 ± 0.11（95% CI）排名分
English mean rank score: 3.37 ± 0.02（95% CI）排名分

More metrics

Albanian mean rank score: Not provided
Belarusian mean rank score: Not provided
Bosnian mean rank score: Not provided
Bulgarian mean rank score: Not provided
Catalan mean rank score: Not provided
Croatian mean rank score: Not provided
Czech mean rank score: Not provided
Estonian mean rank score: Not provided
Faroese mean rank score: 4.27 ± 0.02（95% CI）排名分
Finnish mean rank score: Not provided
French mean rank score: Not provided
German mean rank score: 3.58 ± 0.11（95% CI）排名分
Greek mean rank score: Not provided
Hungarian mean rank score: Not provided
Icelandic mean rank score: 3.67 ± 0.02（95% CI）排名分
Italian mean rank score: Not provided
Latvian mean rank score: Not provided
Lithuanian mean rank score: Not provided
Luxembourgish mean rank score: Not provided
Norwegian mean rank score: 3.44 ± 0.05（95% CI）排名分
Polish mean rank score: Not provided
Portuguese mean rank score: Not provided
Romanian mean rank score: Not provided
Serbian mean rank score: Not provided
Slovak mean rank score: Not provided
Slovene mean rank score: Not provided
Spanish mean rank score: Not provided
Swedish mean rank score: 3.3 ± 0.1（95% CI）排名分
Ukrainian mean rank score: Not provided

TrustLLMeu/trustllm-v2-8b-sft-mixb2-exp@f33c260efa853437a55d780ce5b910944b1395f6 (zero-shot)

Model reported by the benchmark

Test split · zero-shot · Instruction-tuned

Mean European-language rank score: Not provided
Danish mean rank score: 3.54 ± 0.02（95% CI）排名分
Dutch mean rank score: 3.26 ± 0.09（95% CI）排名分
English mean rank score: 3.15 ± 0.01（95% CI）排名分

More metrics

Albanian mean rank score: Not provided
Belarusian mean rank score: Not provided
Bosnian mean rank score: Not provided
Bulgarian mean rank score: Not provided
Catalan mean rank score: Not provided
Croatian mean rank score: Not provided
Czech mean rank score: Not provided
Estonian mean rank score: Not provided
Faroese mean rank score: 4.09 ± 0.03（95% CI）排名分
Finnish mean rank score: Not provided
French mean rank score: Not provided
German mean rank score: 3.5 ± 0.15（95% CI）排名分
Greek mean rank score: Not provided
Hungarian mean rank score: Not provided
Icelandic mean rank score: 3.73 ± 0.02（95% CI）排名分
Italian mean rank score: Not provided
Latvian mean rank score: Not provided
Lithuanian mean rank score: Not provided
Luxembourgish mean rank score: Not provided
Norwegian mean rank score: 3.39 ± 0.03（95% CI）排名分
Polish mean rank score: Not provided
Portuguese mean rank score: Not provided
Romanian mean rank score: Not provided
Serbian mean rank score: Not provided
Slovak mean rank score: Not provided
Slovene mean rank score: Not provided
Spanish mean rank score: Not provided
Swedish mean rank score: 3.29 ± 0.11（95% CI）排名分
Ukrainian mean rank score: Not provided

swiss-ai/Apertus-v1.1-1.5B (zero-shot)

Model reported by the benchmark

Test split · zero-shot · Base generative

Mean European-language rank score: Not provided
Croatian mean rank score: 4.16 ± 0.01（95% CI）排名分

More metrics

Albanian mean rank score: Not provided
Belarusian mean rank score: Not provided
Bosnian mean rank score: Not provided
Bulgarian mean rank score: Not provided
Catalan mean rank score: Not provided
Czech mean rank score: Not provided
Danish mean rank score: Not provided
Dutch mean rank score: Not provided
English mean rank score: Not provided
Estonian mean rank score: Not provided
Faroese mean rank score: Not provided
Finnish mean rank score: Not provided
French mean rank score: Not provided
German mean rank score: Not provided
Greek mean rank score: Not provided
Hungarian mean rank score: Not provided
Icelandic mean rank score: Not provided
Italian mean rank score: Not provided
Latvian mean rank score: Not provided
Lithuanian mean rank score: Not provided
Luxembourgish mean rank score: Not provided
Norwegian mean rank score: Not provided
Polish mean rank score: Not provided
Portuguese mean rank score: Not provided
Romanian mean rank score: Not provided
Serbian mean rank score: Not provided
Slovak mean rank score: Not provided
Slovene mean rank score: Not provided
Spanish mean rank score: Not provided
Swedish mean rank score: Not provided
Ukrainian mean rank score: Not provided