EuroEval European languages · Validation split · zero-shot

Report identity & conditions

Data as of2026-10-18· Report published—. See individual records for run dates and test conditions.

Leaderboard updated2026-10-10T14:26:33+01:00

• Mean rank scores cover the European generative datasets; lower is better. Overall and language-specific scores are separate. Missing scores are not zero.
• Test and validation splits, and few-shot and zero-shot prompts, have separate pages. Thinking modes and model types remain part of each run’s identity; matching names do not merge configurations.
• The ± value is the half-width of a 95% bootstrap confidence interval. Charts sort by point estimate, but small differences with overlapping intervals do not establish superiority.
• Hugging Face models are linked only when the official URL exactly matches the catalog identifier. Short names, API prefixes and thinking modes do not establish an exact version.
• Model metadata, European values and hallucination rates are outside this page’s ranking metrics. This leaderboard does not measure general ability across all tasks or languages.
• The EuroEval results repository and framework use the MIT License, Copyright © Dan Saattrup Smart and Alexandra Instituttet A/S. Full terms: /licenses/euroeval.txt.
• Leaderboard updated: 2026-10-10 14:26:33 CET. This is not a model release date or an individual test date.
• This page covers Validation split with zero-shot prompts. Model types remain attached to individual records. Per-run test dates, framework versions and a common sample count are not stated and are not inferred.