Find the right AI for you

Search by name or tell us what you want to do
API servicesChoose how to access modelsAI modelsCapabilities, specifications, and pricingAI toolsFind useful tools by taskMCP directoryConnect tools, data, and workflowsAgent skillsFind reusable skills for AI agentsBenchmarksCompare model performanceOnline toolsConvert accounts, format JSON, estimate costs and test APIsModel timelineExplore model releasesUse casesStart with a practical task
EnterSearch · ↑↓Choose a resultEscClose
Submit中文
Project benchmark

EuroEval European languages · Test split · few-shot

EuroEval · 273 configurations with published scores. Review each metric and its test conditions separately.

Report identity & conditions

Data as of2026-10-28· Report published—. See individual records for run dates and test conditions.

Leaderboard updated

  • Mean rank scores cover the European generative datasets; lower is better. Overall and language-specific scores are separate. Missing scores are not zero.
  • Test and validation splits, and few-shot and zero-shot prompts, have separate pages. Thinking modes and model types remain part of each run’s identity; matching names do not merge configurations.
  • The ± value is the half-width of a 95% bootstrap confidence interval. Charts sort by point estimate, but small differences with overlapping intervals do not establish superiority.
  • Hugging Face models are linked only when the official URL exactly matches the catalog identifier. Short names, API prefixes and thinking modes do not establish an exact version.
  • Model metadata, European values and hallucination rates are outside this page’s ranking metrics. This leaderboard does not measure general ability across all tasks or languages.
  • The EuroEval results repository and framework use the MIT License, Copyright © Dan Saattrup Smart and Alexandra Instituttet A/S. Full terms: /licenses/euroeval.txt.
  • Leaderboard updated: 2026-10-27 10:35:11 CET. This is not a model release date or an individual test date.
  • This page covers Test split with few-shot prompts. Model types remain attached to individual records. Per-run test dates, framework versions and a common sample count are not stated and are not inferred.
Read the original report ↗

Compare metrics within the same report. Each chart explains its direction and scope.
Error bars show 95% confidence intervals.See the details for full values and run conditions.

Mean European-language rank score

Mean rank score across the European generative tasks; lower is better. ± is the half-width of a 95% bootstrap confidence interval. Scores are not ranked across different datasets.: showing 8 of 43 records with values. See details for configurations and dates.

Chart data · 8 entries
NameRank score
mistralai/Mistral-Small-3.2-24B-Instruct-25061.85 ± 0.06 (95% CI)
mistralai/Mistral-Small-3.1-24B-Instruct-25031.86 ± 0.05 (95% CI)
Qwen/Qwen3-32B#no-thinking1.9 ± 0.06 (95% CI)
google/gemma-3-27b-pt1.93 ± 0.07 (95% CI)
mistralai/Mistral-Small-3.1-24B-Base-25031.93 ± 0.06 (95% CI)
deepcogito/cogito-v1-preview-qwen-32B1.95 ± 0.06 (95% CI)
Qwen/Qwen3-14B#no-thinking2.02 ± 0.06 (95% CI)
google/gemma-3-12b-it2.06 ± 0.06 (95% CI)

Albanian mean rank score

Mean rank score for Albanian; lower is better. ± is the half-width of a 95% bootstrap confidence interval. Scores are not ranked across different datasets.: showing 8 of 69 records with values. See details for configurations and dates.

Chart data · 8 entries
NameRank score
mistralai/Mistral-Small-3.1-24B-Instruct-25031.79 ± 0.03 (95% CI)
mistralai/Mistral-Small-3.2-24B-Instruct-25061.8 ± 0.04 (95% CI)
google/gemma-3-27b-it1.81 ± 0.04 (95% CI)
Qwen/Qwen3-32B#no-thinking1.84 ± 0.05 (95% CI)
google/gemma-3-27b-pt1.98 ± 0.04 (95% CI)
Qwen/Qwen3-14B#no-thinking1.98 ± 0.05 (95% CI)
deepcogito/cogito-v2-preview-llama-70B2.02 ± 0.04 (95% CI)
mistralai/Mistral-Small-3.1-24B-Base-25032.06 ± 0.04 (95% CI)

Full results & model versions

273 / 474configurations have published scores in this scope. Scored configurations are listed; missing values remain “Not provided.” Different run configurations of the same model are listed separately.

Qwen/Qwen3-1.7B →

Linked to an exact version in our directory

Test split · few-shot · Instruction-tuned

Mean European-language rank score
Not provided
Faroese mean rank score
4 ± 0.04（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

deepcogito/cogito-v1-preview-qwen-32B

Model reported by the benchmark

Test split · few-shot · Instruction-tuned

Mean European-language rank score
1.95 ± 0.06（95% CI） 排名分
Albanian mean rank score
2.29 ± 0.03（95% CI） 排名分
Belarusian mean rank score
1.93 ± 0.03（95% CI） 排名分
Bosnian mean rank score
1.93 ± 0.04（95% CI） 排名分
More metrics
Bulgarian mean rank score
2.53 ± 0.02（95% CI） 排名分
Catalan mean rank score
1.91 ± 0.03（95% CI） 排名分
Croatian mean rank score
2.21 ± 0.02（95% CI） 排名分
Czech mean rank score
1.7 ± 0.01（95% CI） 排名分
Danish mean rank score
1.8 ± 0.02（95% CI） 排名分
Dutch mean rank score
1.98 ± 0.18（95% CI） 排名分
English mean rank score
1.41 ± 0.01（95% CI） 排名分
Estonian mean rank score
2.13 ± 0.02（95% CI） 排名分
Faroese mean rank score
2.78 ± 0.06（95% CI） 排名分
Finnish mean rank score
1.92 ± 0.02（95% CI） 排名分
French mean rank score
1.71 ± 0.18（95% CI） 排名分
German mean rank score
1.83 ± 0.12（95% CI） 排名分
Greek mean rank score
2.39 ± 0.03（95% CI） 排名分
Hungarian mean rank score
2.2 ± 0.02（95% CI） 排名分
Icelandic mean rank score
2.33 ± 0.03（95% CI） 排名分
Italian mean rank score
1.88 ± 0.17（95% CI） 排名分
Latvian mean rank score
1.6 ± 0.02（95% CI） 排名分
Lithuanian mean rank score
1.9 ± 0.04（95% CI） 排名分
Luxembourgish mean rank score
1.88 ± 0.04（95% CI） 排名分
Norwegian mean rank score
1.72 ± 0.13（95% CI） 排名分
Polish mean rank score
1.92 ± 0.02（95% CI） 排名分
Portuguese mean rank score
1.75 ± 0.07（95% CI） 排名分
Romanian mean rank score
1.96 ± 0.02（95% CI） 排名分
Serbian mean rank score
1.62 ± 0.02（95% CI） 排名分
Slovak mean rank score
1.75 ± 0.02（95% CI） 排名分
Slovene mean rank score
2.28 ± 0.02（95% CI） 排名分
Spanish mean rank score
1.83 ± 0.13（95% CI） 排名分
Swedish mean rank score
1.79 ± 0.15（95% CI） 排名分
Ukrainian mean rank score
1.6 ± 0.02（95% CI） 排名分

deepseek-ai/DeepSeek-R1-0528-Qwen3-8B →

Linked to an exact version in our directory

Test split · few-shot · Reasoning model

Mean European-language rank score
Not provided
Faroese mean rank score
3.71 ± 0.04（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

danish-foundation-models/munin-gemma4-e4b

Model reported by the benchmark

Test split · few-shot · Instruction-tuned

Mean European-language rank score
Not provided
Danish mean rank score
2.94 ± 0.03（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Faroese mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

Shekswess/trlm-135m

Model reported by the benchmark

Test split · few-shot · Instruction-tuned

Mean European-language rank score
Not provided
Faroese mean rank score
4.76 ± 0.03（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

MaLA-LM/emma-500-llama2-7b

Model reported by the benchmark

Test split · few-shot · Base generative

Mean European-language rank score
Not provided
Faroese mean rank score
4.3 ± 0.08（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

google/gemma-3n-E2B-it

Model reported by the benchmark

Test split · few-shot · Instruction-tuned

Mean European-language rank score
Not provided
Bulgarian mean rank score
2.75 ± 0.02（95% CI） 排名分
Slovak mean rank score
2.62 ± 0.03（95% CI） 排名分
Slovene mean rank score
2.72 ± 0.02（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Faroese mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

ibm-granite/granite-4.0-h-tiny →

Linked to an exact version in our directory

Test split · few-shot · Instruction-tuned

Mean European-language rank score
Not provided
Bulgarian mean rank score
3.23 ± 0.03（95% CI） 排名分
Croatian mean rank score
3.03 ± 0.03（95% CI） 排名分
Slovak mean rank score
3 ± 0.04（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Catalan mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Faroese mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovene mean rank score
3.18 ± 0.03（95% CI） 排名分
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

google/gemma-2-2b-it

Model reported by the benchmark

Test split · few-shot · Instruction-tuned

Mean European-language rank score
Not provided
Faroese mean rank score
4.01 ± 0.04（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

HuggingFaceTB/SmolLM2-135M-Instruct

Model reported by the benchmark

Test split · few-shot · Instruction-tuned

Mean European-language rank score
Not provided
Belarusian mean rank score
4.05 ± 0.04（95% CI） 排名分
Bosnian mean rank score
3.68 ± 0.07（95% CI） 排名分
Bulgarian mean rank score
4.22 ± 0.03（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Catalan mean rank score
3.97 ± 0.05（95% CI） 排名分
Croatian mean rank score
Not provided
Czech mean rank score
4.15 ± 0.02（95% CI） 排名分
Danish mean rank score
Not provided
Dutch mean rank score
4.24 ± 0.13（95% CI） 排名分
English mean rank score
3.88 ± 0.06（95% CI） 排名分
Estonian mean rank score
4.12 ± 0.04（95% CI） 排名分
Faroese mean rank score
4.66 ± 0.05（95% CI） 排名分
Finnish mean rank score
4.13 ± 0.03（95% CI） 排名分
French mean rank score
4.06 ± 0.12（95% CI） 排名分
German mean rank score
4.23 ± 0.13（95% CI） 排名分
Greek mean rank score
4.1 ± 0.04（95% CI） 排名分
Hungarian mean rank score
4.14 ± 0.04（95% CI） 排名分
Icelandic mean rank score
4.1 ± 0.04（95% CI） 排名分
Italian mean rank score
4.17 ± 0.13（95% CI） 排名分
Latvian mean rank score
3.84 ± 0.04（95% CI） 排名分
Lithuanian mean rank score
4.02 ± 0.04（95% CI） 排名分
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
3.98 ± 0.05（95% CI） 排名分
Polish mean rank score
4.29 ± 0.03（95% CI） 排名分
Portuguese mean rank score
4.19 ± 0.07（95% CI） 排名分
Romanian mean rank score
4.14 ± 0.04（95% CI） 排名分
Serbian mean rank score
3.83 ± 0.05（95% CI） 排名分
Slovak mean rank score
4.43 ± 0.04（95% CI） 排名分
Slovene mean rank score
4.37 ± 0.02（95% CI） 排名分
Spanish mean rank score
4.07 ± 0.1（95% CI） 排名分
Swedish mean rank score
4.09 ± 0.11（95% CI） 排名分
Ukrainian mean rank score
4.1 ± 0.03（95% CI） 排名分

openai-community/gpt2

Model reported by the benchmark

Test split · few-shot · Base generative

Mean European-language rank score
Not provided
Faroese mean rank score
4.78 ± 0.08（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

allenai/Olmo-3-7B-Instruct-SFT

Model reported by the benchmark

Test split · few-shot · Instruction-tuned

Mean European-language rank score
Not provided
Albanian mean rank score
3.35 ± 0.05（95% CI） 排名分
Belarusian mean rank score
3.64 ± 0.05（95% CI） 排名分
Bosnian mean rank score
2.14 ± 0.05（95% CI） 排名分
More metrics
Bulgarian mean rank score
3.46 ± 0.05（95% CI） 排名分
Catalan mean rank score
3.02 ± 0.04（95% CI） 排名分
Croatian mean rank score
3.33 ± 0.04（95% CI） 排名分
Czech mean rank score
3.15 ± 0.03（95% CI） 排名分
Danish mean rank score
3.26 ± 0.05（95% CI） 排名分
Dutch mean rank score
Not provided
English mean rank score
2.63 ± 0.08（95% CI） 排名分
Estonian mean rank score
3.47 ± 0.05（95% CI） 排名分
Faroese mean rank score
4.04 ± 0.05（95% CI） 排名分
Finnish mean rank score
3.09 ± 0.03（95% CI） 排名分
French mean rank score
Not provided
German mean rank score
3.11 ± 0.16（95% CI） 排名分
Greek mean rank score
3.47 ± 0.03（95% CI） 排名分
Hungarian mean rank score
3.43 ± 0.04（95% CI） 排名分
Icelandic mean rank score
3.75 ± 0.05（95% CI） 排名分
Italian mean rank score
3.22 ± 0.14（95% CI） 排名分
Latvian mean rank score
3.29 ± 0.05（95% CI） 排名分
Lithuanian mean rank score
3.14 ± 0.05（95% CI） 排名分
Luxembourgish mean rank score
3.3 ± 0.08（95% CI） 排名分
Norwegian mean rank score
3.1 ± 0.09（95% CI） 排名分
Polish mean rank score
3.42 ± 0.05（95% CI） 排名分
Portuguese mean rank score
2.95 ± 0.08（95% CI） 排名分
Romanian mean rank score
2.98 ± 0.04（95% CI） 排名分
Serbian mean rank score
3.01 ± 0.03（95% CI） 排名分
Slovak mean rank score
3.4 ± 0.04（95% CI） 排名分
Slovene mean rank score
3.58 ± 0.04（95% CI） 排名分
Spanish mean rank score
3.05 ± 0.1（95% CI） 排名分
Swedish mean rank score
3.14 ± 0.11（95% CI） 排名分
Ukrainian mean rank score
3.09 ± 0.04（95% CI） 排名分

BSC-LT/salamandra-2b

Model reported by the benchmark

Test split · few-shot · Base generative

Mean European-language rank score
Not provided
Belarusian mean rank score
3.92 ± 0.05（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Faroese mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

PleIAs/Monad

Model reported by the benchmark

Test split · few-shot · Base generative

Mean European-language rank score
4.4 ± 0.06（95% CI） 排名分
Albanian mean rank score
4.48 ± 0.03（95% CI） 排名分
Belarusian mean rank score
4.1 ± 0.03（95% CI） 排名分
Bosnian mean rank score
4.27 ± 0.02（95% CI） 排名分
More metrics
Bulgarian mean rank score
3.93 ± 0.05（95% CI） 排名分
Catalan mean rank score
4.5 ± 0.02（95% CI） 排名分
Croatian mean rank score
3.96 ± 0.08（95% CI） 排名分
Czech mean rank score
4.5 ± 0.03（95% CI） 排名分
Danish mean rank score
4.44 ± 0.03（95% CI） 排名分
Dutch mean rank score
4.73 ± 0.11（95% CI） 排名分
English mean rank score
4.43 ± 0.04（95% CI） 排名分
Estonian mean rank score
4.4 ± 0.02（95% CI） 排名分
Faroese mean rank score
4.92 ± 0.02（95% CI） 排名分
Finnish mean rank score
4.5 ± 0.03（95% CI） 排名分
French mean rank score
4.55 ± 0.07（95% CI） 排名分
German mean rank score
4.7 ± 0.08（95% CI） 排名分
Greek mean rank score
4.38 ± 0.03（95% CI） 排名分
Hungarian mean rank score
4.41 ± 0.02（95% CI） 排名分
Icelandic mean rank score
4.49 ± 0.04（95% CI） 排名分
Italian mean rank score
4.67 ± 0.1（95% CI） 排名分
Latvian mean rank score
4.15 ± 0.03（95% CI） 排名分
Lithuanian mean rank score
4.41 ± 0.03（95% CI） 排名分
Luxembourgish mean rank score
3.85 ± 0.13（95% CI） 排名分
Norwegian mean rank score
4.4 ± 0.05（95% CI） 排名分
Polish mean rank score
4.7 ± 0.02（95% CI） 排名分
Portuguese mean rank score
4.59 ± 0.06（95% CI） 排名分
Romanian mean rank score
4.56 ± 0.02（95% CI） 排名分
Serbian mean rank score
3.68 ± 0.07（95% CI） 排名分
Slovak mean rank score
4.63 ± 0.02（95% CI） 排名分
Slovene mean rank score
4.47 ± 0.01（95% CI） 排名分
Spanish mean rank score
4.59 ± 0.07（95% CI） 排名分
Swedish mean rank score
4.45 ± 0.1（95% CI） 排名分
Ukrainian mean rank score
4.02 ± 0.09（95% CI） 排名分

ibm-granite/granite-3.0-1b-a400m-base →

Linked to an exact version in our directory

Test split · few-shot · Base generative

Mean European-language rank score
Not provided
Faroese mean rank score
4.76 ± 0.04（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

facebook/MobileLLM-R1-360M-base

Model reported by the benchmark

Test split · few-shot · Base generative

Mean European-language rank score
Not provided
Faroese mean rank score
4.66 ± 0.05（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

google/gemma-2b-it

Model reported by the benchmark

Test split · few-shot · Instruction-tuned

Mean European-language rank score
Not provided
Faroese mean rank score
4.56 ± 0.04（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

meta-llama/Llama-2-13b-hf →

Linked to an exact version in our directory

Test split · few-shot · Base generative

Mean European-language rank score
Not provided
Faroese mean rank score
3.97 ± 0.04（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

mistralai/Mistral-Nemo-Instruct-2407 →

Linked to an exact version in our directory

Test split · few-shot · Instruction-tuned

Mean European-language rank score
Not provided
Faroese mean rank score
3.28 ± 0.05（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Bosnian mean rank score
Not provided
Bulgarian mean rank score
Not provided
Catalan mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
Not provided
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
Not provided
Estonian mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
Not provided
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
Not provided
Polish mean rank score
Not provided
Portuguese mean rank score
Not provided
Romanian mean rank score
Not provided
Serbian mean rank score
Not provided
Slovak mean rank score
Not provided
Slovene mean rank score
Not provided
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided

utter-project/EuroMoE-2.6B-A0.6B-Preview

Model reported by the benchmark

Test split · few-shot · Base generative

Mean European-language rank score
Not provided
Bosnian mean rank score
3.27 ± 0.06（95% CI） 排名分
Bulgarian mean rank score
3.45 ± 0.05（95% CI） 排名分
Catalan mean rank score
3.61 ± 0.1（95% CI） 排名分
More metrics
Albanian mean rank score
Not provided
Belarusian mean rank score
Not provided
Croatian mean rank score
Not provided
Czech mean rank score
3.7 ± 0.04（95% CI） 排名分
Danish mean rank score
Not provided
Dutch mean rank score
Not provided
English mean rank score
3.26 ± 0.06（95% CI） 排名分
Estonian mean rank score
3.75 ± 0.03（95% CI） 排名分
Faroese mean rank score
Not provided
Finnish mean rank score
Not provided
French mean rank score
Not provided
German mean rank score
Not provided
Greek mean rank score
Not provided
Hungarian mean rank score
Not provided
Icelandic mean rank score
Not provided
Italian mean rank score
Not provided
Latvian mean rank score
3.49 ± 0.05（95% CI） 排名分
Lithuanian mean rank score
Not provided
Luxembourgish mean rank score
Not provided
Norwegian mean rank score
3.75 ± 0.07（95% CI） 排名分
Polish mean rank score
3.91 ± 0.04（95% CI） 排名分
Portuguese mean rank score
Not provided
Romanian mean rank score
3.64 ± 0.03（95% CI） 排名分
Serbian mean rank score
Not provided
Slovak mean rank score
4.11 ± 0.04（95% CI） 排名分
Slovene mean rank score
4.11 ± 0.03（95% CI） 排名分
Spanish mean rank score
Not provided
Swedish mean rank score
Not provided
Ukrainian mean rank score
Not provided