Project benchmark

CompassBench 2026-07 · Overall

OpenCompass · 15 configurations with published scores. Review each metric and its test conditions separately.

Report identity & conditions

Data as of2026-10-19· Report published—. See individual records for run dates and test conditions.

Leaderboard updated

  • This leaderboard uses OpenCompass’s closed benchmark sets. Questions update quarterly, and models may be added between quarters. Quarters and tasks are compared separately.
  • Overall and task scores follow the original leaderboard. We do not recalculate overall weights or interpret scores as question accuracy.
  • The same model configurations appear across five task scopes. Reasoning settings stay in the names; adding row counts does not give a count of unique models.
  • Organizations, parameter counts, release dates and release types follow the report. An open-weight label does not imply an open license; use depends on the model’s terms.
  • Quarterly versions and leaderboard update dates are kept separate. Actual test dates and individual sample counts are not stated.
  • Results: official OpenCompass leaderboard.
  • Quarterly version: 2026-07; leaderboard updated: 2026-08-24.
Read the original report ↗

Compare metrics within the same report. Each chart explains its direction and scope.
See the details for full values and run conditions.

Overall score

Original scores from this quarter’s closed benchmark; higher is better. Overall and task values are retained and are not ranked across quarters or tasks.: showing 8 of 15 records with values. See details for configurations and dates.

Chart data · 8 entries
Name points
Claude Opus 5 (high)83.3
GPT-5.6-Sol (high)80.8
GPT-5.5 (high)80.6
Qwen3.8-Max80.6
Doubao-Seed-2.1-Pro-260628 (high)80.5
Gemini-3.7-Flash80.5
Kimi-K3 (high)79.1
Grok-4.6 (high)78

Knowledge score

Original scores from this quarter’s closed benchmark; higher is better. Overall and task values are retained and are not ranked across quarters or tasks.: showing 8 of 15 records with values. See details for configurations and dates.

Chart data · 8 entries
Name points
Claude Opus 5 (high)94.1
Gemini-3.7-Flash94
Grok-4.6 (high)93.8
DeepSeek-V4-Pro92.5
GLM-5.391.9
Doubao-Seed-2.1-Pro-260628 (high)91.4
Kimi-K3 (high)90.3
Kimi-K2.6 (high)89.8

Full results & model versions

15 / 15configurations have published scores in this scope. Scored configurations are listed; missing values remain “Not provided.” Different run configurations of the same model are listed separately.

Gemini-3.7-Flash

Model reported by the benchmark

Overall score · original rank 5

As reportedOrganization: Google · Model details ↗

Chat

Release date reported by the benchmark:

API

Overall score
80.5 分
Knowledge score
94 分
Inference score
62.1 分
Math score
76.8 分
Code score
89.3 分

GLM-5.3

Model reported by the benchmark

Overall score · original rank 12

As reportedOrganization: Zhipu AI · Model details ↗

Chat

Release date reported by the benchmark:

API

Overall score
74.4 分
Knowledge score
91.9 分
Inference score
62 分
Math score
67.2 分
Code score
76.5 分

Kimi-K3 (high)

Model reported by the benchmark

Overall score · original rank 7

As reportedOrganization: Moonshot · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 2.8T · Open weights

Overall score
79.1 分
Knowledge score
90.3 分
Inference score
63.9 分
Math score
74.1 分
Code score
88 分

Hy3-preview (high)

Model reported by the benchmark

Overall score · original rank 14

As reportedOrganization: Tencent · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 295B · Open weights

Overall score
73.6 分
Knowledge score
85.6 分
Inference score
54.6 分
Math score
72.2 分
Code score
82 分

Doubao-Seed-2.1-Pro-260628 (high)

Model reported by the benchmark

Overall score · original rank 6

As reportedOrganization: ByteDance · Model details ↗

Chat

Release date reported by the benchmark:

API

Overall score
80.5 分
Knowledge score
91.4 分
Inference score
64.9 分
Math score
74.9 分
Code score
90.8 分

GPT-5.5 (high)

Model reported by the benchmark

Overall score · original rank 4

As reportedOrganization: OpenAI · Model details ↗

Chat

Release date reported by the benchmark:

API

Overall score
80.6 分
Knowledge score
87.7 分
Inference score
66.9 分
Math score
71.4 分
Code score
96.5 分

GPT-5.6-Sol (high)

Model reported by the benchmark

Overall score · original rank 2

As reportedOrganization: OpenAI · Model details ↗

Chat

Release date reported by the benchmark:

API

Overall score
80.8 分
Knowledge score
88.5 分
Inference score
66.8 分
Math score
71.4 分
Code score
96.3 分

Kimi-K2.6 (high)

Model reported by the benchmark

Overall score · original rank 10

As reportedOrganization: Moonshot · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 1T · Open weights

Overall score
75.7 分
Knowledge score
89.8 分
Inference score
62.9 分
Math score
75.7 分
Code score
74.5 分

Qwen3.8-Max

Model reported by the benchmark

Overall score · original rank 3

As reportedOrganization: Alibaba · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 2.4T · Open weights

Overall score
80.6 分
Knowledge score
86.8 分
Inference score
65.2 分
Math score
75 分
Code score
95.5 分

DeepSeek-V4-Pro

Model reported by the benchmark

Overall score · original rank 9

As reportedOrganization: DeepSeek · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 1.6T · Open weights

Overall score
77.5 分
Knowledge score
92.5 分
Inference score
55.5 分
Math score
71.2 分
Code score
91 分

Grok-4.6 (high)

Model reported by the benchmark

Overall score · original rank 8

As reportedOrganization: xAI · Model details ↗

Chat

Release date reported by the benchmark:

API

Overall score
78 分
Knowledge score
93.8 分
Inference score
60 分
Math score
73 分
Code score
85 分

DeepSeek-V4-Flash

Model reported by the benchmark

Overall score · original rank 13

As reportedOrganization: DeepSeek · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 284B · Open weights

Overall score
73.7 分
Knowledge score
84.5 分
Inference score
61 分
Math score
70.4 分
Code score
79 分

Claude Opus 4.8 (high)

Model reported by the benchmark

Overall score · original rank 11

As reportedOrganization: Anthropic · Model details ↗

Chat

Release date reported by the benchmark:

API

Overall score
75.1 分
Knowledge score
87.5 分
Inference score
64.1 分
Math score
71.5 分
Code score
77.3 分

MiniMax-M3

Model reported by the benchmark

Overall score · original rank 15

As reportedOrganization: MiniMax · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 428B · Open weights

Overall score
69 分
Knowledge score
86.6 分
Inference score
54 分
Math score
63 分
Code score
72.5 分

Claude Opus 5 (high)

Model reported by the benchmark

Overall score · original rank 1

As reportedOrganization: Anthropic · Model details ↗

Chat

Release date reported by the benchmark:

API

Overall score
83.3 分
Knowledge score
94.1 分
Inference score
68.4 分
Math score
77.3 分
Code score
93.3 分