Project benchmark

CompassBench 2026-07 · Inference

OpenCompass · 15 configurations with published scores. Review each metric and its test conditions separately.

Report identity & conditions

Data as of2026-10-19· Report published—. See individual records for run dates and test conditions.

Leaderboard updated

  • This leaderboard uses OpenCompass’s closed benchmark sets. Questions update quarterly, and models may be added between quarters. Quarters and tasks are compared separately.
  • Overall and task scores follow the original leaderboard. We do not recalculate overall weights or interpret scores as question accuracy.
  • The same model configurations appear across five task scopes. Reasoning settings stay in the names; adding row counts does not give a count of unique models.
  • Organizations, parameter counts, release dates and release types follow the report. An open-weight label does not imply an open license; use depends on the model’s terms.
  • Quarterly versions and leaderboard update dates are kept separate. Actual test dates and individual sample counts are not stated.
  • Results: official OpenCompass leaderboard.
  • Quarterly version: 2026-07; leaderboard updated: 2026-08-24.
Read the original report ↗

Compare metrics within the same report. Each chart explains its direction and scope.
See the details for full values and run conditions.

Inference score

Original scores from this quarter’s closed benchmark; higher is better. Overall and task values are retained and are not ranked across quarters or tasks.: showing 8 of 15 records with values. See details for configurations and dates.

Chart data · 8 entries
Name points
Claude Opus 5 (high)68.4
GPT-5.5 (high)66.9
GPT-5.6-Sol (high)66.8
Qwen3.8-Max65.2
Doubao-Seed-2.1-Pro-260628 (high)64.9
Claude Opus 4.8 (high)64.1
Kimi-K3 (high)63.9
Kimi-K2.6 (high)62.9

Advanced general reasoning score

Original scores from this quarter’s closed benchmark; higher is better. Overall and task values are retained and are not ranked across quarters or tasks.: showing 8 of 15 records with values. See details for configurations and dates.

Chart data · 8 entries
Name points
Claude Opus 4.8 (high)80.6
Claude Opus 5 (high)80.1
GPT-5.5 (high)78.6
Kimi-K2.6 (high)78.1
Qwen3.8-Max78.1
Doubao-Seed-2.1-Pro-260628 (high)77.8
GPT-5.6-Sol (high)77.8
Gemini-3.7-Flash76.8

Full results & model versions

15 / 15configurations have published scores in this scope. Scored configurations are listed; missing values remain “Not provided.” Different run configurations of the same model are listed separately.

Gemini-3.7-Flash

Model reported by the benchmark

As reportedOrganization: Google · Model details ↗

Chat

Release date reported by the benchmark:

API

Inference score
62.1 分
Advanced general reasoning score
76.8 分
Advanced subject reasoning score
47.4 分

GLM-5.3

Model reported by the benchmark

As reportedOrganization: Zhipu AI · Model details ↗

Chat

Release date reported by the benchmark:

API

Inference score
62 分
Advanced general reasoning score
74.5 分
Advanced subject reasoning score
49.4 分

Kimi-K3 (high)

Model reported by the benchmark

As reportedOrganization: Moonshot · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 2.8T · Open weights

Inference score
63.9 分
Advanced general reasoning score
76 分
Advanced subject reasoning score
51.7 分

Hy3-preview (high)

Model reported by the benchmark

As reportedOrganization: Tencent · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 295B · Open weights

Inference score
54.6 分
Advanced general reasoning score
72.2 分
Advanced subject reasoning score
36.9 分

Doubao-Seed-2.1-Pro-260628 (high)

Model reported by the benchmark

As reportedOrganization: ByteDance · Model details ↗

Chat

Release date reported by the benchmark:

API

Inference score
64.9 分
Advanced general reasoning score
77.8 分
Advanced subject reasoning score
52 分

GPT-5.5 (high)

Model reported by the benchmark

As reportedOrganization: OpenAI · Model details ↗

Chat

Release date reported by the benchmark:

API

Inference score
66.9 分
Advanced general reasoning score
78.6 分
Advanced subject reasoning score
55.2 分

GPT-5.6-Sol (high)

Model reported by the benchmark

As reportedOrganization: OpenAI · Model details ↗

Chat

Release date reported by the benchmark:

API

Inference score
66.8 分
Advanced general reasoning score
77.8 分
Advanced subject reasoning score
55.8 分

Kimi-K2.6 (high)

Model reported by the benchmark

As reportedOrganization: Moonshot · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 1T · Open weights

Inference score
62.9 分
Advanced general reasoning score
78.1 分
Advanced subject reasoning score
47.7 分

Qwen3.8-Max

Model reported by the benchmark

As reportedOrganization: Alibaba · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 2.4T · Open weights

Inference score
65.2 分
Advanced general reasoning score
78.1 分
Advanced subject reasoning score
52.3 分

DeepSeek-V4-Pro

Model reported by the benchmark

As reportedOrganization: DeepSeek · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 1.6T · Open weights

Inference score
55.5 分
Advanced general reasoning score
69.6 分
Advanced subject reasoning score
41.3 分

Grok-4.6 (high)

Model reported by the benchmark

As reportedOrganization: xAI · Model details ↗

Chat

Release date reported by the benchmark:

API

Inference score
60 分
Advanced general reasoning score
75.3 分
Advanced subject reasoning score
44.8 分

DeepSeek-V4-Flash

Model reported by the benchmark

As reportedOrganization: DeepSeek · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 284B · Open weights

Inference score
61 分
Advanced general reasoning score
73 分
Advanced subject reasoning score
49.1 分

Claude Opus 4.8 (high)

Model reported by the benchmark

As reportedOrganization: Anthropic · Model details ↗

Chat

Release date reported by the benchmark:

API

Inference score
64.1 分
Advanced general reasoning score
80.6 分
Advanced subject reasoning score
47.7 分

MiniMax-M3

Model reported by the benchmark

As reportedOrganization: MiniMax · Model details ↗

Chat

Release date reported by the benchmark:

Parameters: 428B · Open weights

Inference score
54 分
Advanced general reasoning score
69.9 分
Advanced subject reasoning score
38.1 分

Claude Opus 5 (high)

Model reported by the benchmark

As reportedOrganization: Anthropic · Model details ↗

Chat

Release date reported by the benchmark:

API

Inference score
68.4 分
Advanced general reasoning score
80.1 分
Advanced subject reasoning score
56.7 分