Leaderboard

Leaderboard Tables

Compare single-task decisions, spatial and temporal grounding, and paired Agent-World coordination across all evaluated models. These complete tables share their data and presentation with the Analysis page.

Leaderboard

Current leading models

The compact Image, Video, Agent-State, and World-State views select three models by their aggregate task accuracy and display Dual scores alongside it. The Dual Cognition view selects by Overall Dual Semantic Acc and resolves all three paired capabilities. The complete tables below provide every model and task metric.

Image

#	Model	Acc	Dual Sem.	Dual Evi.
1	Gemini 3.8 Flash	66.6%	44.4%	34.3%
2	Muse Spark 1.3 Contributor	54.0%	28.1%	4.5%
3	Gemini 3.1 Pro Preview	52.6%	27.1%	30.1%

Video

#	Model	Acc	Dual Sem.	Dual Evi.
1	Gemini 3.8 Flash	47.1%	6.9%	8.2%
2	Gemini 3 Flash	46.2%	11.4%	12.6%
3	Muse Spark 1.3 Contributor	45.4%	12.6%	16.2%

Agent-State

#	Model	Acc	Dual Sem.	Dual Evi.
1	Gemini 3.8 Flash	57.5%	12.0%	13.2%
2	Gemini 3.1 Pro Preview	46.9%	2.2%	3.8%
3	Gemini 3 Flash	44.2%	15.7%	3.4%

World-State

#	Model	Acc	Dual Sem.	Dual Evi.
1	Gemini 3.8 Flash	59.1%	12.0%	13.2%
2	Muse Spark 1.3 Contributor	58.8%	17.4%	7.1%
3	Qwen3.6-Flash	57.2%	13.4%	6.6%

Dual Cognition

#	Model	Position		Action–Observation		Behavior–Visibility		Overall
#	Model	Sem.	Evi.	Sem.	Evi.	Sem.	Evi.	Sem.	Evi.
1	Muse Spark 1.3 Contributor	24.7%	6.7%	32.6%	3.4%	12.6%	16.2%	17.4%	7.1%
2	Gemini 3 Flash	25.6%	1.9%	24.3%	2.1%	11.4%	12.6%	15.7%	3.4%
3	Qwen3.6-27B	17.5%	13.0%	19.3%	4.1%	13.4%	7.7%	15.5%	6.9%

Image Tasks

Image-task leaderboard

The complete image evaluation follows Table II: four tasks assess Agent-State and World-State Reasoning, with option accuracy, BBox Acc@0.5, and mIoU for each task. Image Dual scores harmonically combine the position and action-observation pairings.

#1 within group #2 within group #3 within group

Four image tasks; 45 models and the unranked Human baseline. Dual columns harmonically combine the position and action-observation pair scores.
Model	Agent-State Reasoning						World-State Reasoning						Image Coordination
	Landmark-relative Position			Future Observation			Self-relative Position			Action Decision			Two image pairings
	Acc	BBox@0.5	mIoU	Acc	BBox@0.5	mIoU	Acc	BBox@0.5	mIoU	Acc	BBox@0.5	mIoU	Dual Sem.	Dual Evi.
Proprietary Models
Claude Opus 4.8^T	39.4%	11.4%	23.5%	35.9%	14.3%	25.4%	54.1%	10.4%	23.7%	51.9%	8.0%	21.7%	19.5%	2.5%
Claude Opus 4.7^T	39.3%	8.2%	20.1%	37.2%	7.0%	18.1%	49.7%	7.1%	18.6%	39.1%	7.9%	18.0%	16.7%	1.1%
Claude Opus 4.6^T	38.1%	2.1%	15.6%	32.4%	2.8%	18.7%	62.0%	8.6%	19.7%	58.9%	9.2%	20.1%	20.5%	0.0%
Claude Sonnet 4.6	37.7%	4.9%	18.2%	23.6%	3.6%	15.1%	48.5%	9.6%	20.2%	61.0%	8.6%	19.9%	15.9%	0.1%
Gemini 3.8 Flash^T	60.1%1	66.7%1	57.6%1	74.9%1	73.8%1	62.5%1	61.9%	40.8%1	39.0%1	69.5%1	42.3%1	39.3%1	44.4%1	34.3%1
Gemini 3.1 Pro Preview^T	40.9%3	58.8%2	50.5%2	58.8%2	59.9%2	52.3%2	63.7%3	37.5%2	36.8%2	47.2%	37.1%2	36.4%2	27.1%	30.1%2
Gemini 3.1 Flash Lite	33.7%	48.1%3	45.7%3	30.1%	47.9%3	46.0%3	47.6%	9.7%	21.1%	35.9%	9.3%	20.8%	12.4%	5.5%
Gemini 3 Flash	47.6%2	33.6%	33.8%	45.9%	37.5%	38.5%	56.2%	5.0%	13.5%	51.3%	5.1%	12.2%	24.9%	2.0%
GPT-6 Astra^T	35.1%	27.8%	31.2%	43.0%	27.8%	32.7%	57.2%	16.1%	24.3%	55.4%	14.9%	24.3%	21.5%	6.9%3
GPT-5.6 Sol^T	34.1%	23.9%	28.8%	42.1%	24.6%	30.1%	55.7%	12.9%	23.0%	55.8%	12.5%	22.4%	20.5%	5.6%
GPT-5.6 Terra^T	33.7%	24.8%	28.9%	40.5%	27.1%	31.0%	58.9%	14.5%	23.4%	60.2%	12.9%	22.5%	22.3%	6.3%
GPT-5.5	38.0%	19.4%	26.2%	53.4%3	17.5%	26.3%	65.4%1	17.6%	25.1%	53.6%	17.9%	24.7%	27.1%3	5.8%
GPT-5.4	37.9%	12.2%	24.1%	37.6%	13.9%	25.9%	37.8%	12.9%	24.4%	36.0%	12.0%	23.5%	14.0%	3.2%
GPT-5.3	35.2%	11.9%	23.5%	37.3%	13.9%	26.7%	56.5%	14.9%	22.5%	62.3%3	15.4%	22.5%	21.1%	2.9%
MiMo-V2-Omni	28.7%	40.7%	36.5%	21.3%	36.9%	33.4%	36.5%	8.8%	17.6%	38.2%	9.2%	17.3%	9.4%	4.6%
Muse Spark 1.3 Contributor^T	38.7%	20.5%	26.7%	48.6%	15.0%	21.2%	64.2%2	14.8%	25.5%	64.4%2	14.9%	24.9%	28.1%2	4.5%
Qwen3.7-Plus	33.3%	18.4%	28.0%	34.6%	21.4%	30.3%	55.4%	18.4%	26.7%	43.4%	18.8%3	27.0%3	15.7%	6.5%
Qwen3.6-Plus	32.8%	16.6%	27.1%	33.5%	14.7%	26.1%	48.4%	7.4%	19.0%	42.5%	6.0%	19.9%	13.7%	1.6%
Qwen3.6-Flash	25.1%	24.6%	32.0%	28.7%	19.2%	29.8%	62.7%	19.4%3	27.1%3	56.7%	18.6%	25.8%	16.0%	6.0%
Qwen3.5-Plus	28.6%	21.4%	27.1%	29.0%	12.3%	24.1%	47.6%	9.7%	19.3%	48.9%	8.3%	20.0%	12.7%	1.6%
Qwen3.5-Flash	27.8%	21.6%	29.8%	28.9%	15.8%	23.1%	52.4%	8.8%	19.4%	54.5%	8.9%	20.1%	15.0%	2.3%
Open-weight Models
GLM-5.3-Flash^T	32.4%	38.4%	38.1%	35.2%	45.4%1	43.8%1	63.6%1	32.7%1	33.5%1	57.4%2	33.0%1	34.1%1	19.9%1	20.6%1
GLM-4.6V	30.8%	47.5%1	43.0%1	27.1%	44.9%2	42.3%2	29.2%	9.5%	20.0%	44.2%	10.2%	20.6%	9.9%	5.3%
GLM-4.5V	31.9%	31.6%	32.1%	29.0%	23.4%	26.3%	19.9%	15.9%	22.5%	39.6%	17.8%	24.2%	8.8%	7.7%
Intern-S1-Pro	29.4%	17.4%	26.8%	26.2%	10.5%	22.6%	27.8%	2.7%	13.7%	30.3%	3.2%	14.0%	7.3%	0.4%
InternVL 3.5-241B-A28B	32.9%	31.3%	34.1%	26.1%	17.5%	24.8%	50.1%	5.4%	16.2%	41.8%	5.2%	15.3%	13.0%	1.7%
InternVL 3.5-30B-A3B	27.3%	4.9%	20.0%	24.0%	7.0%	15.3%	35.4%	0.6%	7.6%	41.3%	1.3%	7.3%	9.1%	0.0%
InternVL 3.5-14B	22.8%	7.6%	22.2%	31.9%	7.5%	22.5%	28.5%	4.7%	12.9%	41.3%	5.0%	11.9%	8.7%	0.6%
InternVL 3.5-8B	28.5%	19.7%	34.2%	24.5%	9.5%	29.1%	24.7%	4.2%	12.3%	30.8%	2.5%	11.4%	7.2%	0.6%
InternVL 3.5-4B	25.6%	3.1%	19.8%	26.4%	12.0%	23.7%	22.4%	1.0%	8.1%	36.7%	1.0%	7.5%	7.1%	0.0%
Kimi K2.6	36.1%1	22.1%	28.5%	32.3%	12.2%	20.8%	42.8%	12.3%	21.9%	28.0%	10.8%	20.4%	11.3%	3.7%
Kimi K2.5	34.3%2	27.1%	30.4%	32.7%	18.5%	23.9%	39.4%	5.0%	15.6%	30.1%	4.7%	14.4%	10.7%	1.1%
MiMo-V2.5	33.1%3	43.3%2	38.3%3	27.3%	43.5%3	40.1%3	51.2%	26.6%2	30.7%2	49.7%	27.8%2	31.5%2	15.3%	19.0%2
Qwen3.8-27B	26.2%	34.7%	35.2%	28.8%	17.0%	26.1%	61.9%2	22.8%3	27.6%	49.4%	21.9%3	28.1%3	15.3%	8.5%3
Qwen3.6-27B	30.8%	36.0%	35.2%	36.4%3	13.2%	22.8%	60.4%3	21.7%	27.8%3	53.4%3	19.5%	27.3%	18.4%2	6.2%
Qwen3.5-397B-A17B	27.4%	3.3%	12.6%	35.8%	13.5%	23.5%	47.9%	2.8%	13.0%	46.2%	4.4%	13.9%	14.1%	0.2%
Qwen3.5-122B-A10B	32.6%	29.1%	31.6%	37.8%1	26.0%	31.6%	49.7%	6.1%	19.4%	49.0%	6.8%	18.8%	15.4%	2.1%
Qwen3.5-35B-A3B	29.5%	27.6%	30.5%	27.4%	0.6%	0.8%	53.2%	6.1%	14.5%	57.5%1	7.2%	18.5%	15.5%	0.0%
Qwen3.5-27B	31.6%	42.8%3	39.9%2	37.1%2	22.8%	28.5%	57.8%	7.3%	20.4%	50.6%	7.5%	21.0%	17.8%3	2.9%
Qwen3.5-9B	29.0%	15.9%	25.8%	29.0%	22.9%	32.5%	53.2%	10.3%	20.9%	52.2%	11.5%	22.1%	15.1%	2.8%
Qwen3.5-4B	30.9%	12.9%	23.2%	30.2%	12.4%	23.1%	47.5%	6.8%	17.8%	47.5%	6.3%	18.0%	15.4%	1.2%
Spatially Specialized Models
SpaceOm	24.7%1	2.8%2	6.7%2	24.5%2	4.2%1	11.4%1	35.2%3	2.4%1	8.6%1	32.8%	1.8%2	6.5%2	8.0%3	0.1%2
SpaceR	20.6%3	2.5%3	6.3%3	24.0%3	1.1%	1.8%	42.4%2	2.1%2	6.5%2	48.8%2	2.3%1	6.9%1	9.4%2	0.0%3
SpaceThinker	22.6%2	1.2%	3.0%	25.4%1	1.8%3	5.9%2	32.8%	0.6%	5.1%3	34.3%3	0.7%	4.7%3	7.9%	0.0%3
ViLaSR	18.8%	4.3%1	7.6%1	22.1%	2.0%2	3.5%3	43.1%1	1.9%3	3.5%	49.7%1	1.5%3	3.2%	9.7%1	0.3%1
Human	85.8%	77.9%	57.8%	94.6%	75.4%	59.5%	82.5%	53.8%	47.2%	82.5%	72.5%	57.5%	-	-

Image-task performance. Four image tasks; 45 models and the unranked Human baseline. Dual columns harmonically combine the position and action-observation pair scores. Scores are percentages. Within each group, model families are alphabetical, with newer versions first and larger models first within a version. Colors mark the three highest distinct values per metric, including ties and zero scores. Dashes indicate missing metrics. ^T: low reasoning effort, or Muse Spark's minimum available setting. Human questionnaire results are unranked; see Human Validation for the protocol.

Video Tasks

Video-task leaderboard

The complete video evaluation follows Table III. Composite behavior uses exact-set accuracy, atomic behavior uses label-set F1, and landmark visibility uses count accuracy. Class-aware temporal F1@0.5 and mtIoU complement these decisions; Dual scores assess aligned behavior-visibility questions.

#1 within group #2 within group #3 within group

Behavior and visibility tasks; 32 models and the unranked Human baseline. Dual columns use aligned source trajectories; temporal F1 is class-aware.
Model	Agent-State Reasoning						World-State Reasoning			Video Coordination
	Composite Behavior			Atomic Behavior			Landmark Visibility			Behavior-Visibility
	Acc	F1@0.5	mtIoU	Label F1	F1@0.5	mtIoU	Count Acc	F1@0.5	mtIoU	Dual Sem.	Dual Evi.
Proprietary Models
Gemini 3.8 Flash^T	56.4%1	41.4%3	43.0%3	38.8%2	17.2%	14.6%	46.0%	25.3%	29.0%	6.9%	8.2%
Gemini 3.1 Pro Preview^T	54.8%2	40.2%	37.9%	32.9%	9.0%	8.6%	33.5%	20.4%	30.3%	1.2%	2.1%
Gemini 3.1 Flash Lite	23.7%	23.0%	26.0%	19.7%	11.6%	10.3%	52.8%	44.1%	42.2%	7.3%	5.5%
Gemini 3 Flash	48.3%	47.7%2	52.4%2	35.0%3	27.5%1	22.0%2	55.2%2	45.0%	44.3%	11.4%	12.6%2
MiMo-V2-Omni	26.9%	25.0%	26.9%	30.1%	21.3%	17.4%	59.4%1	52.7%	53.7%1	10.6%	11.5%3
Muse Spark 1.3 Contributor^T	49.2%3	50.0%1	53.1%1	39.2%1	27.2%2	22.3%1	47.9%	48.0%	44.2%	12.6%	16.2%1
Qwen3.7-Plus	6.5%	6.2%	6.4%	33.8%	24.2%3	18.3%3	53.6%3	56.8%2	49.2%3	14.0%3	11.5%3
Qwen3.6-Plus	9.8%	9.3%	9.6%	30.1%	15.6%	15.3%	50.8%	52.2%	46.1%	14.8%1	8.5%
Qwen3.6-Flash	32.3%	28.1%	32.0%	24.9%	16.9%	12.9%	52.2%	52.7%	46.7%	11.5%	7.3%
Qwen3.5-Plus	2.4%	2.4%	2.5%	32.1%	17.5%	17.0%	53.2%	54.2%3	46.8%	14.4%2	9.1%
Qwen3.5-Flash	32.6%	29.8%	33.1%	26.9%	17.8%	13.9%	52.3%	58.3%1	51.3%2	9.3%	9.5%
Open-weight Models
GLM-5.3-Flash^T	26.0%3	24.5%2	25.8%2	30.3%3	21.2%2	18.0%1	49.1%	43.9%	41.4%	11.8%3	9.4%
GLM-4.6V	31.2%2	1.2%	6.0%	32.2%1	7.5%	6.2%	31.3%	17.4%	33.8%	0.1%	0.5%
InternVL 3.5-30B-A3B	13.3%	1.9%	4.3%	24.5%	5.8%	5.4%	43.9%	8.2%	12.6%	7.2%	0.3%
InternVL 3.5-14B	23.4%	2.3%	7.3%	21.8%	3.9%	3.8%	54.5%2	14.4%	22.7%	3.0%	0.9%
InternVL 3.5-8B	22.4%	6.2%	10.6%	22.9%	4.2%	4.6%	51.9%	16.7%	21.3%	6.4%	0.3%
InternVL 3.5-4B	25.8%	2.3%	5.8%	20.7%	4.3%	3.4%	34.6%	17.1%	32.3%	0.4%	0.5%
Kimi K2.6	11.9%	10.7%	11.1%	31.4%2	20.0%	16.7%	39.9%	48.3%	43.3%	8.5%	7.8%
Kimi K2.5	13.3%	12.4%	13.2%	30.0%	21.2%3	17.6%	50.5%	50.3%3	45.8%	11.5%	10.2%1
MiMo-V2.5	35.6%1	33.4%1	36.9%1	29.5%	21.4%1	18.0%2	58.5%1	54.4%1	50.4%2	11.9%2	10.0%2
Qwen3.8-27B	15.3%	6.8%	7.5%	27.8%	12.4%	8.6%	43.2%	16.3%	23.6%	8.9%	0.5%
Qwen3.6-27B	19.9%	12.8%	14.1%	29.1%	18.9%	15.8%	52.7%	43.3%	42.3%	13.4%1	7.7%
Qwen3.5-397B-A17B	5.2%	1.0%	1.5%	26.6%	10.3%	8.4%	40.4%	21.2%	31.8%	5.7%	1.9%
Qwen3.5-122B-A10B	21.0%	17.8%3	19.9%3	23.4%	13.3%	11.9%	48.4%	46.7%	49.7%3	5.4%	6.5%
Qwen3.5-35B-A3B	21.0%	15.7%	16.7%	27.7%	17.8%	16.0%	54.1%3	50.0%	48.6%	8.9%	9.0%
Qwen3.5-27B	14.6%	13.4%	14.3%	29.7%	20.1%	17.7%3	51.4%	52.2%2	48.7%	11.2%	9.7%3
Qwen3.5-9B	9.5%	7.3%	8.3%	28.2%	17.8%	16.0%	50.7%	33.8%	36.8%	8.0%	6.0%
Qwen3.5-4B	6.4%	1.1%	1.1%	10.0%	0.9%	0.8%	33.9%	45.2%	52.0%1	0.6%	0.4%
Spatially Specialized Models
SpaceOm	26.5%1	0.0%1	2.5%1	25.9%2	4.0%1	3.1%2	32.3%3	17.6%1	34.2%1	0.3%	0.0%1
SpaceR	21.4%2	0.0%1	1.9%2	26.2%1	4.0%2	3.5%1	33.7%2	16.5%2	30.8%2	0.4%3	0.0%1
SpaceThinker	17.2%3	0.0%1	1.3%3	23.1%3	3.7%3	2.6%3	33.7%2	14.3%3	27.1%3	0.9%2	0.0%1
ViLaSR	5.2%	0.0%1	0.4%	9.9%	0.4%	1.1%	35.9%1	10.4%	20.6%	1.6%1	0.0%1
Human	83.9%	62.9%	53.3%	76.3%	83.2%	61.6%	95.0%	96.7%	83.7%	-	-

Video-task performance. Behavior and visibility tasks; 32 models and the unranked Human baseline. Dual columns use aligned source trajectories; temporal F1 is class-aware. Scores are percentages. Within each group, model families are alphabetical, with newer versions first and larger models first within a version. Colors mark the three highest distinct values per metric, including ties and zero scores. Dashes indicate missing metrics. ^T: low reasoning effort, or Muse Spark's minimum available setting. Human questionnaire results are unranked; see Human Validation for the protocol.

Agent-State

Agent-State capability leaderboard

The Agent-State view brings together landmark-relative position, action-conditioned future observation, and both levels of flight behavior. Each task retains its semantic and grounding metrics, followed by shared cross-media Dual scores for coordinated Agent-World success.

#1 within group #2 within group #3 within group

32 models evaluated in both media. Single-task Agent-State metrics are followed by the shared cross-media Agent-World Dual scores.
Model	Image Agent-State Tasks						Video Agent-State Tasks						Shared Coordination
	Landmark-relative Position			Future Observation			Composite Behavior			Atomic Behavior			Cross-media Overall
	Acc	BBox@0.5	mIoU	Acc	BBox@0.5	mIoU	Acc	F1@0.5	mtIoU	Label F1	F1@0.5	mtIoU	Dual Sem.	Dual Evi.
Proprietary Models
Gemini 3.8 Flash^T	60.1%1	66.7%1	57.6%1	74.9%1	73.8%1	62.5%1	56.4%1	41.4%3	43.0%3	38.8%2	17.2%	14.6%	12.0%	13.2%1
Gemini 3.1 Pro Preview^T	40.9%3	58.8%2	50.5%2	58.8%2	59.9%2	52.3%2	54.8%2	40.2%	37.9%	32.9%	9.0%	8.6%	2.2%	3.8%
Gemini 3.1 Flash Lite	33.7%	48.1%3	45.7%3	30.1%	47.9%3	46.0%3	23.7%	23.0%	26.0%	19.7%	11.6%	10.3%	9.2%	5.5%
Gemini 3 Flash	47.6%2	33.6%	33.8%	45.9%	37.5%	38.5%	48.3%	47.7%2	52.4%2	35.0%3	27.5%1	22.0%2	15.7%2	3.4%
MiMo-V2-Omni	28.7%	40.7%	36.5%	21.3%	36.9%	33.4%	26.9%	25.0%	26.9%	30.1%	21.3%	17.4%	10.0%	6.5%
Muse Spark 1.3 Contributor^T	38.7%	20.5%	26.7%	48.6%3	15.0%	21.2%	49.2%3	50.0%1	53.1%1	39.2%1	27.2%2	22.3%1	17.4%1	7.1%3
Qwen3.7-Plus	33.3%	18.4%	28.0%	34.6%	21.4%	30.3%	6.5%	6.2%	6.4%	33.8%	24.2%3	18.3%3	14.8%3	8.3%2
Qwen3.6-Plus	32.8%	16.6%	27.1%	33.5%	14.7%	26.1%	9.8%	9.3%	9.6%	30.1%	15.6%	15.3%	14.3%	2.6%
Qwen3.6-Flash	25.1%	24.6%	32.0%	28.7%	19.2%	29.8%	32.3%	28.1%	32.0%	24.9%	16.9%	12.9%	13.4%	6.6%
Qwen3.5-Plus	28.6%	21.4%	27.1%	29.0%	12.3%	24.1%	2.4%	2.4%	2.5%	32.1%	17.5%	17.0%	13.5%	2.7%
Qwen3.5-Flash	27.8%	21.6%	29.8%	28.9%	15.8%	23.1%	32.6%	29.8%	33.1%	26.9%	17.8%	13.9%	11.5%	3.7%
Open-weight Models
GLM-5.3-Flash^T	32.4%	38.4%	38.1%	35.2%	45.4%1	43.8%1	26.0%3	24.5%2	25.8%2	30.3%3	21.2%2	18.0%1	14.8%2	12.9%2
GLM-4.6V	30.8%	47.5%1	43.0%1	27.1%	44.9%2	42.3%2	31.2%2	1.2%	6.0%	32.2%1	7.5%	6.2%	0.2%	0.9%
InternVL 3.5-30B-A3B	27.3%	4.9%	20.0%	24.0%	7.0%	15.3%	13.3%	1.9%	4.3%	24.5%	5.8%	5.4%	8.0%	0.0%
InternVL 3.5-14B	22.8%	7.6%	22.2%	31.9%	7.5%	22.5%	23.4%	2.3%	7.3%	21.8%	3.9%	3.8%	4.5%	0.7%
InternVL 3.5-8B	28.5%	19.7%	34.2%	24.5%	9.5%	29.1%	22.4%	6.2%	10.6%	22.9%	4.2%	4.6%	6.8%	0.4%
InternVL 3.5-4B	25.6%	3.1%	19.8%	26.4%	12.0%	23.7%	25.8%	2.3%	5.8%	20.7%	4.3%	3.4%	0.7%	0.0%
Kimi K2.6	36.1%1	22.1%	28.5%	32.3%	12.2%	20.8%	11.9%	10.7%	11.1%	31.4%2	20.0%	16.7%	9.7%	5.0%
Kimi K2.5	34.3%2	27.1%	30.4%	32.7%	18.5%	23.9%	13.3%	12.4%	13.2%	30.0%	21.2%3	17.6%	11.1%	2.0%
MiMo-V2.5	33.1%3	43.3%2	38.3%3	27.3%	43.5%3	40.1%3	35.6%1	33.4%1	36.9%1	29.5%	21.4%1	18.0%2	13.4%	13.1%1
Qwen3.8-27B	26.2%	34.7%	35.2%	28.8%	17.0%	26.1%	15.3%	6.8%	7.5%	27.8%	12.4%	8.6%	11.2%	0.9%
Qwen3.6-27B	30.8%	36.0%	35.2%	36.4%3	13.2%	22.8%	19.9%	12.8%	14.1%	29.1%	18.9%	15.8%	15.5%1	6.9%3
Qwen3.5-397B-A17B	27.4%	3.3%	12.6%	35.8%	13.5%	23.5%	5.2%	1.0%	1.5%	26.6%	10.3%	8.4%	8.1%	0.3%
Qwen3.5-122B-A10B	32.6%	29.1%	31.6%	37.8%1	26.0%	31.6%	21.0%	17.8%3	19.9%3	23.4%	13.3%	11.9%	8.0%	3.2%
Qwen3.5-35B-A3B	29.5%	27.6%	30.5%	27.4%	0.6%	0.8%	21.0%	15.7%	16.7%	27.7%	17.8%	16.0%	11.3%	0.0%
Qwen3.5-27B	31.6%	42.8%3	39.9%2	37.1%2	22.8%	28.5%	14.6%	13.4%	14.3%	29.7%	20.1%	17.7%3	13.8%3	4.5%
Qwen3.5-9B	29.0%	15.9%	25.8%	29.0%	22.9%	32.5%	9.5%	7.3%	8.3%	28.2%	17.8%	16.0%	10.5%	3.8%
Qwen3.5-4B	30.9%	12.9%	23.2%	30.2%	12.4%	23.1%	6.4%	1.1%	1.1%	10.0%	0.9%	0.8%	1.1%	0.6%
Spatially Specialized Models
SpaceOm	24.7%1	2.8%2	6.7%2	24.5%2	4.2%1	11.4%1	26.5%1	0.0%1	2.5%1	25.9%2	4.0%1	3.1%2	0.6%	0.0%1
SpaceR	20.6%3	2.5%3	6.3%3	24.0%3	1.1%	1.8%	21.4%2	0.0%1	1.9%2	26.2%1	4.0%2	3.5%1	0.8%3	0.0%1
SpaceThinker	22.6%2	1.2%	3.0%	25.4%1	1.8%3	5.9%2	17.2%3	0.0%1	1.3%3	23.1%3	3.7%3	2.6%3	1.6%2	0.0%1
ViLaSR	18.8%	4.3%1	7.6%1	22.1%	2.0%2	3.5%3	5.2%	0.0%1	0.4%	9.9%	0.4%	1.1%	2.7%1	0.0%1
Human	85.8%	77.9%	57.8%	94.6%	75.4%	59.5%	83.9%	62.9%	53.3%	76.3%	83.2%	61.6%	-	-

Agent-State Reasoning performance. 32 models evaluated in both media. Single-task Agent-State metrics are followed by the shared cross-media Agent-World Dual scores. Scores are percentages. Within each group, model families are alphabetical, with newer versions first and larger models first within a version. Colors mark the three highest distinct values per metric, including ties and zero scores. Dashes indicate missing metrics. ^T: low reasoning effort, or Muse Spark's minimum available setting. Human questionnaire results are unranked; see Human Validation for the protocol.

World-State

World-State capability leaderboard

The World-State view groups self-relative position, goal-conditioned action decision, and landmark visibility. Spatial and temporal grounding appear beside each semantic metric. The final columns report the same cross-media Agent-World Dual scores used in the Agent-State view.

#1 within group #2 within group #3 within group

The same 32-model cross-media cohort. World-State task metrics are followed by the shared cross-media Agent-World Dual scores.
Model	Image World-State Tasks						Video World-State Task			Shared Coordination
	Self-relative Position			Action Decision			Landmark Visibility			Cross-media Overall
	Acc	BBox@0.5	mIoU	Acc	BBox@0.5	mIoU	Count Acc	F1@0.5	mtIoU	Dual Sem.	Dual Evi.
Proprietary Models
Gemini 3.8 Flash^T	61.9%	40.8%1	39.0%1	69.5%1	42.3%1	39.3%1	46.0%	25.3%	29.0%	12.0%	13.2%1
Gemini 3.1 Pro Preview^T	63.7%2	37.5%2	36.8%2	47.2%	37.1%2	36.4%2	33.5%	20.4%	30.3%	2.2%	3.8%
Gemini 3.1 Flash Lite	47.6%	9.7%	21.1%	35.9%	9.3%	20.8%	52.8%	44.1%	42.2%	9.2%	5.5%
Gemini 3 Flash	56.2%	5.0%	13.5%	51.3%	5.1%	12.2%	55.2%2	45.0%	44.3%	15.7%2	3.4%
MiMo-V2-Omni	36.5%	8.8%	17.6%	38.2%	9.2%	17.3%	59.4%1	52.7%	53.7%1	10.0%	6.5%
Muse Spark 1.3 Contributor^T	64.2%1	14.8%	25.5%	64.4%2	14.9%	24.9%	47.9%	48.0%	44.2%	17.4%1	7.1%3
Qwen3.7-Plus	55.4%	18.4%	26.7%	43.4%	18.8%3	27.0%3	53.6%3	56.8%2	49.2%3	14.8%3	8.3%2
Qwen3.6-Plus	48.4%	7.4%	19.0%	42.5%	6.0%	19.9%	50.8%	52.2%	46.1%	14.3%	2.6%
Qwen3.6-Flash	62.7%3	19.4%3	27.1%3	56.7%3	18.6%	25.8%	52.2%	52.7%	46.7%	13.4%	6.6%
Qwen3.5-Plus	47.6%	9.7%	19.3%	48.9%	8.3%	20.0%	53.2%	54.2%3	46.8%	13.5%	2.7%
Qwen3.5-Flash	52.4%	8.8%	19.4%	54.5%	8.9%	20.1%	52.3%	58.3%1	51.3%2	11.5%	3.7%
Open-weight Models
GLM-5.3-Flash^T	63.6%1	32.7%1	33.5%1	57.4%2	33.0%1	34.1%1	49.1%	43.9%	41.4%	14.8%2	12.9%2
GLM-4.6V	29.2%	9.5%	20.0%	44.2%	10.2%	20.6%	31.3%	17.4%	33.8%	0.2%	0.9%
InternVL 3.5-30B-A3B	35.4%	0.6%	7.6%	41.3%	1.3%	7.3%	43.9%	8.2%	12.6%	8.0%	0.0%
InternVL 3.5-14B	28.5%	4.7%	12.9%	41.3%	5.0%	11.9%	54.5%2	14.4%	22.7%	4.5%	0.7%
InternVL 3.5-8B	24.7%	4.2%	12.3%	30.8%	2.5%	11.4%	51.9%	16.7%	21.3%	6.8%	0.4%
InternVL 3.5-4B	22.4%	1.0%	8.1%	36.7%	1.0%	7.5%	34.6%	17.1%	32.3%	0.7%	0.0%
Kimi K2.6	42.8%	12.3%	21.9%	28.0%	10.8%	20.4%	39.9%	48.3%	43.3%	9.7%	5.0%
Kimi K2.5	39.4%	5.0%	15.6%	30.1%	4.7%	14.4%	50.5%	50.3%3	45.8%	11.1%	2.0%
MiMo-V2.5	51.2%	26.6%2	30.7%2	49.7%	27.8%2	31.5%2	58.5%1	54.4%1	50.4%2	13.4%	13.1%1
Qwen3.8-27B	61.9%2	22.8%3	27.6%	49.4%	21.9%3	28.1%3	43.2%	16.3%	23.6%	11.2%	0.9%
Qwen3.6-27B	60.4%3	21.7%	27.8%3	53.4%3	19.5%	27.3%	52.7%	43.3%	42.3%	15.5%1	6.9%3
Qwen3.5-397B-A17B	47.9%	2.8%	13.0%	46.2%	4.4%	13.9%	40.4%	21.2%	31.8%	8.1%	0.3%
Qwen3.5-122B-A10B	49.7%	6.1%	19.4%	49.0%	6.8%	18.8%	48.4%	46.7%	49.7%3	8.0%	3.2%
Qwen3.5-35B-A3B	53.2%	6.1%	14.5%	57.5%1	7.2%	18.5%	54.1%3	50.0%	48.6%	11.3%	0.0%
Qwen3.5-27B	57.8%	7.3%	20.4%	50.6%	7.5%	21.0%	51.4%	52.2%2	48.7%	13.8%3	4.5%
Qwen3.5-9B	53.2%	10.3%	20.9%	52.2%	11.5%	22.1%	50.7%	33.8%	36.8%	10.5%	3.8%
Qwen3.5-4B	47.5%	6.8%	17.8%	47.5%	6.3%	18.0%	33.9%	45.2%	52.0%1	1.1%	0.6%
Spatially Specialized Models
SpaceOm	35.2%3	2.4%1	8.6%1	32.8%	1.8%2	6.5%2	32.3%3	17.6%1	34.2%1	0.6%	0.0%1
SpaceR	42.4%2	2.1%2	6.5%2	48.8%2	2.3%1	6.9%1	33.7%2	16.5%2	30.8%2	0.8%3	0.0%1
SpaceThinker	32.8%	0.6%	5.1%3	34.3%3	0.7%	4.7%3	33.7%2	14.3%3	27.1%3	1.6%2	0.0%1
ViLaSR	43.1%1	1.9%3	3.5%	49.7%1	1.5%3	3.2%	35.9%1	10.4%	20.6%	2.7%1	0.0%1
Human	82.5%	53.8%	47.2%	82.5%	72.5%	57.5%	95.0%	96.7%	83.7%	-	-

World-State Reasoning performance. The same 32-model cross-media cohort. World-State task metrics are followed by the shared cross-media Agent-World Dual scores. Scores are percentages. Within each group, model families are alphabetical, with newer versions first and larger models first within a version. Colors mark the three highest distinct values per metric, including ties and zero scores. Dashes indicate missing metrics. ^T: low reasoning effort, or Muse Spark's minimum available setting. Human questionnaire results are unranked; see Human Validation for the protocol.

Dual Cognition

Paired Agent-World coordination leaderboard

The full counterpart of Table IV reports all eligible models on position, action-observation, and behavior-visibility pairings. Dual Semantic and Dual Evidence Acc assess semantic and grounding co-success independently; Overall harmonically combines the image and video scores.

#1 within group #2 within group #3 within group

Complete Table IV view: all 32 models with paired image and video records. Overall = H(H(Position, Action-Observation), Behavior-Visibility), separately for Sem. and Evi.
Model	Image Coordination				Video Coordination		Cross-media
	Position		Action-Observation		Behavior-Visibility		Overall
	Dual Sem.	Dual Evi.	Dual Sem.	Dual Evi.	Dual Sem.	Dual Evi.	Dual Sem.	Dual Evi.
Proprietary Models
Gemini 3.8 Flash^T	38.3%1	32.5%1	52.8%1	36.2%1	6.9%	8.2%	12.0%	13.2%1
Gemini 3.1 Pro Preview^T	27.0%2	29.5%2	27.1%3	30.8%2	1.2%	2.1%	2.2%	3.8%
Gemini 3.1 Flash Lite	15.5%	6.1%	10.3%	5.0%	7.3%	5.5%	9.2%	5.5%
Gemini 3 Flash	25.6%3	1.9%	24.3%	2.1%	11.4%	12.6%2	15.7%2	3.4%
MiMo-V2-Omni	10.0%	5.3%	9.0%	4.0%	10.6%	11.5%3	10.0%	6.5%
Muse Spark 1.3 Contributor^T	24.7%	6.7%	32.6%2	3.4%	12.6%	16.2%1	17.4%1	7.1%3
Qwen3.7-Plus	16.4%	6.5%	15.1%	6.4%3	14.0%3	11.5%3	14.8%3	8.3%2
Qwen3.6-Plus	13.5%	1.7%	14.0%	1.5%	14.8%1	8.5%	14.3%	2.6%
Qwen3.6-Flash	15.9%	7.4%3	16.0%	5.1%	11.5%	7.3%	13.4%	6.6%
Qwen3.5-Plus	11.2%	3.0%	14.6%	1.1%	14.4%2	9.1%	13.5%	2.7%
Qwen3.5-Flash	14.3%	2.6%	15.9%	2.1%	9.3%	9.5%	11.5%	3.7%
Open-weight Models
GLM-5.3-Flash^T	19.3%1	20.7%1	20.5%1	20.5%1	11.8%3	9.4%	14.8%2	12.9%2
GLM-4.6V	8.3%	5.2%	12.2%	5.4%	0.1%	0.5%	0.2%	0.9%
InternVL 3.5-30B-A3B	9.3%	0.0%	8.9%	0.1%	7.2%	0.3%	8.0%	0.0%
InternVL 3.5-14B	6.4%	0.7%	13.5%	0.5%	3.0%	0.9%	4.5%	0.7%
InternVL 3.5-8B	6.6%	1.3%	7.8%	0.4%	6.4%	0.3%	6.8%	0.4%
InternVL 3.5-4B	5.5%	0.1%	10.0%	0.0%	0.4%	0.5%	0.7%	0.0%
Kimi K2.6	14.6%	5.3%	9.2%	2.8%	8.5%	7.8%	9.7%	5.0%
Kimi K2.5	11.9%	1.6%	9.7%	0.9%	11.5%	10.2%1	11.1%	2.0%
MiMo-V2.5	16.2%	18.9%2	14.6%	19.1%2	11.9%2	10.0%2	13.4%	13.1%1
Qwen3.8-27B	15.8%	13.1%3	14.7%	6.3%3	8.9%	0.5%	11.2%	0.9%
Qwen3.6-27B	17.5%2	13.0%	19.3%2	4.1%	13.4%1	7.7%	15.5%1	6.9%3
Qwen3.5-397B-A17B	12.0%	0.1%	17.0%	1.3%	5.7%	1.9%	8.1%	0.3%
Qwen3.5-122B-A10B	13.5%	2.5%	18.0%	1.9%	5.4%	6.5%	8.0%	3.2%
Qwen3.5-35B-A3B	15.3%	2.4%	15.7%	0.0%	8.9%	9.0%	11.3%	0.0%
Qwen3.5-27B	17.4%3	3.8%	18.2%3	2.3%	11.2%	9.7%3	13.8%3	4.5%
Qwen3.5-9B	14.4%	2.4%	15.8%	3.2%	8.0%	6.0%	10.5%	3.8%
Qwen3.5-4B	15.4%	1.1%	15.4%	1.3%	0.6%	0.4%	1.1%	0.6%
Spatially Specialized Models
SpaceOm	8.4%2	0.2%2	7.6%	0.1%2	0.3%	0.0%1	0.6%	0.0%1
SpaceR	8.1%3	0.2%2	11.2%1	0.0%3	0.4%3	0.0%1	0.8%3	0.0%1
SpaceThinker	7.5%	0.0%3	8.3%3	0.0%3	0.9%2	0.0%1	1.6%2	0.0%1
ViLaSR	9.6%1	0.5%1	9.8%2	0.2%1	1.6%1	0.0%1	2.7%1	0.0%1

Complete dual-cognition coordination results. Complete Table IV view: all 32 models with paired image and video records. Overall = H(H(Position, Action-Observation), Behavior-Visibility), separately for Sem. and Evi. Scores are percentages. Within each group, model families are alphabetical, with newer versions first and larger models first within a version. Colors mark the three highest distinct values per metric, including ties and zero scores. Dashes indicate missing metrics. ^T: low reasoning effort, or Muse Spark's minimum available setting.