Omni-Reason-Bench — leaderboard

Scored v1.0 mini profile: 100 tasks, one sample each. The gallery follows the final 170-task training/evaluation scope based on benchmark v1.1; its 70 newly added tasks do not yet have published metric files and are therefore not folded into this table. Every scored generation is resampled to its target's resolution, frame rate and frame count; PSNR is the benchmark's official score (rgb-psnr-v1: per-pixel MSE over all frames in [0,1], equal-weight mean within a task, macro-mean over the 100 scored tasks). The other columns are computed on the same resampled pair. n counts the scored samples a model returned. The copy-input row scores the input video itself against the target.

RankModelnPSNR ↑SSIM ↑MS-SSIM ↑LPIPS ↓CLIP ↑
—Copy-input baseline10020.110.7430.7620.2790.866
1Kling O3 Standard10016.760.6340.6430.3590.853
2Gemini Omni Flash 1.08815.990.6100.6010.4030.851
3Grok Imagine (extend)10014.100.5630.5150.4640.826
4Seedance 2.59013.650.4920.4480.4800.834
5LTX-2.3 Extend10013.500.5530.4810.5270.807
6HY-OmniWeaving9913.110.5290.5290.5330.782
7LTX-2.3 (IC-LoRA v2v)10012.650.4760.3810.6050.771
8Wan-VACE 14B10012.020.4690.4690.5890.777
9MiniMax H310011.240.4320.3750.6030.795
10Cosmos3 Nano1008.510.3270.2800.7860.647
11Cosmos3 Super1008.490.3300.2480.7870.634

Per-sample scores: model_means.csv · each model's per_sample.csv under /media/scores/<model>/.