Skip to content

GPT-6.1 Sol vs MiniMax M2.5 (Venice)

On the 5 use cases both models ran, MiniMax M2.5 (Venice) won 4 to 1 (better outcome first, then lower cost).

Pass rate: GPT-6.1 Sol 100% (5 runs) vs MiniMax M2.5 (Venice) 80% (5 runs). Average cost per run: $0.06 vs $0.01.

MetricGPT-6.1 SolMiniMax M2.5 (Venice)
Runs on shared use cases55
Pass rate100% (5/5)80% (4/5)
Avg cost per run$0.06$0.01
Avg wall time56s5m
Step-ins per run0.000.00
Use cases won14

Use case by use case

Only use cases both models ran are compared; all settings of each model are grouped. How we score.