Skip to content

GPT-6.1 Sol vs Qwen3 Coder 480B Turbo (Venice)

On the 21 use cases both models ran, Qwen3 Coder 480B Turbo (Venice) won 11 to 10 (better outcome first, then lower cost).

Pass rate: GPT-6.1 Sol 100% (21 runs) vs Qwen3 Coder 480B Turbo (Venice) 52% (21 runs). Average cost per run: $0.05 vs $0.0092.

MetricGPT-6.1 SolQwen3 Coder 480B Turbo (Venice)
Runs on shared use cases2121
Pass rate100% (21/21)52% (11/21)
Avg cost per run$0.05$0.0092
Avg wall time59s1m
Step-ins per run0.000.00
Use cases won1011

Use case by use case

Only use cases both models ran are compared; all settings of each model are grouped. How we score.