Skip to content

Mistral Small 3.2 24B Instruct (Venice) vs GLM 4.7 (Venice)

On the 10 use cases both models ran, GLM 4.7 (Venice) won 8 to 1, with 1 tied (better outcome first, then lower cost).

Pass rate: Mistral Small 3.2 24B Instruct (Venice) 10% (10 runs) vs GLM 4.7 (Venice) 80% (10 runs). Average cost per run: $0.0033 vs $0.02.

MetricMistral Small 3.2 24B Instruct (Venice)GLM 4.7 (Venice)
Runs on shared use cases1010
Pass rate10% (1/10)80% (8/10)
Avg cost per run$0.0033$0.02
Avg wall time1m6m
Step-ins per run0.000.00
Use cases won18

Use case by use case

Only use cases both models ran are compared; all settings of each model are grouped. How we score.