Claude Haiku 5.5 vs GLM 4.7 (Venice)
On the 15 use cases both models ran, Claude Haiku 5.5 won 15 to 0 (better outcome first, then lower cost).
Pass rate: Claude Haiku 5.5 100% (15 runs) vs GLM 4.7 (Venice) 80% (15 runs). Average cost per run: $0.0057 vs $0.03.
| Metric | Claude Haiku 5.5 | GLM 4.7 (Venice) |
|---|---|---|
| Runs on shared use cases | 15 | 15 |
| Pass rate | 100% (15/15) | 80% (12/15) |
| Avg cost per run | $0.0057 | $0.03 |
| Avg wall time | 22s | 6m |
| Step-ins per run | 0.27 | 0.27 |
| Use cases won | 15 | 0 |
Use case by use case
- Backtest a moving-average crossover on a bundled synthetic price file: Claude Haiku 5.5 better (pass 100% vs 100%)
- Boat fuel range with a reserve over a planned trip: Claude Haiku 5.5 better (pass 100% vs 0%)
- Catch log checked against a made-up fishing regulations table: Claude Haiku 5.5 better (pass 100% vs 0%)
- Compute meeting-room utilisation from a versioned booking export across time zones and clock changes: Claude Haiku 5.5 better (pass 100% vs 0%)
- Dead reckoning, estimated position with current, and computed set and drift: Claude Haiku 5.5 better (pass 100% vs 100%)
- Debt avalanche vs snowball schedule to the cent: Claude Haiku 5.5 better (pass 100% vs 100%)
- Discounted cash flow valuation with mid-year option and a sensitivity grid: Claude Haiku 5.5 better (pass 100% vs 100%)
- Progressive tax on fictional brackets, and pre-tax vs after-tax savings comparison: Claude Haiku 5.5 better (pass 100% vs 100%)
- Read a synthetic annual-report excerpt and compute financial ratios: Claude Haiku 5.5 better (pass 100% vs 100%)
- Render per-environment deploy configs when the payment credential is missing: Claude Haiku 5.5 better (pass 100% vs 100%)
- Retirement drawdown with a 4% rule, inflation raises and a skip-raise-after-loss guardrail: Claude Haiku 5.5 better (pass 100% vs 100%)
- Schedule a cross-time-zone meeting in a DST-mismatch week and send invites only after sign-off: Claude Haiku 5.5 better (pass 100% vs 100%)
- Seeded Monte Carlo retirement odds against a stated success threshold: Claude Haiku 5.5 better (pass 100% vs 100%)
- Split a campaign budget across channels whose response only kicks in above a minimum spend: Claude Haiku 5.5 better (pass 100% vs 100%)
- Work backward from a retirement budget to a savings target, contributions and earliest retirement age: Claude Haiku 5.5 better (pass 100% vs 100%)
Only use cases both models ran are compared; all settings of each model are grouped. How we score.