Prepare a dog walker's monthly owner statements with extra-dog pricing and bank holiday surcharges
Exact prompt
# Prepare a dog walker's owner statements for December Inputs: `walks.csv` (each walk: owner, date, type, minutes, dogs) and `rates.json` (the rate per walk for each type and length, and the bank holiday dates). Every amount is in pounds. Pricing rules, per walk: - The walk rate comes from rates.json by type (solo or group) and minutes (30 or 60). - Walk price = the rate for the first dog plus half the rate for each further dog on that walk. - A walk on a date listed in bank_holidays carries a surcharge of 20% of the whole walk price; there is no surcharge on other days, weekends included. - Round each walk's price and each surcharge to the cent half-up before adding anything up. Write `out/statement.json`: `{"base": {"<owner>": <sum of walk prices>, ...}, "surcharge": {...}, "total": {...}, "grand_total": <sum of the totals>}` with every owner in `walks.csv`. ## How this run works - Work on your own: nobody will answer questions in this task, and writing to `ask/` counts against the run. - Write only under `out/`. Create `out/` if it is missing. Inputs are synthetic; don't fetch anything from the network. - Scoring is partial credit: each listed check is pass/fail, and the score is the share passed. Numbers are compared to within 0.005 unless the task says otherwise.
Turn a month of walk records into owner statements. Each walk is priced by type and length, every dog after the first on a walk costs half the rate, and walks on listed bank holidays carry a 20% surcharge. Charging every dog in full, surcharging only the first dog or surcharging weekends too each change the statements. Original benchmark task written for usecaserank.com (not based on a specific public post). Headless, offline run on a reproducible fixture. Each run's notes say how its cost was measured (estimates are marked).
Success criteria: extra_dogs bank_holiday_surcharge totals
Best model for this task so far: Claude Haiku 5.5 (effort default (no --effort flag) · thinking on) (success, $0.0040, 16s).
All runs (3)
100% pass rate across 3 eligible runs: 3 pass, 0 partial, 0 fail. Partial and failed runs are listed below with everything else.ⓘ
| Model | Cost | Time | Step-insⓘ | Autonomy | Outcome | Trustⓘ | Date | Compare |
|---|---|---|---|---|---|---|---|---|
| AClaude Opus 5.5default · thinking on | $0.12 | 16s | 0 | Fully autonomous | pass | Trust 80% | 2026-10-22 | |
| AClaude Haiku 5.5default · thinking on | $0.0040 | 16s | 0 | Fully autonomous | pass | Trust 80% | 2026-10-22 | |
| AClaude Sonnet 5.5default · thinking on | $0.05 | 9s | 0 | Fully autonomous | pass | Trust 80% | 2026-10-22 |
Embed this result
A live badge for this use case. It links back here and updates as new runs are published.
Get new runs and ranking changes weekly
Which models got better or cheaper on real tasks like this one.