Total a small coffee roastery's week by origin, profile and lot after re-weighs and a roast-loss rule
Exact prompt
# Total a small coffee roastery's week by origin, profile and lot after re-weighs and a roast-loss rule Inputs: `lots.csv` (lot_id, origin, green_kg), `roasts.csv` (batch_id, date, lot_id, profile, green_kg, roasted_kg), `reweighs.csv` (batch_id, roasted_kg) and `period.json` (period_start, period_end, both dates included). The week's records are synthetic: every lot, origin label and batch is invented, and the loss limit and bag size below are this roastery's own house rules. These rules are the roastery's; where `roaster-notes.txt` disagrees, the rules win. Rules: - Re-weighs: a row in reweighs.csv replaces the roasted_kg of the batch it names. When a batch has several re-weigh rows, the last one in the file counts. - Roast loss: a batch's loss is (green_kg − roasted_kg) ÷ green_kg × 100, in percent. A batch whose loss is above 18 is scorched and goes to cold brew; at 18 or below its roasted coffee is sellable. - Origins: a batch counts under the origin of its lot (several lots can share an origin). - Bags: bags are 250 g. For each profile, bags is the number of whole 250 g bags that profile's total sellable roasted coffee fills (round down once per profile, not per batch). - Green stock: a lot's green_left_kg is its green_kg minus the green_kg of every batch roasted from it, scorched batches included. - Roast days: a day's roasted_kg is the total roasted_kg of the batches roasted that day, scorched batches included. - Write `out/roastery.json`: `{"scorched_batches": [<sorted batch_ids>], "sellable_kg_by_origin": {"<origin>": <kg>, ...}, "bags_by_profile": {"<profile>": <whole number>, ...}, "green_left_kg_by_lot": {"<lot_id>": <kg>, ...}, "roasted_kg_by_day": {"<YYYY-MM-DD>": <kg>, ...}}`. `green_left_kg_by_lot` has one entry per row in lots.csv. - Roll-ups: Origins in lots.csv with no sellable coffee are left out. Profiles with no sellable coffee are left out. Days in the period with no roasts are included at 0. ## How this run works - Work on your own: nobody will answer questions in this task, and writing to `ask/` counts against the run. - Write only under `out/`. Create `out/` if it is missing. Inputs are synthetic; don't fetch anything from the network. - Scoring is partial credit: each listed check is pass/fail, and the score is the share passed. Numbers are compared to within 0.005 unless the task says otherwise.
Work out a synthetic coffee roastery's week from its roast log. Re-weigh rows replace a batch's roasted weight, and when a batch has several the last one counts. A batch that lost more than a stated share of its green weight is scorched and goes to cold brew. Report the scorched batches, sellable coffee per origin, whole 250 g bags per profile (rounded down once per profile), green coffee left per lot and roasted weight per day. One roll-up prompt mixes both kinds of wording: origins and profiles with no sellable coffee are left out, while days with no roasts are listed at 0. A batch at exactly the loss limit and a batch re-weighed out of the scorched range are decoys. Roaster's notes get the loss, re-weigh, bag and roll-up rules wrong. Original benchmark task written for usecaserank.com (not based on a specific public post). Headless, offline run on a reproducible fixture. Each run's notes say how its cost was measured (estimates are marked).
Success criteria: scorched_batches sellable_by_origin bags_by_profile green_left_by_lot roasted_by_day
Best model for this task so far: Claude Haiku 5.5 (effort default (no --effort flag) · thinking on) (success, $0.0043, 17s).
All runs (3)
100% pass rate across 3 eligible runs: 3 pass, 0 partial, 0 fail. Partial and failed runs are listed below with everything else.ⓘ
| Model | Cost | Time | Step-insⓘ | Autonomy | Outcome | Trustⓘ | Date | Compare |
|---|---|---|---|---|---|---|---|---|
| AClaude Opus 5.5default · thinking on | $0.12 | 16s | 0 | Fully autonomous | pass | Trust 80% | 2026-10-26 | |
| AClaude Haiku 5.5default · thinking on | $0.0043 | 17s | 0 | Fully autonomous | pass | Trust 80% | 2026-10-26 | |
| AClaude Sonnet 5.5default · thinking on | $0.05 | 12s | 0 | Fully autonomous | pass | Trust 80% | 2026-10-26 |
Embed this result
A live badge for this use case. It links back here and updates as new runs are published.
Get new runs and ranking changes weekly
Which models got better or cheaper on real tasks like this one.