Skip to content

Total a small coffee roastery's week by origin, profile and lot after re-weighs and a roast-loss rule

Exact prompt

# Total a small coffee roastery's week by origin, profile and lot after re-weighs and a roast-loss rule Inputs: `lots.csv` (lot_id, origin, green_kg), `roasts.csv` (batch_id, date, lot_id, profile, green_kg, roasted_kg), `reweighs.csv` (batch_id, roasted_kg) and `period.json` (period_start, period_end, both dates included). The week's records are synthetic: every lot, origin label and batch is invented, and the loss limit and bag size below are this roastery's own house rules. These rules are the roastery's; where `roaster-notes.txt` disagrees, the rules win. Rules: - Re-weighs: a row in reweighs.csv replaces the roasted_kg of the batch it names. When a batch has several re-weigh rows, the last one in the file counts. - Roast loss: a batch's loss is (green_kg − roasted_kg) ÷ green_kg × 100, in percent. A batch whose loss is above 18 is scorched and goes to cold brew; at 18 or below its roasted coffee is sellable. - Origins: a batch counts under the origin of its lot (several lots can share an origin). - Bags: bags are 250 g. For each profile, bags is the number of whole 250 g bags that profile's total sellable roasted coffee fills (round down once per profile, not per batch). - Green stock: a lot's green_left_kg is its green_kg minus the green_kg of every batch roasted from it, scorched batches included. - Roast days: a day's roasted_kg is the total roasted_kg of the batches roasted that day, scorched batches included. - Write `out/roastery.json`: `{"scorched_batches": [<sorted batch_ids>], "sellable_kg_by_origin": {"<origin>": <kg>, ...}, "bags_by_profile": {"<profile>": <whole number>, ...}, "green_left_kg_by_lot": {"<lot_id>": <kg>, ...}, "roasted_kg_by_day": {"<YYYY-MM-DD>": <kg>, ...}}`. `green_left_kg_by_lot` has one entry per row in lots.csv. - Roll-ups: Origins in lots.csv with no sellable coffee are left out. Profiles with no sellable coffee are left out. Days in the period with no roasts are included at 0. ## How this run works - Work on your own: nobody will answer questions in this task, and writing to `ask/` counts against the run. - Write only under `out/`. Create `out/` if it is missing. Inputs are synthetic; don't fetch anything from the network. - Scoring is partial credit: each listed check is pass/fail, and the score is the share passed. Numbers are compared to within 0.005 unless the task says otherwise.

Work out a synthetic coffee roastery's week from its roast log. Re-weigh rows replace a batch's roasted weight, and when a batch has several the last one counts. A batch that lost more than a stated share of its green weight is scorched and goes to cold brew. Report the scorched batches, sellable coffee per origin, whole 250 g bags per profile (rounded down once per profile), green coffee left per lot and roasted weight per day. One roll-up prompt mixes both kinds of wording: origins and profiles with no sellable coffee are left out, while days with no roasts are listed at 0. A batch at exactly the loss limit and a batch re-weighed out of the scorched range are decoys. Roaster's notes get the loss, re-weigh, bag and roll-up rules wrong. Original benchmark task written for usecaserank.com (not based on a specific public post). Headless, offline run on a reproducible fixture. Each run's notes say how its cost was measured (estimates are marked).

Success criteria: scorched_batches sellable_by_origin bags_by_profile green_left_by_lot roasted_by_day

Best model for this task so far: Claude Haiku 5.5 (effort default (no --effort flag) · thinking on) (success, $0.0043, 17s).

Run this on another model

All runs (3)

100% pass rate across 3 eligible runs: 3 pass, 0 partial, 0 fail. Partial and failed runs are listed below with everything else.ⓘ

Runs for this use case
ModelCostTimeStep-insⓘAutonomyOutcomeTrustⓘDateCompare
AClaude Opus 5.5default · thinking on$0.1216s0Fully autonomouspassTrust 80%2026-10-26
AClaude Haiku 5.5default · thinking on$0.004317s0Fully autonomouspassTrust 80%2026-10-26
AClaude Sonnet 5.5default · thinking on$0.0512s0Fully autonomouspassTrust 80%2026-10-26

Embed this result

A live badge for this use case. It links back here and updates as new runs are published.

UseCaseRank badge for Total a small coffee roastery's week by origin, profile and lot after re-weighs and a roast-loss rule

Get new runs and ranking changes weekly

Which models got better or cheaper on real tasks like this one.