Skip to content

Claude Sonnet 5.5 (effort default (no --effort flag) · thinking on) on Value a cash-and-carry's month-end stock on FIFO with case units, same-day ordering, supplier returns and write-downs

AClaude Sonnet 5.5default · thinking on · Claude Code 2.1.299 (headless -p) · cloud · 2026-10-23 · by @bobsiopener

Trust 80%Fully autonomoussuccess · first try
Estimated cost
$0.06
Wall time
20s
Human step-ins
0
Outcome
Pass

Compare with other models on this task →

Summary

Exact prompt

# Value a cash-and-carry's stock at month end on first-in, first-out Inputs: `movements.csv` (line, date, sku, type, qty, unit, unit_cost), `items.json` (per sku: case_size, nrv_each) and `stock-note.txt`. Amounts are in pounds. `items.json` and these rules are the record; where the stock note disagrees, the rules win. Rules: - A qty with unit case is qty x case_size single units, whatever the movement type; a receipt's unit_cost is per unit given (per case for case receipts). - Process movements by date; on the same date, receipts come first, then supplier returns, then issues, then adjustments (ties by line). - Each receipt is a cost layer. Issues and negative adjustments use up the oldest layers first; only issues count toward cost of goods sold. - A supplier return takes units back out of the newest layer first. A positive adjustment adds a layer at the newest layer's unit cost. - At month end, if a sku's remaining cost is more than its units x nrv_each, it is written down to that amount; the write-down is the difference. - Write `out/stock.json`: `{"closing_qty": {"<sku>": <units>, ...}, "closing_value": {"<sku>": <value after any write-down>, ...}, "writedowns": {"<sku>": <amount>, ...}, "cogs": {"<sku>": <cost of goods sold>, ...}, "total_value": <sum of closing_value>}` with every sku in each map except `writedowns` (only amounts above 0); round each money figure half-up to 0.01 once, at the end. ## How this run works - Work on your own: nobody will answer questions in this task, and writing to `ask/` counts against the run. - Write only under `out/`. Create `out/` if it is missing. Inputs are synthetic; don't fetch anything from the network. - Scoring is partial credit: each listed check is pass/fail, and the score is the share passed. Numbers are compared to within 0.005 unless the task says otherwise.

Value each product's closing stock and cost of goods sold from a month of movements on first-in, first-out. Quantities come in cases and singles, receipts and issues share dates and appear out of order in the file, supplier returns come back out of the newest layer, stock-take adjustments add or remove units, and some products must be written down to net realisable value. A stock note gets the unit, return and write-down rules wrong. Original benchmark task written for usecaserank.com (not based on a specific public post). Headless, offline run on a reproducible fixture. Each run's notes say how its cost was measured (estimates are marked).

Success criteria: units fifo_cogs same_day_and_returns writedowns totals

Setup notes: Batch 31 case ta02-fifo-stock-valuation (offline, synthetic inputs, seed 612126560). Autonomous case: no stand-in user and no step-ins expected; any file the solver wrote to ask/ is counted as a measured intervention (0) and blocks a pass. Prompt = TASK.md verbatim. Hidden key kept outside the solver's work dir. Scored with the case's scorer (python3 score.py WORKDIR KEYDIR, absolute paths); pass = every check true and no ask/ files. Tools: Read/Write/Edit/Glob/Grep/Bash, web disabled. Single run, no retries. 1-min load average at scoring 0.59 (8 cores). Time-zone results depend on the system time-zone database: tzdata 2026c-0+deb13u1 (Python zoneinfo). Claude Code's own reported cost for claude-sonnet-5.5: $0.05651. Score: 5/5. Cost is an ESTIMATE: measured tokens x pricing.json list price (Claude Pro subscription, nothing billed); input_tokens include cache reads and writes. Single run.

Estimated cost List-price estimate; not actually billed.

Metrics

Estimated cost
$0.06
Wall time
20s
Human step-ins
0
Turns
4
Model usage
ModelInput tokOutput tokCost
AClaude Sonnet 5.5anthropic/claude-sonnet-5.5effort default (no --effort flag) · thinking on77,4021,741$0.06

Reproduce this run

  1. Use the use case prompt on the use case page.
  2. Same setup: Claude Sonnet 5.5 (anthropic/claude-sonnet-5.5, effort default (no --effort flag) · thinking on) via Claude Code 2.1.299 (headless -p), cloud.
  3. It counts as a success only if it meets every success criterion: units fifo_cogs same_day_and_returns writedowns totals
  4. Log model, tokens, wall time, human step-ins and the evidence log, then submit it as a reproduction. A different model? Submit a head-to-head rerun.

How runs are scored: Methodology.

Was this useful?

⇄ Rerun on another model

Automated checks

Trust 80% comes from these checks (how Trust % works).

Evidence log
[
 {
  "duration_api_ms": 19046,
  "stop_reason": "end_turn",
  "session_id": "[REDACTED]",
  "total_cost_usd": 0.0565097,
  "usage": {
   "input_tokens": 8,
   "cache_creation_input_tokens": 8037,
   "cache_read_input_tokens": 69357,
   "output_tokens": 1741,
   "output_tokens_details": {
    "thinking_tokens": 189
   },
   "server_tool_use": {
    "web_search_requests": 0,
    "web_fetch_requests": 0
   },
   "service_tier": "standard",
   "cache_creation": {
    "ephemeral_1h_input_tokens": 8037,
    "ephemeral_5m_input_tokens": 0
   },
   "inference_geo": "global",
   "iterations": [
    {
     "input_tokens": 2,
     "output_tokens": 428,
     "cache_read_input_tokens": 19248,
     "cache_creation_input_tokens": 1328,
     "cache_creation": {
      "ephemeral_5m_input_tokens": 0,
      "ephemeral_1h_input_tokens": 1328
     },
     "type": "message"
    }
   ],
   "speed": "standard",
   "fallback_credit": null
  },
  "modelUsage": {
   "claude-sonnet-5-5": {
    "inputTokens": 8,
    "outputTokens": 1741,
    "cacheReadInputTokens": 69357,
    "cacheCreationInputTokens": 8037,
    "webSearchRequests": 0,
    "costUSD": 0.0565097,
    "contextWindow": 1000000,
    "maxOutputTokens": 128000,
    "thinkingTokens": 189,
    "canonicalModel": "claude-sonnet-5-5",
    "provider": "firstParty",
    "costBasis": "list"
   }
  },
  "permission_denials": [],
  "terminal_reason": "completed",
  "fast_mode_state": "off",
  "fast_mode_disabled_reason": "sdk_opt_in_required",
  "subagent_stats": {
   "spawned": 0,
   "requested": {
    "background": 0,
    "foreground": 0,
    "unset": 0
   },
   "started_in_background": 0,
   "max_depth": 0,
   "spawned_by_subagents": 0,
   "completed": 0,
   "failed": 0,
   "killed": {
    "parent": 0,
    "user": 0,
    "system": 0
   },
   "refused": {
    "depth_limit": 0,
    "concurrency_limit": 0,
    "budget": 0
   },
   "by_type": {}
  },
  "safety_stops": 0,
  "is_error": false,
  "num_turns": 4,
  "subtype": "success",
  "api_error_status": null,
  "result": "I wrote `out/stock.json`. Closing stock is worth \u00a3334.94 in total, after a \u00a323.32 write-down on TEA-80. No movement ran short of stock.\n\n| SKU | Closing units | Closing value (\u00a3) | Write-down (\u00a3) | COGS (\u00a3) |\n|---|---|---|---|---|\n| OATS-1KG | 100 | 175.50 | none | 317.54 |\n| RICE-2KG | 35 | 45.23 | none | 72.03 |\n| COFFEE-227 | 12 | 22.56 | none | 309.30 |\n| TEA-80 | 195 | 91.65 | 23.32 | 62.73 |\n\nThe stock note disagrees with the rules on two points, so I followed the rules:\n- **Cases:** I converted case quantities to single units on every movement type, not just receipts.\n- **Supplier returns:** They came off the newest layer first, not the oldest.\n\nI also included the write-down, which the note said to leave out.\n\nOne reading call: a positive adjustment takes the unit cost of the most recently received layer, even if that layer has already been used up. The rules don't say what to do in that case.",
  "ttft_ms": 3742,
  "type": "result",
  "duration_ms": 19428,
  "uuid": "[REDACTED]",
  "ttft_stream_ms": 2914,
  "time_to_request_ms": 240,
  "first_content_frame_ms": 2915,
  "queued_turn_count": 0,
  "result_index": 0
 }
]

Get new runs and ranking changes weekly