Skip to content

De-duplicate three copy-pasted report renderers behind one row pipeline and add a Markdown renderer, byte-identical output

Exact prompt

# Task: refactor the report renderers and add Markdown `reports.py` has three copy-pasted renderers. Refactor so the row processing (name default, qty/price parsing, skipping negative qty, line totals, running total/count) lives in **one** place that all renderers use, then add a fourth renderer. Requirements: 1. `render_text`, `render_csv`, `render_html` keep their signatures and produce **byte-identical** output to today for every input (the grader compares against the original on hundreds of random inputs, including odd names and float prices). 2. No function in `reports.py` may be longer than 15 lines (def line to last line, inclusive), and the expression `round(qty * price, 2)` (or any `qty * price` multiplication) must appear exactly once in the file. 3. Add `render_markdown(title, rows, currency="EUR")` producing: ``` ## <title> | Name | Qty | Total | |---|---:|---:| | <name> | <qty> | <line_total with 2 decimals> <currency> | ... | **TOTAL** | <count> | **<total with 2 decimals> <currency>** | ``` followed by a final newline. In names, `|` is escaped as `\|`. Same row rules as the others (default name `(unnamed)`, negative qty rows skipped). Empty `rows` still prints the header and TOTAL lines. Standard library only. No network.

Refactor must preserve subtle behaviour (rounding of each line before summing, truncation with '~', CSV quoting, HTML escaping, string qty/price coercion) while meeting structural limits checked via AST. Original benchmark task written for usecaserank.com (not based on a specific public post). Headless, offline run on a reproducible fixture. Each run's notes say how its cost was measured (estimates are marked).

Success criteria: 1. legacy_identical: render_text/csv/html output is byte-identical to the original on 500 random inputs each. 2. functions_short: no function in reports.py is longer than 15 lines. 3. single_multiplication: `qty * price` appears exactly once in reports.py. 4. markdown_correct: render_markdown matches the specified format on 3 hidden inputs (pipe escaping, default name, skipped negative qty, empty rows, rounding).

Best model for this task so far: Claude Haiku 5.5 (effort default (no --effort flag) · thinking on) (success, $0.0098, 47s).

Run this on another model

All runs (4)

100% pass rate across 4 eligible runs: 4 pass, 0 partial, 0 fail. Partial and failed runs are listed below with everything else.ⓘ

Runs for this use case
ModelCostTimeStep-insⓘAutonomyOutcomeTrustⓘDateCompare
OGPT-6.1 Soldefault · thinking on$0.061m0Fully autonomouspassTrust 80%2026-10-22
AClaude Haiku 5.5default · thinking on$0.009847s0Fully autonomouspassTrust 80%2026-10-17
AClaude Opus 5.5default · thinking on$0.1847s0Fully autonomouspassTrust 80%2026-10-17
AClaude Sonnet 5.5default · thinking on$0.0618s0Fully autonomouspassTrust 80%2026-10-17

Embed this result

A live badge for this use case. It links back here and updates as new runs are published.

UseCaseRank badge for De-duplicate three copy-pasted report renderers behind one row pipeline and add a Markdown renderer, byte-identical output

Get new runs and ranking changes weekly

Which models got better or cheaper on real tasks like this one.