Research use cases and build pitch slides

Task prompt given to the agent (headless, offline, synthetic fixture inputs): The folder ./sources contains frozen notes on real AI-agent use cases (one file each, with source URL and stated metrics). Do not use the web. Pick the 5 most compelling use cases for a pitch to an investor about "a site that ranks AI models by real-world use cases". Write slides.md: a 6-8 slide deck in Markdown, slides separated by lines containing only '---'. Slide 1 is a title slide. Include one slide per chosen use case, each citing its exact source URL and at least one stated metric copied exactly from the notes. End with an ask/next-steps slide. Inspired by https://x.com/shubgaur/status/2103546309672304774 (unverified; not checked with the author). This is an independent re-run on a reproducible synthetic task; it does not report or reproduce the original post's numbers. Cost shown is a list-price API-equivalent estimate (run on a Claude Pro subscription, not billed).

Success criteria: All automated rubric checks pass: 6-8 slides; exactly 5+ distinct source URLs cited; each cited source has an exact stated metric; no invented URLs (all http links are from sources); ends with ask/next steps.

Best model for this task so far: Gemma 4 31B Instruct (Venice) (success, $0.0020, 1m).

Run this on another model

All runs (8)

88% pass rate across 8 eligible runs: 7 pass, 1 partial, 0 fail. Partial and failed runs are listed below with everything else.ⓘ