Animate a flickering carved pumpkin on a spooky night in one self-contained HTML file
Exact prompt
# Animate a flickering carved pumpkin on a spooky night in one self-contained HTML file Make a small animated scene: a jack-o'-lantern. Write one file, `out/scene.html`, that works opened straight from disk with no network access. `spec.json` gives the page title, the stage size and the scene parameters. **Looks are not scored**: the page is opened in a headless browser (800x600 window, UTC time zone, network blocked) and checked by objective tests only. ## Scene contract - Draw the scene on one `<canvas>` or `<svg>` stage of `width` x `height` CSS pixels (spec.json), visible on load, with `<title>` containing spec.json `title`. - Animate continuously from load (`requestAnimationFrame` or timers); no click is needed unless stated below. - Expose `window.sceneState()`, returning the scene's current state in stage pixel coordinates (origin top-left of the stage): `{flame: <number 0..1, the candle brightness now>, pumpkin: {x, y, r}}`. Extra fields are fine. It must describe what is actually drawn. - `pumpkin` is the pumpkin's centre and radius in stage pixels. It is night: keep the page corners and the top-centre edge dark. - The page must log no errors and throw no exceptions. Keep the file at most 200,000 bytes; no external scripts, fonts, images or URLs (inline everything). ## Checks (partial credit = share passed) 1. `self_contained`: `out/scene.html` exists, is at most 200,000 bytes, references no http(s) or protocol-relative URL, and requests nothing from the network when opened. 2. `has_canvas_or_svg`: a visible `<canvas>` or `<svg>` of at least 300x200 CSS pixels is on the page. 3. `frames_change`: over 3 s, some later screenshot differs from the first in at least 0.1% of pixels, and at least 3 of 30 screenshots differ. 4. `flame_flickers`: across 30 samples over 3 s, `sceneState().flame` stays within 0 to 1, takes at least 6 distinct values (to 3 dp) and spans at least 0.15. 5. `glow_and_night`: the pumpkin (`r` at least 40, centre inside the stage) visibly changes within its box between the first screenshot and a later one over 3 s, and the four page corners and the top centre stay dark (average RGB below 90). 6. `no_console_errors`: no uncaught exception, `console.error` or browser error is logged during the run. ## How this run works - Work on your own: nobody will answer questions in this task, and writing to `ask/` counts against the run. - Write only under `out/`. Create `out/` if it is missing. Inputs are synthetic; don't fetch anything from the network. - Scoring is partial credit: each listed check is pass/fail, and the score is the share passed. Numbers are compared to within 0.005 unless the task says otherwise.
Original benchmark task written for usecaserank.com. Headless, offline run on a reproducible fixture. Cost shown is a list-price API-equivalent estimate (run on a Google account via Antigravity CLI, not billed per token).
Success criteria: self_contained has_canvas_or_svg frames_change flame_flickers glow_and_night no_console_errors
Best model for this task so far: Claude Haiku 5.5 (effort default (no --effort flag) · thinking on) (success, $0.0087, 42s). Best AI model for Creative / Animated Scene (one HTML File) →
Latest output per model
All runs (6)
100% pass rate across 6 eligible runs: 6 pass, 0 partial, 0 fail. Partial and failed runs are listed below with everything else.ⓘ
| Model | Cost | Time | Step-insⓘ | Autonomy | Outcome | Trustⓘ | Date | Compare |
|---|---|---|---|---|---|---|---|---|
| AClaude Opus 5.5default · thinking on | $0.20 | 48s | 0 | Fully autonomous | pass | Trust 80% | 2026-10-22 | |
| AClaude Haiku 5.5default · thinking on | $0.0087 | 42s | 0 | Fully autonomous | pass | Trust 80% | 2026-10-22 | |
| AClaude Sonnet 5.5default · thinking on | $0.06 | 20s | 0 | Fully autonomous | pass | Trust 80% | 2026-10-22 | |
| GGemini 4 Argonmedium · thinking on | $0.16 | 3m | 0 | Fully autonomous | pass | Trust 80% | 2026-10-22 | |
| OGPT-6.1 Soldefault · thinking off | $0.05 | 58s | 0 | Fully autonomous | pass | Trust 80% | 2026-10-22 | |
| GGemini 3.8 Flashmedium · thinking on | $0.33 | 3m | 0 | Fully autonomous | pass | Trust 80% | 2026-10-22 |
Embed this result
A live badge for this use case. It links back here and updates as new runs are published.
Get new runs and ranking changes weekly
Which models got better or cheaper on real tasks like this one.