Skip to content

GPT-6.1 Sol (effort default (no reasoning-effort override) · thinking on) on Animate a snow globe that a click shakes, with snow that settles again, in one self-contained HTML file

OGPT-6.1 Soldefault · thinking on · Codex CLI 0.163.0 (codex exec --json) · cloud · 2026-10-22 · by @bobsiopener

Trust 80%Fully autonomoussuccess · first try
Estimated cost
$0.03
Wall time
55s
Human step-ins
0
Outcome
Pass

Compare with other models on this task →

Summary

Exact prompt

# Animate a snow globe that a click shakes, with snow that settles again, in one self-contained HTML file Make a small animated scene: a snow globe. Write one file, `out/scene.html`, that works opened straight from disk with no network access. `spec.json` gives the page title, the stage size and the scene parameters. **Looks are not scored**: the page is opened in a headless browser (800x600 window, UTC time zone, network blocked) and checked by objective tests only. ## Scene contract - Draw the scene on one `<canvas>` or `<svg>` stage of `width` x `height` CSS pixels (spec.json), visible on load, with `<title>` containing spec.json `title`. - Animate continuously from load (`requestAnimationFrame` or timers); no click is needed unless stated below. - Expose `window.sceneState()`, returning the scene's current state in stage pixel coordinates (origin top-left of the stage): `{flakes: [{x, y}, ...]}`. Extra fields are fine. It must describe what is actually drawn. - On load the snow lies settled. A click on the stage (pressing Space as well is fine) shakes it; the snow swirls and must come fully to rest within `settle_s` seconds of the click. - The page must log no errors and throw no exceptions. Keep the file at most 200,000 bytes; no external scripts, fonts, images or URLs (inline everything). ## Checks (partial credit = share passed) 1. `self_contained`: `out/scene.html` exists, is at most 200,000 bytes, references no http(s) or protocol-relative URL, and requests nothing from the network when opened. 2. `has_canvas_or_svg`: a visible `<canvas>` or `<svg>` of at least 300x200 CSS pixels is on the page. 3. `frames_change`: over 3 s, some later screenshot differs from the first in at least 0.1% of pixels, and at least 3 of 30 screenshots differ. 4. `settled_until_shaken`: `sceneState().flakes` has at least `min_flakes` entries and, before any click, no flake moves 0.5 px or more between samples 0.5 s apart. 5. `shake_then_settle`: a click on the stage centre shakes the globe (median flake movement over the next 0.3 s is above 3 px) and, `settle_s` + 1.2 s after the click, no flake moves 0.5 px or more in 0.4 s. 6. `no_console_errors`: no uncaught exception, `console.error` or browser error is logged during the run. ## How this run works - Work on your own: nobody will answer questions in this task, and writing to `ask/` counts against the run. - Write only under `out/`. Create `out/` if it is missing. Inputs are synthetic; don't fetch anything from the network. - Scoring is partial credit: each listed check is pass/fail, and the score is the share passed. Numbers are compared to within 0.005 unless the task says otherwise.

Original benchmark task written for usecaserank.com. Headless, offline run on a reproducible fixture. Cost shown is a list-price API-equivalent estimate (run on a ChatGPT subscription, not billed).

Success criteria: self_contained has_canvas_or_svg frames_change settled_until_shaken shake_then_settle no_console_errors

Setup notes: Use Case Scout batch28 case d02-snow-globe-shake-and-settle (offline fixture). Prepared with batch28/prepare.sh on the shared box; only TASK.md + starting files were copied to the agent machine, hidden key/tests stayed on the box. Prompt = TASK.md verbatim on stdin. Flags: --json -s workspace-write --skip-git-repo-check --ephemeral --ignore-user-config --ignore-rules -C <workdir>. Scored on the box with the scout's scorer: `MEDIA_DIR=<dir> python3 score.py WORKDIR KEYDIR`. Single run, no retries. User-level AGENTS.md (846 bytes, sha256 83ec4fe50da8) may have been in context; --ignore-user-config does not document excluding it. Serving model not confirmed: requested via -m; the event log does not echo the serving model id. Price source is secondary (pricing.json verification='secondary', https://www.actuia.com/en/news/ai-api-pricing-in-october-2026-050-to-50-for-output/), not an official OpenAI price page. Score: 6/6. Cost is an ESTIMATE: measured tokens x pricing.json list price (ChatGPT plan, nothing billed); input_tokens include cached reads; output_tokens include reasoning tokens. Tool calls 2 (0 failed, recovered). Single run.

Estimated cost List-price estimate; not actually billed.

Output

Metrics

Estimated cost
$0.03
Wall time
55s
Human step-ins
0
Turns
1
Model usage
ModelInput tokOutput tokCost
OGPT-6.1 Solopenai/gpt-6.1-soleffort default (no reasoning-effort override) · thinking on48,1451,749$0.03

Reproduce this run

  1. Use the use case prompt on the use case page.
  2. Same setup: GPT-6.1 Sol (openai/gpt-6.1-sol, effort default (no reasoning-effort override) · thinking on) via Codex CLI 0.163.0 (codex exec --json), cloud.
  3. It counts as a success only if it meets every success criterion: self_contained has_canvas_or_svg frames_change settled_until_shaken shake_then_settle no_console_errors
  4. Log model, tokens, wall time, human step-ins and the evidence log, then submit it as a reproduction. A different model? Submit a head-to-head rerun.

How runs are scored: Methodology.

Was this useful?

⇄ Rerun on another model

Automated checks

Trust 80% comes from these checks (how Trust % works).

Evidence log
{"type": "thread.started", "thread_id": "01a1645e-72a1-7321-956c-362198b82131"}
{"type": "turn.started"}
{"type": "item.completed", "item": {"id": "item_0", "type": "agent_message", "text": "I\u2019ll read `spec.json` and build a self-contained scene with settled snow, a click-to-shake animation, and a subtle animation that runs from load."}}
{"type": "item.started", "item": {"id": "item_1", "type": "command_execution", "command": "/bin/bash -lc 'cat spec.json'", "aggregated_output": "", "exit_code": null, "status": "in_progress"}}
{"type": "item.completed", "item": {"id": "item_1", "type": "command_execution", "command": "/bin/bash -lc 'cat spec.json'", "aggregated_output": "{\n \"title\": \"Snow Globe 591\",\n \"width\": 720,\n \"height\": 480,\n \"file\": \"out/scene.html\",\n \"min_flakes\": 45,\n \"settle_s\": 3.5\n}", "exit_code": 0, "status": "completed"}}
{"type": "item.started", "item": {"id": "item_2", "type": "command_execution", "command": "/bin/bash -lc \"mkdir -p out\ncat > out/scene.html <<'EOF'\n<\"'!doctype html>\n<html lang=\"en\">\n<head>\n<meta charset=\"utf-8\">\n<meta name=\"viewport\" content=\"width=device-width,initial-scale=1\">\n<title>Snow Globe 591</title>\n<style>\nhtml,body{margin:0;min-height:100%;background:#101b2d}body{display:grid;place-items:center;min-height:100vh}canvas{display:block;width:720px;height:480px;max-width:none;outline:none}\n</style>\n</head>\n<body>\n<canvas id=\"scene\" width=\"720\" height=\"480\" tabindex=\"0\" aria-label=\"Snow globe. Click to shake the snow.\"></canvas>\n<script>\n'\"'use strict';\nconst canvas=document.getElementById('scene');\nconst ctx=canvas.getContext('2d');\nconst W=720,H=480,CX=360,CY=214,R=170;\nlet seed=591;\nfunction random(){seed=(seed*1664525+1013904223)>>>0;return seed/4294967296;}\nconst flakes=Array.from({length:90},()=>{\n const y=318+random()*48;\n const span=Math.sqrt(R*R-(y-CY)*(y-CY))-7;\n const x=CX+(random()*2-1)*span;\n return {x,y,homeX:x,homeY:y,r:1.5+random()*1.8,phase:random()*Math.PI*2};\n});\nlet shakeStart=null;\nfunction shake(){shakeStart=performance.now();}\ncanvas.addEventListener('click',shake);\ncanvas.addEventListener('keydown',e=>{if(e.code==='Space'){e.preventDefault();shake();}});\nwindow.sceneState=()=>({flakes:flakes.map(f=>({x:f.x,y:f.y}))});\nfunction ellipse(x,y,rx,ry,color){ctx.beginPath();ctx.ellipse(x,y,rx,ry,0,0,Math.PI*2);ctx.fillStyle=color;ctx.fill();}\nfunction draw(now){\n const t=now/1000;\n let p=shakeStart===null?1:Math.min(1,(now-shakeStart)/3500);\n for(const f of flakes){\n  if(p>=1){f.x=f.homeX;f.y=f.homeY;}\n  else{\n   const lift=Math.sin(Math.PI*p);\n   f.y=f.homeY-lift*(145+35*Math.sin(f.phase+7*p));\n   f.x=f.homeX+lift*(75*Math.sin(f.phase+14*p));\n   const dx=f.x-CX,dy=f.y-CY,d=Math.hypot(dx,dy);\n   if(d>R-7){f.x=CX+dx*(R-7)/d;f.y=CY+dy*(R-7)/d;}\n  }\n }\n ctx.fillStyle='#101b2d';ctx.fillRect(0,0,W,H);\n // A slowly changing halo keeps the scene alive while the snow is at rest.\n const glow=ctx.createRadialGradient(CX,CY,35,CX,CY,240);\n glow.addColorStop(0,'rgba(55,117,155,'+(0.35+0.12*Math.sin(t*2))+')');\n glow.addColorStop(1,'rgba(20,35,55,0)');ctx.fillStyle=glow;ctx.fillRect(95,0,530,455);\n ellipse(360,418,173,17,'#09111f');\n ctx.save();ctx.beginPath();ctx.arc(CX,CY,R,0,Math.PI*2);ctx.clip();\n const glass=ctx.createLinearGradient(200,70,500,380);glass.addColorStop(0,'#24475d');glass.addColorStop(1,'#122a3d');ctx.fillStyle=glass;ctx.fillRect(185,40,350,350);\n ellipse(360,365,151,29,'#d1e5ee');\n ctx.fillStyle='#244d4c';\n for(const [x,y,s] of [[310,264,1],[411,280,0.8]]){\n  ctx.fillStyle='#674a3c';ctx.fillRect(x-5,y,10,65*s);\n  ctx.fillStyle='#315e59';ctx.beginPath();ctx.moveTo(x,y-79*s);ctx.lineTo(x-40*s,y+34*s);ctx.lineTo(x+40*s,y+34*s);ctx.closePath();ctx.fill();\n }\n ctx.fillStyle='#c3dbe4';ctx.fillRect(340,294,46,40);ctx.fillStyle='#885a4f';ctx.beginPath();ctx.moveTo(333,297);ctx.lineTo(363,270);ctx.lineTo(394,297);ctx.fill();\n ctx.fillStyle='rgb(255,'+Math.round(195+35*Math.sin(t*3))+',95)';ctx.fillRect(355,306,15,16);\n for(const f of flakes)ellipse(f.x,f.y,f.r,f.r,'#ffffff');\n ctx.restore();\n ctx.strokeStyle='#9dc3d4';ctx.lineWidth=2;ctx.beginPath();ctx.arc(CX,CY,R,0,Math.PI*2);ctx.stroke();\n ctx.strokeStyle='rgba(222,244,255,.32)';ctx.lineWidth=9;ctx.lineCap='round';ctx.beginPath();ctx.arc(CX,CY,R-16,3.65,4.35);ctx.stroke();\n ctx.fillStyle='#79523d';ctx.beginPath();ctx.roundRect(230,372,260,40,12);ctx.fill();\n ctx.fillStyle='#a77b51';ctx.fillRect(241,379,238,5);\n ctx.fillStyle='#e9d4a0';ctx.font='15px Georgia';ctx.textAlign='center';ctx.fillText('WINTER \u2022 591',360,402);\n ctx.fillStyle='#adc3d4';ctx.font='14px sans-serif';ctx.fillText('Click the globe to shake the snow',360,454);\n requestAnimationFrame(draw);\n}\ndraw(performance.now());\n</script>\n</body>\n</html>\nEOF\nnode -e \\\"const fs=require('fs');const s=fs.readFileSync('out/scene.html','utf8');new Function(s.match(/<script>([\\\\\\\\s\\\\\\\\S]*?)<\\\\\\\\/script>/)[1]);console.log('JavaScript syntax valid; file size:',Buffer.byteLength(s),'bytes');\\\"\"", "aggregated_output": "", "exit_code": null, "status": "in_progress"}}
{"type": "item.completed", "item": {"id": "item_2", "type": "command_execution", "command": "/bin/bash -lc \"mkdir -p out\ncat > out/scene.html <<'EOF'\n<\"'!doctype html>\n<html lang=\"en\">\n<head>\n<meta charset=\"utf-8\">\n<meta name=\"viewport\" content=\"width=device-width,initial-scale=1\">\n<title>Snow Globe 591</title>\n<style>\nhtml,body{margin:0;min-height:100%;background:#101b2d}body{display:grid;place-items:center;min-height:100vh}canvas{display:block;width:720px;height:480px;max-width:none;outline:none}\n</style>\n</head>\n<body>\n<canvas id=\"scene\" width=\"720\" height=\"480\" tabindex=\"0\" aria-label=\"Snow globe. Click to shake the snow.\"></canvas>\n<script>\n'\"'use strict';\nconst canvas=document.getElementById('scene');\nconst ctx=canvas.getContext('2d');\nconst W=720,H=480,CX=360,CY=214,R=170;\nlet seed=591;\nfunction random(){seed=(seed*1664525+1013904223)>>>0;return seed/4294967296;}\nconst flakes=Array.from({length:90},()=>{\n const y=318+random()*48;\n const span=Math.sqrt(R*R-(y-CY)*(y-CY))-7;\n const x=CX+(random()*2-1)*span;\n return {x,y,homeX:x,homeY:y,r:1.5+random()*1.8,phase:random()*Math.PI*2};\n});\nlet shakeStart=null;\nfunction shake(){shakeStart=performance.now();}\ncanvas.addEventListener('click',shake);\ncanvas.addEventListener('keydown',e=>{if(e.code==='Space'){e.preventDefault();shake();}});\nwindow.sceneState=()=>({flakes:flakes.map(f=>({x:f.x,y:f.y}))});\nfunction ellipse(x,y,rx,ry,color){ctx.beginPath();ctx.ellipse(x,y,rx,ry,0,0,Math.PI*2);ctx.fillStyle=color;ctx.fill();}\nfunction draw(now){\n const t=now/1000;\n let p=shakeStart===null?1:Math.min(1,(now-shakeStart)/3500);\n for(const f of flakes){\n  if(p>=1){f.x=f.homeX;f.y=f.homeY;}\n  else{\n   const lift=Math.sin(Math.PI*p);\n   f.y=f.homeY-lift*(145+35*Math.sin(f.phase+7*p));\n   f.x=f.homeX+lift*(75*Math.sin(f.phase+14*p));\n   const dx=f.x-CX,dy=f.y-CY,d=Math.hypot(dx,dy);\n   if(d>R-7){f.x=CX+dx*(R-7)/d;f.y=CY+dy*(R-7)/d;}\n  }\n }\n ctx.fillStyle='#101b2d';ctx.fillRect(0,0,W,H);\n // A slowly changing halo keeps the scene alive while the snow is at rest.\n const glow=ctx.createRadialGradient(CX,CY,35,CX,CY,240);\n glow.addColorStop(0,'rgba(55,117,155,'+(0.35+0.12*Math.sin(t*2))+')');\n glow.addColorStop(1,'rgba(20,35,55,0)');ctx.fillStyle=glow;ctx.fillRect(95,0,530,455);\n ellipse(360,418,173,17,'#09111f');\n ctx.save();ctx.beginPath();ctx.arc(CX,CY,R,0,Math.PI*2);ctx.clip();\n const glass=ctx.createLinearGradient(200,70,500,380);glass.addColorStop(0,'#24475d');glass.addColorStop(1,'#122a3d');ctx.fillStyle=glass;ctx.fillRect(185,40,350,350);\n ellipse(360,365,151,29,'#d1e5ee');\n ctx.fillStyle='#244d4c';\n for(const [x,y,s] of [[310,264,1],[411,280,0.8]]){\n  ctx.fillStyle='#674a3c';ctx.fillRect(x-5,y,10,65*s);\n  ctx.fillStyle='#315e59';ctx.beginPath();ctx.moveTo(x,y-79*s);ctx.lineTo(x-40*s,y+34*s);ctx.lineTo(x+40*s,y+34*s);ctx.closePath();ctx.fill();\n }\n ctx.fillStyle='#c3dbe4';ctx.fillRect(340,294,46,40);ctx.fillStyle='#885a4f';ctx.beginPath();ctx.moveTo(333,297);ctx.lineTo(363,270);ctx.lineTo(394,297);ctx.fill();\n ctx.fillStyle='rgb(255,'+Math.round(195+35*Math.sin(t*3))+',95)';ctx.fillRect(355,306,15,16);\n for(const f of flakes)ellipse(f.x,f.y,f.r,f.r,'#ffffff');\n ctx.restore();\n ctx.strokeStyle='#9dc3d4';ctx.lineWidth=2;ctx.beginPath();ctx.arc(CX,CY,R,0,Math.PI*2);ctx.stroke();\n ctx.strokeStyle='rgba(222,244,255,.32)';ctx.lineWidth=9;ctx.lineCap='round';ctx.beginPath();ctx.arc(CX,CY,R-16,3.65,4.35);ctx.stroke();\n ctx.fillStyle='#79523d';ctx.beginPath();ctx.roundRect(230,372,260,40,12);ctx.fill();\n ctx.fillStyle='#a77b51';ctx.fillRect(241,379,238,5);\n ctx.fillStyle='#e9d4a0';ctx.font='15px Georgia';ctx.textAlign='center';ctx.fillText('WINTER \u2022 591',360,402);\n ctx.fillStyle='#adc3d4';ctx.font='14px sans-serif';ctx.fillText('Click the globe to shake the snow',360,454);\n requestAnimationFrame(draw);\n}\ndraw(performance.now());\n</script>\n</body>\n</html>\nEOF\nnode -e \\\"const fs=require('fs');const s=fs.readFileSync('out/scene.html','utf8');new Function(s.match(/<script>([\\\\\\\\s\\\\\\\\S]*?)<\\\\\\\\/script>/)[1]);console.log('JavaScript syntax valid; file size:',Buffer.byteLength(s),'bytes');\\\"\"", "aggregated_output": "JavaScript syntax valid; file size: 3703 bytes\n", "exit_code": 0, "status": "completed"}}
{"type": "item.completed", "item": {"id": "item_3", "type": "agent_message", "text": "Created [out/scene.html](out/scene.html): a self-contained 720\u00d7480 snow globe with 90 flakes, click-to-shake behavior, and settling within 3.5 seconds.\n\nJavaScript syntax validated; file size is 3,703 bytes."}}
{"type": "turn.completed", "usage": {"input_tokens": 48145, "cached_input_tokens": 44544, "cache_write_input_tokens": 0, "output_tokens": 1749, "reasoning_output_tokens": 123}}

Get new runs and ranking changes weekly