Claude Haiku 5.5 (effort default (no --effort flag) · thinking on) on Fill and submit job applications from a resume

AClaude Haiku 5.5default · thinking on · Claude Code 2.1.299 (headless -p) · cloud · 2026-10-16 · by @bobsiopener

Trust 80%Fully autonomoussuccess · first tryCompare

Estimated cost: $0.0044
Wall time: 17s
Human step-ins: 0
Outcome: Pass

Compare with other models on this task →

Exact prompt

This is a sandboxed mock job portal. resume.json is the candidate. forms/ has two job application forms (field definitions). For each form, write a JSON file {"job_id": ..., "answers": {field_name: value}} filled truthfully from the resume (never invent facts), then submit it with: python3 submit.py <file>. Fix and resubmit if rejected. Both applications must end up SUBMITTED.

Task prompt given to the agent (headless, offline, synthetic fixture inputs): This is a sandboxed mock job portal. resume.json is the candidate. forms/ has two job application forms (field definitions). For each form, write a JSON file {"job_id": ..., "answers": {field_name: value}} filled truthfully from the resume (never invent facts), then submit it with: python3 submit.py <file>. Fix and resubmit if rejected. Both applications must end up SUBMITTED. Inspired by https://x.com/SAkasxh/status/2104655629021565156 (unverified; not checked with the author). This is an independent re-run on a reproducible synthetic task; it does not report or reproduce the original post's numbers. Cost shown is a list-price API-equivalent estimate (run on a Claude Pro subscription, not billed).

Success criteria: All automated rubric checks pass: ACME submitted; Globex submitted; ACME identity fields match resume; ACME years_experience = 6-9; ACME authorized = yes; ACME skills only from resume; Globex names/title/email match; Globex relocation false; Globex salary = 165000; Globex linkedin from resume (if given).

Setup notes: Cost is an ESTIMATE: Claude Code's list-price API-equivalent figure. The run used a Claude Pro subscription, so nothing was billed. input_tokens = all input incl. cache-creation and cache-read tokens; cached_tokens = cache reads (subset of input). Claude Code's cost bills cache writes at the 1h cache-write premium, so it can differ from a flat input-price recompute. Web disabled; tools Read/Write/Edit/Glob/Grep/Bash; single run; scored automatically (10/10 checks).

Estimated cost List-price estimate; not actually billed.

Metrics

Estimated cost: $0.0044
Wall time: 17s
Human step-ins: 0
Turns: 5

Model usage
Model	Input tok	Output tok	Cost
AClaude Haiku 5.5anthropic/claude-haiku-5.5effort default (no --effort flag) · thinking on	86,106	2,873	$0.0044

Reproduce this run

Use the use case prompt on the use case page.
Same setup: Claude Haiku 5.5 (anthropic/claude-haiku-5.5, effort default (no --effort flag) · thinking on) via Claude Code 2.1.299 (headless -p), cloud.
It counts as a success only if it meets every success criterion: All automated rubric checks pass: ACME submitted; Globex submitted; ACME identity fields match resume; ACME years_experience = 6-9; ACME authorized = yes; ACME skills only from resume; Globex names/title/email match; Globex relocation false; Globex salary = 165000; Globex linkedin from resume (if given).
Log model, tokens, wall time, human step-ins and the evidence log, then submit it as a reproduction. A different model? Submit a head-to-head rerun.

How runs are scored: Methodology.

Was this useful?

⇄ Rerun on another model

Automated checks

Trust 80% comes from these checks (how Trust % works).

Run date is not in the future : passed
Model is in the dated pricing table : passed
Cost recomputed from tokens matches : passed
Cached tokens are consistent : passed
Output throughput is plausible : passed
Autonomy matches step-ins : passed
Step-ins do not exceed turns : passed
Retries agree with first-try result : passed
Evidence log SHA-256 matches : passed
Evidence log is substantial : passed

Evidence log

{
 "duration_api_ms": 15799,
 "stop_reason": "end_turn",
 "session_id": "[REDACTED]",
 "total_cost_usd": 0.0043561699999999995,
 "usage": {
  "input_tokens": 8,
  "cache_creation_input_tokens": 10831,
  "cache_read_input_tokens": 75267,
  "output_tokens": 2873,
  "output_tokens_details": {
   "thinking_tokens": 1277
  },
  "server_tool_use": {
   "web_search_requests": 0,
   "web_fetch_requests": 0
  },
  "service_tier": "standard",
  "cache_creation": {
   "ephemeral_1h_input_tokens": 10831,
   "ephemeral_5m_input_tokens": 0
  },
  "inference_geo": "global",
  "iterations": [
   {
    "input_tokens": 2,
    "output_tokens": 433,
    "cache_read_input_tokens": 23139,
    "cache_creation_input_tokens": 231,
    "cache_creation": {
     "ephemeral_5m_input_tokens": 0,
     "ephemeral_1h_input_tokens": 231
    },
    "type": "message"
   }
  ],
  "speed": "standard",
  "fallback_credit": null
 },
 "modelUsage": {
  "claude-haiku-5-5": {
   "inputTokens": 8,
   "outputTokens": 2873,
   "cacheReadInputTokens": 75267,
   "cacheCreationInputTokens": 10831,
   "webSearchRequests": 0,
   "costUSD": 0.0043561699999999995,
   "contextWindow": 1000000,
   "maxOutputTokens": 128000,
   "thinkingTokens": 1277,
   "canonicalModel": "claude-haiku-5-5",
   "provider": "firstParty",
   "costBasis": "list"
  }
 },
 "permission_denials": [],
 "terminal_reason": "completed",
 "fast_mode_state": "off",
 "fast_mode_disabled_reason": "sdk_opt_in_required",
 "subagent_stats": {
  "spawned": 0,
  "requested": {
   "background": 0,
   "foreground": 0,
   "unset": 0
  },
  "started_in_background": 0,
  "max_depth": 0,
  "spawned_by_subagents": 0,
  "completed": 0,
  "failed": 0,
  "killed": {
   "parent": 0,
   "user": 0,
   "system": 0
  },
  "refused": {
   "depth_limit": 0,
   "concurrency_limit": 0,
   "budget": 0
  },
  "by_type": {}
 },
 "safety_stops": 0,
 "is_error": false,
 "num_turns": 5,
 "subtype": "success",
 "api_error_status": null,
 "result": "Both applications are submitted: ACME-1042 (Data Engineer) and GLX-77 (Analytics Engineer). Each was accepted on the first attempt, so no resubmission was needed.\n\nThe answer files are in `answers/` and the submitted copies are in `submitted/`.\n\nChoices I made that you may want to review:\n- **Acme `years_experience`:** \"6-9\", since the resume says 7 years.\n- **Acme `top_skills`:** Python, SQL, Spark. The form allows 3, and Dana's resume also lists dbt and Airflow, which I left out. Java and Kafka are not on the resume.\n- **Acme `why_acme`:** This is the one answer that is partly the candidate's own motivation, which the resume does not contain. I wrote it from resume facts only and kept the reason for applying generic. It does not claim anything about Acme beyond the job title. Dana should read it before this is treated as final.\n- **Globex `open_to_relocation`:** `false`, matching `willing_to_relocate: false` on the resume.\n- **Globex `linkedin_url`:** Included, since the resume has it and the field is optional.\n- **Globex `cover_note`:** Written from resume facts only, with no claims about Globex.",
 "ttft_ms": 1658,
 "type": "result",
 "duration_ms": 16169,
 "uuid": "[REDACTED]",
 "ttft_stream_ms": 1417,
 "time_to_request_ms": 227,
 "first_content_frame_ms": 1418,
 "queued_turn_count": 0,
 "result_index": 0
}