Skip to content

Claude Haiku 5.5 (effort default (no --effort flag) · thinking on) on Extract 40 fields from a 125k-token RFP into JSON

AClaude Haiku 5.5default · thinking on · Claude Code 2.1.299 (headless -p) · cloud · 2026-10-16 · by @bobsiopener

Trust 80%Fully autonomoussuccess · first try
Estimated cost
$0.03
Wall time
43s
Human step-ins
0
Outcome
Pass

Compare with other models on this task →

Summary

Exact prompt

CHUNK PROMPT (sent once per half, n=1,2): Standard input contains PART {n} OF 2 of a long Request for Proposals (RFP); the other part is processed separately and the results are merged afterwards. For each of the 40 fields below, reply with ONLY a JSON object (no prose, no code fence) mapping each field name to {{"value": ..., "quote": "<verbatim supporting quote, max 25 words>"}}, or to null if this part does not state it. Use YYYY-MM-DD for dates, plain numbers without $ signs or commas for numeric fields, and true/false for booleans. If the document later amends a value (for example in an addendum), report the final amended value. If a field is not stated in the text you were given, use null. Do not use any tools. Fields: - issuing_agency: name of the agency issuing the RFP - rfp_number: RFP/solicitation number - project_title: official project title - procurement_officer_name: name of the single point of contact / procurement officer - procurement_officer_email: procurement officer email - procurement_officer_phone: procurement officer phone - rfp_issue_date: date the RFP was issued (YYYY-MM-DD) - questions_deadline: final deadline for written questions (YYYY-MM-DD) - pre_proposal_conference_date: pre-proposal conference date (YYYY-MM-DD) - pre_proposal_conference_mandatory: is attendance at the pre-proposal conference mandatory (true/false) - proposal_due_date: final proposal due date (YYYY-MM-DD) - proposal_due_time: proposal due time incl. time zone - submission_method: how proposals must be submitted - number_of_hard_copies: number of printed hard copies required (integer, 0 if none) - technical_proposal_page_limit: page limit for the technical proposal (integer) - minimum_font_size_pt: minimum font size in points (number) - proposal_validity_days: days the proposal must remain valid (integer) - contract_term_years: initial contract term in years (integer) - renewal_options_count: number of optional renewal periods (integer) - not_to_exceed_budget_usd: not-to-exceed budget for THIS procurement in USD (number) - bid_bond_percent: bid bond as % of proposed price (number) - performance_bond_percent: performance bond as % of contract value (number) - general_liability_per_occurrence_usd: prime contractor's commercial general liability per-occurrence limit in USD (number) - cyber_liability_usd: cyber/network security liability limit in USD (number) - liquidated_damages_per_day_usd: liquidated damages per calendar day in USD (number) - go_live_date: required production go-live date (YYYY-MM-DD) - uptime_sla_percent: monthly availability SLA in percent (number) - p1_response_time_hours: vendor response time for Priority 1 / critical incidents in hours (number) - data_retention_years: years records must be retained (integer) - eval_weight_technical: evaluation weight (points or %) for technical approach - eval_weight_cost: evaluation weight for cost/price - eval_weight_experience: evaluation weight for experience/qualifications - eval_weight_local_business: evaluation weight for local business preference - min_reference_projects: minimum number of comparable reference projects required (integer) - min_years_in_business: minimum years the proposer must have been in business (integer) - dbe_goal_percent: DBE/disadvantaged business participation goal in % (number) - retainage_percent: retainage withheld from each payment in % (number) - payment_terms_days: days after approved invoice that payment is made (integer) - max_concurrent_users: number of concurrent users the system must support (integer) - asset_records_to_migrate: number of asset records to be migrated (integer) MERGE PROMPT (template; {a},{b} = the two chunk replies): Two partial extractions of the same RFP are below, one per half of the document (part 2 is the later half and includes any attachments/addenda). Each maps field -> {{value, quote}} or null. Merge them into ONE final JSON object with exactly the 40 field names as keys and plain values (no quotes objects). When the parts conflict, use the quotes to decide which value is final (later amendments supersede original values). Reply with ONLY the JSON object. Do not use any tools. PART 1 EXTRACTION: {a} PART 2 EXTRACTION: {b}

Pulling 40 fields out of a roughly 125k-token request-for-proposals document, either in one prompt or in two halves merged afterwards. The document hides three addendum overrides and several near-miss values. It measures accuracy and how the price changes when a single prompt crosses a 100k-token long-context pricing threshold. Original benchmark task written for usecaserank.com (not based on a specific public post). Headless, offline run on a reproducible fixture. Each run's notes say how its cost was measured (estimates are marked).

Success criteria: Field-level accuracy ≥ 95% against a hand-labelled key.

Setup notes: Synthetic 40-field RFP (~371k chars, generated by batch2/p05/gen.py, seed 20261016) with 3 addendum overrides and 4 distractor values. Mode 'chunked': each half sent in its own prompt via stdin, then a third small call by the same model merges the two partial extractions. All tools disabled (pure in-context extraction). Scored automatically against answer_key.json (exact match after normalization). The input document was generated synthetically by a script (not a real RFP). Run variant: mode=chunked. Claude Code's own reported cost for claude-haiku-5.5: $0.03282. Score: 40/40. Cost is an ESTIMATE: measured tokens x pricing.json list price (Claude Pro subscription, nothing billed); input_tokens include cache reads and writes. Single run. Comparison on this use case: whole document in one prompt (about 132k input tokens) vs chunked (two prompts of about 71k-74k tokens, each under 100k, plus a small merge call by the same model), each on Haiku 5.5 and Sonnet 5.5. Price-cliff context: in pricing.json, a Haiku 5.5 request whose prompt is over 100,000 input tokens is billed at long-context rates (5x: $0.50/M input, $2.50/M output instead of $0.10/$0.50); Sonnet 5.5 has no long-context tier there. So only the Haiku whole-document run crosses the cliff.

Estimated cost List-price estimate; not actually billed.

Metrics

Estimated cost
$0.03
Wall time
43s
Human step-ins
0
Turns
3
Model usage
ModelInput tokOutput tokCost
AClaude Haiku 5.5anthropic/claude-haiku-5.5effort default (no --effort flag) · thinking on162,09111,376$0.03

Reproduce this run

  1. Use the use case prompt on the use case page.
  2. Same setup: Claude Haiku 5.5 (anthropic/claude-haiku-5.5, effort default (no --effort flag) · thinking on) via Claude Code 2.1.299 (headless -p), cloud.
  3. It counts as a success only if it meets every success criterion: Field-level accuracy ≥ 95% against a hand-labelled key.
  4. Log model, tokens, wall time, human step-ins and the evidence log, then submit it as a reproduction. A different model? Submit a head-to-head rerun.

How runs are scored: Methodology.

Was this useful?

⇄ Rerun on another model

Automated checks

Trust 80% comes from these checks (how Trust % works).

Evidence log
[
 {
  "duration_api_ms": 21263,
  "stop_reason": "end_turn",
  "session_id": "[REDACTED]",
  "total_cost_usd": 0.015655730000000003,
  "usage": {
   "input_tokens": 2,
   "cache_creation_input_tokens": 62934,
   "cache_read_input_tokens": 9273,
   "output_tokens": 5952,
   "output_tokens_details": {
    "thinking_tokens": 3963
   },
   "server_tool_use": {
    "web_search_requests": 0,
    "web_fetch_requests": 0
   },
   "service_tier": "standard",
   "cache_creation": {
    "ephemeral_1h_input_tokens": 62934,
    "ephemeral_5m_input_tokens": 0
   },
   "inference_geo": "global",
   "iterations": [
    {
     "input_tokens": 2,
     "output_tokens": 5952,
     "cache_read_input_tokens": 9273,
     "cache_creation_input_tokens": 62934,
     "cache_creation": {
      "ephemeral_5m_input_tokens": 0,
      "ephemeral_1h_input_tokens": 62934
     },
     "type": "message"
    }
   ],
   "speed": "standard",
   "fallback_credit": null
  },
  "modelUsage": {
   "claude-haiku-5-5": {
    "inputTokens": 2,
    "outputTokens": 5952,
    "cacheReadInputTokens": 9273,
    "cacheCreationInputTokens": 62934,
    "webSearchRequests": 0,
    "costUSD": 0.015655730000000003,
    "contextWindow": 1000000,
    "maxOutputTokens": 128000,
    "thinkingTokens": 3963,
    "canonicalModel": "claude-haiku-5-5",
    "provider": "firstParty",
    "costBasis": "list"
   }
  },
  "permission_denials": [],
  "terminal_reason": "completed",
  "fast_mode_state": "off",
  "fast_mode_disabled_reason": "sdk_opt_in_required",
  "subagent_stats": {
   "spawned": 0,
   "requested": {
    "background": 0,
    "foreground": 0,
    "unset": 0
   },
   "started_in_background": 0,
   "max_depth": 0,
   "spawned_by_subagents": 0,
   "completed": 0,
   "failed": 0,
   "killed": {
    "parent": 0,
    "user": 0,
    "system": 0
   },
   "refused": {
    "depth_limit": 0,
    "concurrency_limit": 0,
    "budget": 0
   },
   "by_type": {}
  },
  "safety_stops": 0,
  "is_error": false,
  "num_turns": 1,
  "subtype": "success",
  "api_error_status": null,
  "result": "{\"issuing_agency\": {\"value\": \"Harlow Valley Regional Water Authority\", \"quote\": \"This Request for Proposals (RFP) No. HVRWA-2026-0417 is issued by the Harlow Valley Regional Water Authority\"}, \"rfp_number\": {\"value\": \"HVRWA-2026-0417\", \"quote\": \"This Request for Proposals (RFP) No. HVRWA-2026-0417 is issued by the Harlow Valley Regional Water Authority\"}, \"project_title\": {\"value\": \"Enterprise Asset Management and Work Order System Replacement\", \"quote\": \"for the Enterprise Asset Management and Work Order System Replacement project.\"}, \"procurement_officer_name\": {\"value\": \"Delphine Okafor\", \"quote\": \"must be directed solely to the Authority's Procurement Officer, Delphine Okafor\"}, \"procurement_officer_email\": {\"value\": \"[REDACTED:email]\", \"quote\": \"by email at [REDACTED:email]\"}, \"procurement_officer_phone\": {\"value\": \"[REDACTED:phone]\", \"quote\": \"by telephone at [REDACTED:phone].\"}, \"rfp_issue_date\": {\"value\": \"2026-11-02\", \"quote\": \"issued by the Harlow Valley Regional Water Authority (the Authority) on November 2, 2026\"}, \"questions_deadline\": {\"value\": \"2026-11-20\", \"quote\": \"Written questions must be received no later than November 20, 2026.\"}, \"pre_proposal_conference_date\": {\"value\": \"2026-11-13\", \"quote\": \"A pre-proposal conference will be held on November 13, 2026 at 10:00 AM at the Authority's Operations Center.\"}, \"pre_proposal_conference_mandatory\": {\"value\": false, \"quote\": \"Attendance is strongly encouraged but is not mandatory; proposers who do not attend will not be penalized.\"}, \"proposal_due_date\": {\"value\": \"2026-12-15\", \"quote\": \"Proposals must be received no later than 2:00 PM Eastern on December 15, 2026.\"}, \"proposal_due_time\": {\"value\": \"2:00 PM Eastern\", \"quote\": \"Proposals must be received no later than 2:00 PM Eastern on December 15, 2026.\"}, \"submission_method\": {\"value\": \"Electronic submission via the Authority's eBid portal, plus two printed hard copies delivered to the Procurement Office within two business days after the electronic deadline\", \"quote\": \"Proposals shall be submitted electronically via the Authority's eBid portal.\"}, \"number_of_hard_copies\": {\"value\": 2, \"quote\": \"the proposer shall deliver two (2) printed hard copies of the complete proposal to the Procurement Office within two business days\"}, \"technical_proposal_page_limit\": {\"value\": 40, \"quote\": \"The Technical Proposal shall not exceed forty (40) pages, excluding resumes, required forms, and the cost proposal.\"}, \"minimum_font_size_pt\": {\"value\": 11, \"quote\": \"Text shall be no smaller than 11-point font with one-inch margins.\"}, \"proposal_validity_days\": {\"value\": 180, \"quote\": \"Proposals shall remain valid and irrevocable for one hundred eighty (180) days following the proposal due date.\"}, \"contract_term_years\": {\"value\": 5, \"quote\": \"The initial term of the resulting contract shall be five (5) years from the Notice to Proceed.\"}, \"renewal_options_count\": {\"value\": 2, \"quote\": \"The Authority may, at its sole discretion, renew the contract for up to two (2) additional one-year periods.\"}, \"not_to_exceed_budget_usd\": {\"value\": 3850000, \"quote\": \"The not-to-exceed budget for this procurement, inclusive of all implementation, licensing for the initial term, data migration, and training, is $3,850,000.\"}, \"bid_bond_percent\": {\"value\": 5, \"quote\": \"Each proposal must be accompanied by a bid bond in the amount of five percent (5%) of the total proposed price.\"}, \"performance_bond_percent\": {\"value\": 100, \"quote\": \"The successful proposer shall furnish a performance bond equal to one hundred percent (100%) of the contract value within ten days of award.\"}, \"general_liability_per_occurrence_usd\": {\"value\": 2000000, \"quote\": \"The Contractor shall maintain commercial general liability insurance with limits of not less than $2,000,000 per occurrence and $4,000,000 aggregate.\"}, \"cyber_liability_usd\": {\"value\": 5000000, \"quote\": \"The Contractor shall also maintain cyber and network security liability coverage of not less than $5,000,000.\"}, \"liquidated_damages_per_day_usd\": {\"value\": 1500, \"quote\": \"the Contractor shall pay the Authority liquidated damages of $1,500 per calendar day of delay\"}, \"go_live_date\": {\"value\": \"2028-03-31\", \"quote\": \"The new system must be fully in production (go-live) no later than March 31, 2028.\"}, \"uptime_sla_percent\": {\"value\": 99.9, \"quote\": \"The hosted solution shall achieve monthly availability of at least 99.9 percent, excluding scheduled maintenance windows announced at least five days in advance.\"}, \"p1_response_time_hours\": {\"value\": 2, \"quote\": \"For Priority 1 (critical) incidents the vendor shall respond within two (2) hours, 24x7.\"}, \"data_retention_years\": {\"value\": 10, \"quote\": \"shall be retained in the system for a minimum of ten (10) years, consistent with the State Records Retention Schedule\"}, \"eval_weight_technical\": null, \"eval_weight_cost\": null, \"eval_weight_experience\": null, \"eval_weight_local_business\": null, \"min_reference_projects\": null, \"min_years_in_business\": null, \"dbe_goal_percent\": null, \"retainage_percent\": null, \"payment_terms_days\": null, \"max_concurrent_users\": null, \"asset_records_to_migrate\": null}",
  "ttft_ms": 16344,
  "type": "result",
  "duration_ms": 21507,
  "uuid": "[REDACTED]",
  "ttft_stream_ms": 3235,
  "time_to_request_ms": 237,
  "first_content_frame_ms": 3236,
  "queued_turn_count": 0,
  "result_index": 0
 },
 {
  "duration_api_ms": 13738,
  "stop_reason": "end_turn",
  "session_id": "[REDACTED]",
  "total_cost_usd": 0.014974630000000003,
  "usage": {
   "input_tokens": 2,
   "cache_creation_input_tokens": 65046,
   "cache_read_input_tokens": 9273,
   "output_tokens": 3745,
   "output_tokens_details": {
    "thinking_tokens": 2568
   },
   "server_tool_use": {
    "web_search_requests": 0,
    "web_fetch_requests": 0
   },
   "service_tier": "standard",
   "cache_creation": {
    "ephemeral_1h_input_tokens": 65046,
    "ephemeral_5m_input_tokens": 0
   },
   "inference_geo": "global",
   "iterations": [
    {
     "input_tokens": 2,
     "output_tokens": 3745,
     "cache_read_input_tokens": 9273,
     "cache_creation_input_tokens": 65046,
     "cache_creation": {
      "ephemeral_5m_input_tokens": 0,
      "ephemeral_1h_input_tokens": 65046
     },
     "type": "message"
    }
   ],
   "speed": "standard",
   "fallback_credit": null
  },
  "modelUsage": {
   "claude-haiku-5-5": {
    "inputTokens": 2,
    "outputTokens": 3745,
    "cacheReadInputTokens": 9273,
    "cacheCreationInputTokens": 65046,
    "webSearchRequests": 0,
    "costUSD": 0.014974630000000003,
    "contextWindow": 1000000,
    "maxOutputTokens": 128000,
    "thinkingTokens": 2568,
    "canonicalModel": "claude-haiku-5-5",
    "provider": "firstParty",
    "costBasis": "list"
   }
  },
  "permission_denials": [],
  "terminal_reason": "completed",
  "fast_mode_state": "off",
  "fast_mode_disabled_reason": "sdk_opt_in_required",
  "subagent_stats": {
   "spawned": 0,
   "requested": {
    "background": 0,
    "foreground": 0,
    "unset": 0
   },
   "started_in_background": 0,
   "max_depth": 0,
   "spawned_by_subagents": 0,
   "completed": 0,
   "failed": 0,
   "killed": {
    "parent": 0,
    "user": 0,
    "system": 0
   },
   "refused": {
    "depth_limit": 0,
    "concurrency_limit": 0,
    "budget": 0
   },
   "by_type": {}
  },
  "safety_stops": 0,
  "is_error": false,
  "num_turns": 1,
  "subtype": "success",
  "api_error_status": null,
  "result": "{\"issuing_agency\": null, \"rfp_number\": null, \"project_title\": null, \"procurement_officer_name\": null, \"procurement_officer_email\": null, \"procurement_officer_phone\": null, \"rfp_issue_date\": null, \"questions_deadline\": {\"value\": \"2026-11-24\", \"quote\": \"The deadline for written questions is extended from November 20, 2026 to November 24, 2026.\"}, \"pre_proposal_conference_date\": null, \"pre_proposal_conference_mandatory\": null, \"proposal_due_date\": {\"value\": \"2026-12-22\", \"quote\": \"The proposal due date is extended from December 15, 2026 to December 22, 2026; the due time remains 2:00 PM Eastern.\"}, \"proposal_due_time\": {\"value\": \"2:00 PM Eastern\", \"quote\": \"the due time remains 2:00 PM Eastern.\"}, \"submission_method\": null, \"number_of_hard_copies\": null, \"technical_proposal_page_limit\": {\"value\": 45, \"quote\": \"The Technical Proposal page limit is increased from forty (40) to forty-five (45) pages.\"}, \"minimum_font_size_pt\": null, \"proposal_validity_days\": null, \"contract_term_years\": null, \"renewal_options_count\": null, \"not_to_exceed_budget_usd\": null, \"bid_bond_percent\": null, \"performance_bond_percent\": null, \"general_liability_per_occurrence_usd\": null, \"cyber_liability_usd\": null, \"liquidated_damages_per_day_usd\": null, \"go_live_date\": null, \"uptime_sla_percent\": null, \"p1_response_time_hours\": null, \"data_retention_years\": null, \"eval_weight_technical\": {\"value\": 45, \"quote\": \"Technical Approach and Functionality, 45 points; Cost, 30 points;\"}, \"eval_weight_cost\": {\"value\": 30, \"quote\": \"Technical Approach and Functionality, 45 points; Cost, 30 points;\"}, \"eval_weight_experience\": {\"value\": 15, \"quote\": \"Proposer Experience and Qualifications, 15 points; Local Business Preference, 10 points.\"}, \"eval_weight_local_business\": {\"value\": 10, \"quote\": \"Proposer Experience and Qualifications, 15 points; Local Business Preference, 10 points.\"}, \"min_reference_projects\": {\"value\": 3, \"quote\": \"must provide at least three (3) reference projects of comparable scope completed for public water or wastewater utilities within the last eight years.\"}, \"min_years_in_business\": {\"value\": 7, \"quote\": \"the proposer must have been in business continuously for at least seven (7) years\"}, \"dbe_goal_percent\": {\"value\": 12, \"quote\": \"The Authority has established a Disadvantaged Business Enterprise (DBE) participation goal of twelve percent (12%) of the total contract value for this procurement.\"}, \"retainage_percent\": {\"value\": 10, \"quote\": \"The Authority will withhold retainage of ten percent (10%) from each progress payment until final acceptance.\"}, \"payment_terms_days\": {\"value\": 45, \"quote\": \"Undisputed invoices will be paid within forty-five (45) days after approval by the Project Manager.\"}, \"max_concurrent_users\": {\"value\": 350, \"quote\": \"The system shall support at least 350 concurrent named users without degradation of response times below the targets in Section 7\"}, \"asset_records_to_migrate\": {\"value\": 182000, \"quote\": \"The Contractor shall migrate approximately 182,000 asset records and their associated attributes from the legacy system.\"}}",
  "ttft_ms": 10861,
  "type": "result",
  "duration_ms": 13943,
  "uuid": "[REDACTED]",
  "ttft_stream_ms": 2336,
  "time_to_request_ms": 197,
  "first_content_frame_ms": 2336,
  "queued_turn_count": 0,
  "result_index": 0
 },
 {
  "duration_api_ms": 5794,
  "stop_reason": "end_turn",
  "session_id": "[REDACTED]",
  "total_cost_usd": 0.0021896299999999997,
  "usage": {
   "input_tokens": 2,
   "cache_creation_input_tokens": 6286,
   "cache_read_input_tokens": 9273,
   "output_tokens": 1679,
   "output_tokens_details": {
    "thinking_tokens": 986
   },
   "server_tool_use": {
    "web_search_requests": 0,
    "web_fetch_requests": 0
   },
   "service_tier": "standard",
   "cache_creation": {
    "ephemeral_1h_input_tokens": 6286,
    "ephemeral_5m_input_tokens": 0
   },
   "inference_geo": "global",
   "iterations": [
    {
     "input_tokens": 2,
     "output_tokens": 1679,
     "cache_read_input_tokens": 9273,
     "cache_creation_input_tokens": 6286,
     "cache_creation": {
      "ephemeral_5m_input_tokens": 0,
      "ephemeral_1h_input_tokens": 6286
     },
     "type": "message"
    }
   ],
   "speed": "standard",
   "fallback_credit": null
  },
  "modelUsage": {
   "claude-haiku-5-5": {
    "inputTokens": 2,
    "outputTokens": 1679,
    "cacheReadInputTokens": 9273,
    "cacheCreationInputTokens": 6286,
    "webSearchRequests": 0,
    "costUSD": 0.0021896299999999997,
    "contextWindow": 1000000,
    "maxOutputTokens": 128000,
    "thinkingTokens": 986,
    "canonicalModel": "claude-haiku-5-5",
    "provider": "firstParty",
    "costBasis": "list"
   }
  },
  "permission_denials": [],
  "terminal_reason": "completed",
  "fast_mode_state": "off",
  "fast_mode_disabled_reason": "sdk_opt_in_required",
  "subagent_stats": {
   "spawned": 0,
   "requested": {
    "background": 0,
    "foreground": 0,
    "unset": 0
   },
   "started_in_background": 0,
   "max_depth": 0,
   "spawned_by_subagents": 0,
   "completed": 0,
   "failed": 0,
   "killed": {
    "parent": 0,
    "user": 0,
    "system": 0
   },
   "refused": {
    "depth_limit": 0,
    "concurrency_limit": 0,
    "budget": 0
   },
   "by_type": {}
  },
  "safety_stops": 0,
  "is_error": false,
  "num_turns": 1,
  "subtype": "success",
  "api_error_status": null,
  "result": "{\"issuing_agency\": \"Harlow Valley Regional Water Authority\", \"rfp_number\": \"HVRWA-2026-0417\", \"project_title\": \"Enterprise Asset Management and Work Order System Replacement\", \"procurement_officer_name\": \"Delphine Okafor\", \"procurement_officer_email\": \"[REDACTED:email]\", \"procurement_officer_phone\": \"[REDACTED:phone]\", \"rfp_issue_date\": \"2026-11-02\", \"questions_deadline\": \"2026-11-24\", \"pre_proposal_conference_date\": \"2026-11-13\", \"pre_proposal_conference_mandatory\": false, \"proposal_due_date\": \"2026-12-22\", \"proposal_due_time\": \"2:00 PM Eastern\", \"submission_method\": \"Electronic submission via the Authority's eBid portal, plus two printed hard copies delivered to the Procurement Office within two business days after the electronic deadline\", \"number_of_hard_copies\": 2, \"technical_proposal_page_limit\": 45, \"minimum_font_size_pt\": 11, \"proposal_validity_days\": 180, \"contract_term_years\": 5, \"renewal_options_count\": 2, \"not_to_exceed_budget_usd\": 3850000, \"bid_bond_percent\": 5, \"performance_bond_percent\": 100, \"general_liability_per_occurrence_usd\": 2000000, \"cyber_liability_usd\": 5000000, \"liquidated_damages_per_day_usd\": 1500, \"go_live_date\": \"2028-03-31\", \"uptime_sla_percent\": 99.9, \"p1_response_time_hours\": 2, \"data_retention_years\": 10, \"eval_weight_technical\": 45, \"eval_weight_cost\": 30, \"eval_weight_experience\": 15, \"eval_weight_local_business\": 10, \"min_reference_projects\": 3, \"min_years_in_business\": 7, \"dbe_goal_percent\": 12, \"retainage_percent\": 10, \"payment_terms_days\": 45, \"max_concurrent_users\": 350, \"asset_records_to_migrate\": 182000}",
  "ttft_ms": 4236,
  "type": "result",
  "duration_ms": 6021,
  "uuid": "[REDACTED]",
  "ttft_stream_ms": 1128,
  "time_to_request_ms": 219,
  "first_content_frame_ms": 1128,
  "queued_turn_count": 0,
  "result_index": 0
 }
]

Get new runs and ranking changes weekly