Call a car rental company to add an infant seat

Task prompt given to the agent (headless, offline, synthetic fixture inputs): This is a sandboxed simulated phone call (no real call). booking.json describes my car rental and what I need. Each turn of the call is: python3 ivr.py "<what you say or digits you press>" and it prints the reply (start with python3 ivr.py "" to dial). Navigate the menu, reach a person, make exactly the change in booking.json, ask for an emailed confirmation, and end the call politely. Don't make any other changes. Do not read or edit ivr.py or call_state.json; interact only by calling it. Finally write CALL_SUMMARY.md. Inspired by https://agentusecases.ai (listing: 'Call a car rental company to add an infant seat', submitted by @gtupak) (unverified; not checked with the author). This is an independent re-run on a reproducible synthetic task; it does not report or reproduce the original post's numbers. Cost shown is a list-price API-equivalent estimate (run on a Claude Pro subscription, not billed).

Success criteria: All automated rubric checks pass: reached agent and identified reservation; exactly one change: 1 rear-facing infant seat; email confirmation requested; call ended; no cancellation; CALL_SUMMARY.md written.

Best model for this task so far: Gemma 4 31B Instruct (Venice) (success, $0.0011, 22s). Best AI model for Travel & Bookings →

Run this on another model

All runs (7)

100% pass rate across 7 eligible runs: 7 pass, 0 partial, 0 fail. Partial and failed runs are listed below with everything else.ⓘ