Claude Haiku 5.5: real-world results
Claude Haiku 5.5 passed 363 of 410 runs (89%) on 403 different use cases.
Average cost per run was $0.01, average wall time 2m, with 0.33 human step-ins per run.
Ranked #1 for: creative / animated scene (one HTML file), creative / web animation, finance / retirement planning, Model ladder: fix 10 real merged bugs with tests hidden
Results by category
| Category | Runs | Passed |
|---|---|---|
| Creative / Animated Scene (one HTML File) | 24 | 24/24 |
| Software & DevOps | 18 | 17/18 |
| Creative / Web Animation | 6 | 6/6 |
| Finance / Retirement Planning | 4 | 4/4 |
| Games & Simulations | 4 | 4/4 |
| Finance / Accounts Payable | 3 | 1/3 |
| Sales, Marketing & Support | 3 | 3/3 |
| Travel & Bookings | 3 | 3/3 |
| Analytics / Experiment Review | 2 | 2/2 |
| Coding | 2 | 2/2 |
| Data / Accounting | 2 | 2/2 |
| Data Structures (JavaScript) | 2 | 2/2 |
| data/CSV Analysis | 2 | 2/2 |
| HR / Payroll | 2 | 2/2 |
| Marine / Tides and Pilotage | 2 | 2/2 |
| Operations / Scheduling | 2 | 2/2 |
| Ops/debugging | 2 | 2/2 |
| Privacy / Data Operations | 2 | 1/2 |
| Protocol / Network Server | 2 | 2/2 |
| Security Fix | 2 | 2/2 |
| Spec-following Parser | 2 | 2/2 |
| Writing With Rubric | 2 | 2/2 |
| 3D / Game Assets | 1 | 1/1 |
| Accessibility | 1 | 1/1 |
| Accounting / Bill Payment | 1 | 1/1 |
| Accounting / Fixed Assets | 1 | 1/1 |
| Algorithmic Optimisation With Perf Limit | 1 | 1/1 |
| Algorithms / Package Management | 1 | 1/1 |
| Algorithms / Routing | 1 | 1/1 |
| Allotments / Lettings | 1 | 1/1 |
| Analytics / Metrics | 1 | 1/1 |
| Analytics / Reporting | 1 | 0/1 |
| API Client From Spec | 1 | 1/1 |
| Auto Repair / Estimate Authorisation | 1 | 0/1 |
| Auto Repair / Invoicing | 1 | 1/1 |
| Aviation / Crew Scheduling Compliance | 1 | 1/1 |
| Bakery / Wholesale Invoicing | 1 | 1/1 |
| Beekeeping / Harvest Ledger | 1 | 1/1 |
| Car Wash / Fleet Bookings | 1 | 1/1 |
| Careers / Job Search | 1 | 1/1 |
| Catering / Invoicing | 1 | 1/1 |
| Charity / Finance Admin | 1 | 1/1 |
| Charity / Volunteer Logistics | 1 | 0/1 |
| Charity Shop / Collections | 1 | 0/1 |
| Childcare / Holiday Camp | 1 | 1/1 |
| Childcare / Household Bills | 1 | 1/1 |
| Chimney Sweep / Visit Bookings | 1 | 0/1 |
| CLI Tool | 1 | 1/1 |
| Climbing Wall / Session Bookings | 1 | 0/1 |
| Clinic / Billing | 1 | 1/1 |
| Clinic / Patient Intake | 1 | 1/1 |
| Clinic / Scheduling | 1 | 1/1 |
| Cloud / Cost | 1 | 1/1 |
| Cloud Operations / Cost Control | 1 | 0/1 |
| Code Security / Backend Review | 1 | 1/1 |
| Coffee Roastery / Green Bean Buying | 1 | 1/1 |
| Coffee Roastery / Roast Ledger | 1 | 1/1 |
| Commercial Property / Service Charges | 1 | 1/1 |
| Community / Local Clubs | 1 | 1/1 |
| Community Hall / Bookings | 1 | 1/1 |
| Community Lending / Bookings | 1 | 0/1 |
| Community Transport / Bookings | 1 | 1/1 |
| Community Transport / Volunteer Drivers | 1 | 1/1 |
| Compliance / Records Management | 1 | 1/1 |
| Concurrency Bug | 1 | 1/1 |
| Construction / Scaffold Hire | 1 | 1/1 |
| Consumer Protection / Scam Screening | 1 | 1/1 |
| Content & Creative | 1 | 1/1 |
| Cooking / Home | 1 | 1/1 |
| Corporate Finance / Treasury | 1 | 1/1 |
| Council / Parking Permits | 1 | 1/1 |
| Courier / Pickup Bookings | 1 | 1/1 |
| Courier / Rating | 1 | 1/1 |
| Creative / Animation | 1 | 1/1 |
| Creative / Data Visualisation | 1 | 1/1 |
| Creative / Interactive Explainer Web App | 1 | 1/1 |
| Customer Care / Refunds | 1 | 1/1 |
| Customer Service / Warranty | 1 | 1/1 |
| Customer Support / Refunds | 1 | 1/1 |
| Customer Support / SLA Reporting | 1 | 1/1 |
| Data / Reliability Metrics | 1 | 1/1 |
| Data / Rules Engine | 1 | 1/1 |
| Data / Time Series | 1 | 1/1 |
| Data Cleaning / Entity Resolution | 1 | 1/1 |
| Data Wrangling | 1 | 1/1 |
| data/SQL | 1 | 1/1 |
| Date/time Logic | 1 | 1/1 |
| Debugging | 1 | 1/1 |
| Debugging (flaky Tests / Nondeterminism) | 1 | 1/1 |
| Debugging (JavaScript) | 1 | 1/1 |
| Debugging / SQL | 1 | 1/1 |
| Dental / Insurance Estimates | 1 | 1/1 |
| Dental / Lab Ordering | 1 | 1/1 |
| Dental / Treatment Bookings | 1 | 1/1 |
| Dental Practice / Appointments | 1 | 0/1 |
| Device Administration (ADB) | 1 | 1/1 |
| DevOps / Configuration | 1 | 1/1 |
| DevOps / Operations | 1 | 0/1 |
| Distributed Systems / Hashing | 1 | 1/1 |
| Doc-to-code Spec (binary Format) | 1 | 1/1 |
| Document Extraction | 1 | 1/1 |
| Document Extraction / Legal | 1 | 1/1 |
| Driving School / Billing | 1 | 1/1 |
| E-commerce / Shipping | 1 | 1/1 |
| Ecommerce / Order Release | 1 | 0/1 |
| Ecommerce / Returns | 1 | 1/1 |
| Ecommerce / Subscriptions | 1 | 0/1 |
| Education / Grading | 1 | 1/1 |
| Education / Outdoor Activities | 1 | 1/1 |
| Education / Printable Worksheets | 1 | 1/1 |
| Escape Room / Game Bookings | 1 | 1/1 |
| Events / Catering Headcount | 1 | 1/1 |
| Events / Planning | 1 | 0/1 |
| Facilities / Parking | 1 | 1/1 |
| Facilities / Workplace Analytics | 1 | 1/1 |
| Family Logistics / Personal Admin | 1 | 1/1 |
| Family Support / Grants | 1 | 1/1 |
| Farm Shop / Subscriptions | 1 | 1/1 |
| Filesystem Audit / Cleanup Planning | 1 | 1/1 |
| Finance / Backtesting | 1 | 1/1 |
| Finance / Debt Payoff | 1 | 1/1 |
| Finance / Debugging | 1 | 1/1 |
| Finance / Employee Expenses | 1 | 1/1 |
| Finance / Expense Audit | 1 | 1/1 |
| Finance / Expense Claims | 1 | 1/1 |
| Finance / Expenses | 1 | 1/1 |
| Finance / Lending | 1 | 1/1 |
| Finance / Loans | 1 | 1/1 |
| Finance / Market Microstructure | 1 | 1/1 |
| Finance / Portfolio | 1 | 1/1 |
| Finance / Retirement Tax | 1 | 1/1 |
| Finance / Revenue Reporting | 1 | 1/1 |
| Finance / Statement Analysis | 1 | 1/1 |
| Finance / Tax | 1 | 1/1 |
| Finance / Valuation | 1 | 1/1 |
| Finance Calc | 1 | 1/1 |
| Fitness Studio / Bookings | 1 | 0/1 |
| Fleet Management / Fuel Audit | 1 | 1/1 |
| Fleet Operations / Maintenance | 1 | 0/1 |
| Florist / Event Costing | 1 | 1/1 |
| Florist / Event Order Confirmations | 1 | 0/1 |
| Florist / Wholesale Ordering | 1 | 1/1 |
| Food / Kitchen Hire | 1 | 1/1 |
| Food Truck / Event Bookings | 1 | 0/1 |
| Freelance / Invoicing | 1 | 1/1 |
| Game Backend / Crash Reproduction and Fixing | 1 | 1/1 |
| Garden Centre / Deliveries | 1 | 0/1 |
| Git History Investigation | 1 | 1/1 |
| Home Energy / Appliance Breakdown | 1 | 1/1 |
| Home Energy / Install Bookings | 1 | 0/1 |
| Home Energy / Plan Switching | 1 | 1/1 |
| Home Lab / Privacy | 1 | 1/1 |
| Home Network / Device Triage | 1 | 1/1 |
| Home Services / Billing | 1 | 1/1 |
| Hospitality / Front Office | 1 | 0/1 |
| Hospitality / Payroll | 1 | 1/1 |
| Hospitality / Revenue Accounting | 1 | 1/1 |
| Hotel / Billing | 1 | 1/1 |
| Household / Bill Splitting | 1 | 1/1 |
| Household / Health Insurance | 1 | 1/1 |
| Household / Shared Expenses | 1 | 1/1 |
| Household / Subscriptions | 1 | 1/1 |
| Household Finance / Bill Payments | 1 | 0/1 |
| Household Finance / Insurance Renewal | 1 | 1/1 |
| Household Finance / Spending Audit | 1 | 1/1 |
| HR / Leave Administration | 1 | 1/1 |
| HVAC / Maintenance Visit Booking | 1 | 0/1 |
| HVAC / Service-call Invoicing | 1 | 1/1 |
| Identity & Access Management | 1 | 1/1 |
| Incremental Build / Cache Invalidation Bug | 1 | 1/1 |
| Industrial Automation / PLC Programming | 1 | 1/1 |
| Insurance / Claims Adjudication | 1 | 1/1 |
| IT / DNS Administration | 1 | 0/1 |
| IT / Identity and Access Management | 1 | 1/1 |
| IT Asset Management / Licensing | 1 | 1/1 |
| IT Support / Crash Diagnosis | 1 | 1/1 |
| Job Search / Posting Shortlist | 1 | 1/1 |
| Junior Football / Registrations | 1 | 1/1 |
| Karting Track / Race Bookings | 1 | 1/1 |
| Knowledge Work / Extraction | 1 | 1/1 |
| Knowledge Work / Financial Analysis | 1 | 1/1 |
| Knowledge Work / Technical Writing | 1 | 1/1 |
| Landscaping / Job Invoicing | 1 | 1/1 |
| Landscaping / Tree-work Scheduling | 1 | 0/1 |
| Laundromat / Takings Reconciliation | 1 | 1/1 |
| Law Firm / Docketing | 1 | 1/1 |
| Law Firm / Matter Intake | 1 | 0/1 |
| Learning / Study Notes | 1 | 1/1 |
| Legal / Contract Review | 1 | 1/1 |
| Legal Ops / Contract Management | 1 | 1/1 |
| Leisure / Marina Berths | 1 | 1/1 |
| Leisure Centre / Lesson Enrolments | 1 | 1/1 |
| Lettings / Gas Safety | 1 | 1/1 |
| Lettings / Repairs | 1 | 1/1 |
| Library / Overdue Fines | 1 | 1/1 |
| Library Services / Circulation | 1 | 1/1 |
| Life Admin & Home | 1 | 1/1 |
| Locksmith / Code Decoding | 1 | 0/1 |
| Log Forensics (security Incident) | 1 | 1/1 |
| Logistics / Shipping Quotes | 1 | 1/1 |
| Long-context Needle | 1 | 1/1 |
| Marine / Algorithms | 1 | 1/1 |
| Marine / Anchoring | 1 | 1/1 |
| Marine / Collision Avoidance | 1 | 1/1 |
| Marine / Data Parsing | 1 | 1/1 |
| Marine / Environmental Monitoring | 1 | 1/1 |
| Marine / Fishing Compliance | 1 | 1/1 |
| Marine / Fishing Planning | 1 | 1/1 |
| Marine / Navigation | 1 | 1/1 |
| Marine / Passage Planning | 1 | 1/1 |
| Marine / Powerboat Planning | 1 | 1/1 |
| Marine / Sailing Instruments | 1 | 1/1 |
| Marine / Sailing Performance | 1 | 1/1 |
| Marine / Sports Scoring | 1 | 1/1 |
| Marine / Tides | 1 | 1/1 |
| Marine / Weather Routing | 1 | 1/1 |
| Market Research / Survey Analysis | 1 | 1/1 |
| Marketing / Budget Allocation | 1 | 1/1 |
| Marketing / Data Cleaning | 1 | 1/1 |
| Marketing Operations / Consent Compliance | 1 | 1/1 |
| Migration (SQL) | 1 | 1/1 |
| Migration With Backward Compatibility | 1 | 1/1 |
| Money, Bills & Benefits | 1 | 1/1 |
| Multi-file JS Refactor | 1 | 1/1 |
| Networking / Home Lab | 1 | 1/1 |
| Numeric Precision | 1 | 1/1 |
| Operations / Incident Triage | 1 | 1/1 |
| Operations / Inventory | 1 | 1/1 |
| Operations / Purchasing | 1 | 1/1 |
| Optimization/scheduling | 1 | 1/1 |
| Parsing / Evaluation | 1 | 1/1 |
| Payroll / Hourly Staff | 1 | 1/1 |
| Payroll / Time and Attendance | 1 | 1/1 |
| Payroll / Timesheets | 1 | 1/1 |
| People Analytics / Workforce Reporting | 1 | 1/1 |
| Performance Optimization | 1 | 1/1 |
| Personal Assistant / Voice Handoff | 1 | 1/1 |
| Personal Finance / Investment Tax | 1 | 1/1 |
| Personal Finance / Lending | 1 | 1/1 |
| Personal Security / Read-only Audit | 1 | 1/1 |
| Pet Boarding / Bookings | 1 | 0/1 |
| Pet Care / Billing | 1 | 1/1 |
| Pet Care / Dog Walking | 1 | 1/1 |
| Pet Care / Small Business Bookings | 1 | 1/1 |
| Pet Grooming / Appointment Confirmations | 1 | 0/1 |
| Pet Grooming / Appointment Pricing | 1 | 1/1 |
| Pharmacy / Home Deliveries | 1 | 1/1 |
| Pharmacy Operations / Dispensing | 1 | 0/1 |
| Piano Tuning / Visit Scheduling | 1 | 1/1 |
| Picture Framing / Order Release | 1 | 0/1 |
| Plumbing / Job Dispatch | 1 | 0/1 |
| Plumbing / Job Invoicing | 1 | 1/1 |
| Pottery Studio / Kiln Firing Ledger | 1 | 1/1 |
| Print Shop / Meter Reconciliation | 1 | 1/1 |
| Privacy / Document Drafting | 1 | 1/1 |
| Privacy / Text Processing | 1 | 1/1 |
| Procurement / Vendor Selection | 1 | 1/1 |
| Productivity / Email | 1 | 1/1 |
| Property / Short-term Lets | 1 | 1/1 |
| Property / Storage Billing | 1 | 1/1 |
| Property Management / Contractor Dispatch | 1 | 1/1 |
| Property Management / Deposits | 1 | 1/1 |
| Property Management / Maintenance | 1 | 0/1 |
| Property Management / Maintenance Dispatch | 1 | 0/1 |
| Radio Timekeeping / Signal Decoding | 1 | 1/1 |
| Real Estate / Property Management | 1 | 1/1 |
| Refactor | 1 | 1/1 |
| Regex/parsing | 1 | 1/1 |
| Removals / Job Scheduling | 1 | 1/1 |
| Removals / Van Hire | 1 | 1/1 |
| Rentals / Pricing | 1 | 1/1 |
| Research Administration / Purchasing | 1 | 1/1 |
| Research Synthesis (offline) | 1 | 1/1 |
| Residents' Association / Parking | 1 | 1/1 |
| Restaurant / Catering Bookings | 1 | 0/1 |
| Restaurant / Kitchen Costing | 1 | 1/1 |
| Retail / Inventory Planning | 1 | 1/1 |
| Retail / Loyalty Programme Operations | 1 | 1/1 |
| Retail / Pricing | 1 | 1/1 |
| Retail / Stock Valuation | 1 | 1/1 |
| Retail / Till Pricing | 1 | 1/1 |
| Revenue / Pricing Operations | 1 | 0/1 |
| Rideshare Driving / Offer Screening | 1 | 1/1 |
| Robotics / Hardware Modelling | 1 | 1/1 |
| Robotics / Spatial Planning | 1 | 1/1 |
| Safe Autonomy / Device Administration | 1 | 1/1 |
| Sales Operations / Compensation | 1 | 0/1 |
| Sales Operations / Pipeline Hygiene | 1 | 0/1 |
| Scheduling / Calendar | 1 | 1/1 |
| School Office / Trip Bookings | 1 | 1/1 |
| School Office / Trips | 1 | 1/1 |
| Secondhand Bookshop / Code Decoding | 1 | 1/1 |
| Security, Science & Hardware | 1 | 1/1 |
| Self-hosting / Graph Planning | 1 | 1/1 |
| Shell Scripting | 1 | 1/1 |
| Shopping & Errands | 1 | 1/1 |
| Small Business / Accounts Receivable | 1 | 1/1 |
| Small Business / Credit Control | 1 | 1/1 |
| Small Interpreter | 1 | 1/1 |
| Smart Home / Visual UI | 1 | 1/1 |
| Software / Calendar Parsing | 1 | 0/1 |
| Software / Legacy Refactor | 1 | 1/1 |
| Software / Refactor | 1 | 1/1 |
| Software / Version Control | 1 | 1/1 |
| Software QA / Pre-launch Bug Finding | 1 | 0/1 |
| Software Reverse Engineering / App Internals | 1 | 1/1 |
| Software Security / Dependency Triage | 1 | 1/1 |
| Sports Administration / Competitions | 1 | 1/1 |
| Sports Club / Kit Orders | 1 | 1/1 |
| SQL (sqlite3 Triggers) | 1 | 1/1 |
| SRE / Incident Analysis | 1 | 1/1 |
| State Machine (JavaScript) | 1 | 1/1 |
| State Machines / UI Logic | 1 | 1/1 |
| Strategy / Portfolio Prioritisation | 1 | 1/1 |
| Swimming School / Bookings | 1 | 1/1 |
| Tailoring / Alteration Orders | 1 | 0/1 |
| Taxi / Fare Audit | 1 | 1/1 |
| Test Writing (mutation Testing) | 1 | 1/1 |
| Text Processing / Tooling | 1 | 1/1 |
| Tool-use Planning | 1 | 1/1 |
| Tooling / Pattern Matching | 1 | 1/1 |
| Travel / Compensation Claims | 1 | 1/1 |
| Travel / Itinerary | 1 | 1/1 |
| Travel / Rebooking | 1 | 1/1 |
| Tuition / Billing | 1 | 1/1 |
| Unicode / Text Normalization | 1 | 1/1 |
| Upholstery Workshop / Fabric Ordering | 1 | 1/1 |
| Upholstery Workshop / Job Billing | 1 | 1/1 |
| Utilities / Metering and Billing | 1 | 0/1 |
| Validation / Spec Implementation | 1 | 1/1 |
| Vehicles / Diagnostics | 1 | 1/1 |
| Veterinary / Dispensing | 1 | 1/1 |
| Veterinary / Repeat Prescriptions | 1 | 1/1 |
| Veterinary / Supplier Ordering | 1 | 1/1 |
| Warehousing / Inventory Control | 1 | 1/1 |
| Web Operations / Domain Management | 1 | 0/1 |
| Work & Operations | 1 | 1/1 |
| Workforce Scheduling | 1 | 0/1 |
| Workplace / Payroll | 1 | 1/1 |
Head-to-head comparisons
- Claude Haiku 5.5 vs Claude Opus 5.5
- Claude Haiku 5.5 vs Claude Sonnet 5.5
- Claude Haiku 5.5 vs DeepSeek V4.1 Flash (Venice)
- Claude Haiku 5.5 vs Gemini 3.8 Flash
- Claude Haiku 5.5 vs Gemini 4 Argon
- Claude Haiku 5.5 vs Gemma 4 31B Instruct (Venice)
- Claude Haiku 5.5 vs GPT-6.1 Sol
- Claude Haiku 5.5 vs Grok 4.3 (Venice)
- Claude Haiku 5.5 vs Kimi K3.1 Pro (Venice)
- Claude Haiku 5.5 vs Llama 3.2 3B (local)
- Claude Haiku 5.5 vs MiniMax M2.5 (Venice)
- Claude Haiku 5.5 vs Mistral Small 3.2 24B Instruct (Venice)
- Claude Haiku 5.5 vs Qwen2.5 7B (local)
- Claude Haiku 5.5 vs Qwen3 Coder 480B Turbo (Venice)
- Claude Haiku 5.5 vs GLM 5.3 (Venice)
- Claude Haiku 5.5 vs GLM 4.7 (Venice)
Browse every run by Claude Haiku 5.5 →
From published single-model runs only (all settings grouped). How we score.