DeepSeek V4.1 Flash (Venice) vs GPT-6.1 Sol
On the 45 use cases both models ran, DeepSeek V4.1 Flash (Venice) won 39 to 5, with 1 tied (better outcome first, then lower cost).
Pass rate: DeepSeek V4.1 Flash (Venice) 87% (45 runs) vs GPT-6.1 Sol 96% (45 runs). Average cost per run: $0.01 vs $0.05.
| Metric | DeepSeek V4.1 Flash (Venice) | GPT-6.1 Sol |
|---|---|---|
| Runs on shared use cases | 45 | 45 |
| Pass rate | 87% (39/45) | 96% (43/45) |
| Avg cost per run | $0.01 | $0.05 |
| Avg wall time | 2m | 1m |
| Step-ins per run | 0.00 | 0.00 |
| Use cases won | 39 | 5 |
Use case by use case
- AIS collision risk: closest point of approach and alert levels: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Anchor drag alarm from a GPS track: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Animated fireplace in one self-contained HTML file: GPT-6.1 Sol better (pass 0% vs 100%)
- Animated snowman in one self-contained HTML file: GPT-6.1 Sol better (pass 0% vs 100%)
- Answer 8 business questions against a SQLite shop database: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Answer 8 questions from 12 conflicting dated sources with correct citations: tie (pass 0% vs 0%)
- Audit a full disk without touching it, then hand over an approve-before-delete cleanup script: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Backtest a moving-average crossover on a bundled synthetic price file: GPT-6.1 Sol better (pass 0% vs 100%)
- Best fishing windows from tide, solunar and weather data: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Best sailing angle and leg times from a polar table: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Boat fuel range with a reserve over a planned trip: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Carry out device tweaks but stop and ask before anything irreversible or out of scope: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Catch log checked against a made-up fishing regulations table: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Classify 12 faulty sensors (frozen/°F/spike/gap/drift) with fault start hours: GPT-6.1 Sol better (pass 0% vs 100%)
- Dead reckoning, estimated position with current, and computed set and drift: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Debloat your own Android TV over ADB with a backup and a one-command undo: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Debt avalanche vs snowball schedule to the cent: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Discounted cash flow valuation with mid-year option and a sensitivity grid: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Extract 8 fields from 24 invoices in 4 formats (EU numbers, credit notes, MM/DD dates): DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Find substantive changes hidden in a 'minor clean-up' contract redline: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Fix 14 WCAG issues in a static HTML page without losing content: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Fix an async job pool (retries, deadlock, error capture) with hidden tests: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Go/no-go departure time from a gridded wind file: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Looping fireworks show in one self-contained HTML file: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Make a stdlib Python service pass its healthcheck (4 layered config bugs): DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Migrate a 3-file Node.js module from callbacks to async/await + fix a validation bug: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Monthly cohort retention + revenue from a messy orders CSV: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Mortgage amortization with extra monthly payments and lump sums: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Optimise an O(n·m) price lookup to <4s on 200k orders with byte-identical output: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Parse 300 transaction lines in 6 formats (EU numbers, 12h times, minor units, 'Last, First'): DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Pension claiming-age comparison: lifetime totals, present values and break-even ages: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Progressive tax on fictional brackets, and pre-tax vs after-tax savings comparison: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Reach a goal stack configuration using a simulator CLI with minimal moves: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Read a synthetic annual-report excerpt and compute financial ratios: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Rebalance to target weights with whole shares and highest-cost-first tax lots: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Refactor nested legacy pricing code + add a bulk-discount rule with exact behaviour preservation: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Retirement drawdown with a 4% rule, inflation raises and a skip-raise-after-loss guardrail: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Rewrite a legalese policy in plain language without losing or inventing rules: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Root-cause a checkout 500 spike from nginx/app/deploy logs with red herrings: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Seeded Monte Carlo retirement odds against a stated success threshold: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Tide height by rule of twelfths and cosine, with under-keel clearance windows: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Work backward from a retirement budget to a savings target, contributions and earliest retirement age: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Write a blameless postmortem from a timeline + chat export (automated rubric): DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
- Write a robust backup rotation script (dry-run, spaces, exit codes, safe deletion): GPT-6.1 Sol better (pass 0% vs 0%)
- Write an atomic, idempotent SQLite v1→v2 migration with dedupe, FK and CHECK constraints: DeepSeek V4.1 Flash (Venice) better (pass 100% vs 100%)
Only use cases both models ran are compared; all settings of each model are grouped. How we score.