AI Financial Modelling: Can AI Build a Financial Model? We Tested Claude, GPT and Gemini

How well can AI handle financial modelling?

We test Claude, GPT, Gemini and other AI models on a standardised 13-cell financial modelling workbook and score each one on accuracy, formula logic, structure and presentation. The best score so far is 61 out of 80 (76%), from a skilled-prompt run. This tracker is a living scorecard, updated as models improve.


I started testing AI on financial models because I kept hearing the same claim: “AI can build your model for you now.” After 20 years of financial modelling across PwC, KPMG, Investec and NAB, that sounded like someone saying a calculator can do an audit.

So I built a framework to test it properly. Thirteen evaluation cells, each scored on the same four criteria I would use to review work from a junior analyst: accuracy, formula logic, structure and presentation.

The results surprised me. Not because AI was brilliant, and not because it failed completely. The surprise was how specific the failures were, and how consistent they became across models.

No hype, no vendor pitches. Just structured evaluations against a real workbook covering revenue builds, operating expenses, P&L consolidation, balance sheets, cash flow, debt schedules and more.


Key terms

AI financial modelling Using AI tools such as Claude, GPT or Gemini to build, review or extend financial models, including 3-way integrated models, revenue builds, debt schedules and valuations.

Evaluation cell One of 13 defined financial modelling tasks in our scoring framework. Each cell is assessed independently for accuracy, formula logic, structure and presentation, scored out of 80.

Cold prompt An AI model given a task brief with no prior context, examples or coaching. Tests the model’s baseline capability on a financial modelling task.

Skilled prompt An AI model given a structured brief with context, examples, formatting rules and step-by-step instructions. Tests the model’s ceiling when guided by someone who knows what to ask for.

Human reference score The benchmark score set by a qualified financial modeller completing the same task under the same rubric. Every AI score is compared against this baseline.

3-way financial model A fully integrated financial model linking the profit and loss statement, balance sheet and cash flow statement, where a change in any assumption flows correctly through all three.


Can AI actually build a financial model?

Yes, but with significant limitations. Across four completed evaluation runs, the best AI score reached 61 out of 80 (76%). That is roughly equivalent to a junior analyst who gets the structure right but misses reconciliation checks and makes formula errors in edge cases.

The gap between a cold prompt and a skilled prompt is large. When I gave Claude a bare task brief with no context, the output missed fundamental modelling conventions: hardcoded values where formulas should be, no error checks, inconsistent sign conventions. When I gave the same model a structured brief with examples and formatting rules, the output improved by 15 to 20 points.

That tells you something important about AI financial modelling today. The tool is not the bottleneck; the prompt is. If you do not know what good modelling looks like, you cannot coach an AI to produce it.

How do Claude, GPT and Gemini compare on financial modelling tasks?

No single AI model dominates across all 13 evaluation cells. Each model has strengths in specific areas and consistent weaknesses in others.

Claude tends to produce cleaner formula structures and follows formatting instructions more reliably. GPT often generates longer, more detailed outputs but introduces more hardcoded values. Gemini handles narrative explanations well but struggles with multi-step formula chains.

These are patterns, not absolutes. Every model version changes the picture, which is why this tracker exists as a living scorecard rather than a one-off comparison.

The evaluation runs so far include:

RunModelPrompt typeScorePercentage
1Claude (Desktop)Cold48/8060%
2Claude (Desktop)Skilled61/8076%
3GPT (ChatGPT)Cold44/8055%
4GeminiCold42/8053%

Scores are indicative and updated as new runs are completed. Click any run card in the tracker below to see the cell-by-cell breakdown.

What does each evaluation cell test in AI financial modelling?

Each of the 13 evaluation cells maps to a real financial modelling task that an accountant or analyst would perform inside a 3-way integrated model. The cells are not abstract exercises; they are the actual build steps in a monthly driver-based model.

The cells cover:

  1. Revenue build Revenue drivers, pricing assumptions, volume growth, seasonal patterns
  2. Cost of goods sold Variable cost structures tied to revenue drivers
  3. Operating expenses Fixed and semi-variable cost schedules with escalation logic
  4. Employee costs Headcount planning, salary escalation, on-costs and superannuation
  5. Depreciation Asset register, useful life calculations, depreciation methods
  6. Working capital Debtor days, creditor days, inventory days, all formula-driven from revenue and COGS
  7. Debt schedule Drawdown, repayment, interest calculation, covenant testing
  8. Tax Corporate tax calculation with carry-forward losses
  9. P&L consolidation Bringing revenue, COGS, opex, depreciation, interest and tax together
  10. Balance sheet Full balance sheet with opening and closing balances that reconcile
  11. Cash flow statement Indirect method cash flow derived from P&L movements and balance sheet changes
  12. 3-way integration check Does a change in one assumption flow correctly through all three statements?
  13. Presentation and structure Formatting, sign conventions, labelling, print layout, error checks

Each cell is scored on four criteria worth 5 points each (total 20 per cell, 80 across four scored cells per run). The four criteria are accuracy, formula logic, structure and presentation.

Where does AI fail in financial modelling?

AI financial modelling breaks down in predictable ways. After four evaluation runs, the failure patterns are consistent across Claude, GPT and Gemini.

Hardcoded values instead of formulas. Every AI model tested inserted at least some hardcoded numbers where a formula-driven reference should be. In financial modelling, a hardcoded value is a maintenance risk: it does not update when assumptions change, and it breaks the model’s integrity.

Missing reconciliation checks. None of the cold-prompt runs produced a balance sheet that included a reconciliation check (assets minus liabilities minus equity equals zero). Skilled prompts improved this, but only when the brief explicitly called for it.

Inconsistent sign conventions. AI models frequently mix positive and negative signs within the same schedule. Expenses appear as positive numbers in one section and negative in another. This makes P&L consolidation unreliable without manual correction.

Circular reference avoidance that breaks logic. When a model encounters a potential circular reference (common in interest calculations that affect tax, which affects cash, which affects debt), AI tends to break the chain by removing the dependency entirely rather than implementing an iterative solution or a workaround.

Weak presentation standards. Formatting, column widths, number formatting and print-area settings are consistently poor across all models. AI treats presentation as cosmetic; in professional financial modelling, presentation is a quality signal.

Is AI ready to replace financial modellers?

No. Based on four structured evaluations, AI is a useful assistant for specific financial modelling tasks but cannot independently produce a model that meets professional standards.

The best AI score of 76% came from a skilled-prompt run. That means a qualified modeller spent time writing a detailed brief, providing examples and specifying formatting rules. The time saved by AI generating the output was partially offset by the time spent crafting the prompt and reviewing the result.

Where AI adds genuine value today:

  • First-draft generation. AI can produce a starting structure faster than building from scratch, provided you review every formula.
  • Formula explanation. AI is strong at explaining what a formula does and suggesting alternatives.
  • Error checking support. AI can scan a model and flag potential issues, though it also flags false positives.
  • Documentation. AI writes assumption registers and model notes faster than most analysts.

Where human oversight remains essential:

  • Integration logic across all three financial statements
  • Sign convention enforcement
  • Circular reference resolution
  • Professional presentation standards
  • Commercial judgement on assumption reasonableness
MODEL CITIZN · AI MODEL EVALUATION FRAMEWORK

AI Model Eval Tracker

Benchmarking AI models on financial modelling — cold vs. skilled, Desktop vs. Excel harness, against Human reference
Report generated: 2026-09-15 · 4 completed runs · 4 total runs
TOTAL RUNS
4
COMPLETE
4
PLANNED
0
LATEST TOP SCORE
61/80
76%
HUMAN BENCHMARK
68/80
85%

Evaluation Runs

2026-08-26
FMI Global Conference Eval Run
RUN_006 · FMI Global Conference — 13-cell cross-platform comparison · 13 cells
COMPLETE
2026-08-26
FMI Global Conference — 13-cell cross-platform comparison
COMPLETE
time Of Day: varioustemperature: defaulttoken Limit: defaultprompt Length: extendednetwork Condition: stableretry Count: 0system Prompt: defaultthinking Mode: extended
Comprehensive 13-cell comparison for the FMI Global Conference presentation. Tests Perplexity, 5G AI (Claude Opus 4.8), Claude Fable 5 & 5.1, GPT 5.6 (Copilot), and two human references (Lance & Craig) across Big Blind, Small Blind, and Small Blind + cheat configurations. Case study: SaaS 3-Way DCF with cap table and convertible note. Cells 12–13 add Fable 5.1 builds on a revised starting file (8.9.26 v2). Key finding: Cell 13 (Fable 5.1 Big Blind) achieves 61/80 with ZERO killer flaws and a perfect 10/10 audit — the only AI build in tracker history to pass every deterministic check. Cell 12 (Fable 5.1 Small Blind) scores 50/80 (recorded) with a CFS↔BS cash gap inherited from the source design. Human Craig remains the top scorer at 68/80.
CELL HARNESS VER CONFIDENCECOMPLEXITYSTRUCTUREFLEXIBILITYVALIDATIONSDASHBOARDSAUTOMATIONFIT TOTAL %
Perplexity (Claude Opus)
COLD
Perplexity 4.5 1 3 4 1 1 5 1 2
18
/80
22%
Claude Opus
SKILLED
5G AI (In Excel) 4.8 4 9 9 8 4 7 9 7
57
/80
71%
Claude Opus
COLD
5G AI (In Excel) 4.8 1 9 8 3 2 7 3 4
37
/80
46%
Claude Opus
SKILLED
5G AI (In Excel) 4.8 4 9 9 8 4 6 9 7
56
/80
70%
Human Reference (Lance)
REFERENCE
EXL Cloud 3-Way V7.11 9 8 8 8 9 8 6 10
66
/80
82%
Human Reference (Craig)
REFERENCE
EXL Cloud 3-Way V4.6-5g 7 10 9 9 6 9 9 9
68
/80
85%
Claude Fable
COLD
Claude App 5.0 2 8 9 8 8 8 8 7
58
/80
72%
Claude Fable
COLD
In Excel 5.0 2 7 7 7 8 7 7 5
50
/80
62%
Claude Opus
SKILLED
5G AI (In Excel) 4.8 2 8 9 3 2 6 3 4
37
/80
46%
GPT
SKILLED
Copilot (In Excel) 5.6 4 9 9 8 4 6 9 5
54
/80
68%
GPT
COLD
Copilot (In Excel) 5.6 1 1 2 1 1 1 1 1
9
/80
11%
Claude Fable
SKILLED
Claude.ai (In Excel) 5.1 4 10 8 8 4 2 8 6
50
/80
subj: 61
62%
Claude Fable
COLD
Claude.ai (In Excel) 5.1 2 9 9 8 10 7 7 9
61
/80
76%
KILLER FLAWS DETECTED
Perplexity (Claude Opus) · COLD: Zero formulas — entire model is static/hardcoded (4,713 literal values); BS unbalanced by ~$5.1M every period; No dynamic array or formula engine
Claude Opus · SKILLED: CFS does not reconcile to BS cash (~$3.48M cumulative gap); Zero-formula-count cosmetic #REF! on nav links
Claude Opus · COLD: 41 #SPILL! errors across Calcs sheets (time-series collisions); BS balance off by ~$9.70 (rounding, not structural); Flexibility capped — scenario selector present but drivers broken by spill errors
Claude Opus · SKILLED: CFS does not reconcile to BS cash (~$3.55M cumulative gap); Unfunctional scenario/sensitivity checks
Claude Opus · SKILLED: Formulas stripped to values on rebuild — only 574 of 944 intended formulas survive; CFS does not reconcile to BS cash (~$3.55M gap); #NUM! errors on IRR/XIRR calculations
GPT · SKILLED: CFS does not reconcile to BS cash (~$1.08M max period gap); Zero genuine forecast hardcodes but dynamic-array spill architecture
GPT · COLD: NON-BUILD: unmodified starting file returned as output; All 8 factors capped — dead shell with 171 formulas (all inherited); 12 broken cross-sheet links; 6 of 9 tabs empty or unmodified
Claude Fable · SKILLED: CFS does not articulate to BS — cumulative gap $3,547,710; COGS positive in CFS; faithful to source design (identical defect exists in human reference starting file) but breaks 3-way articulation; caps Confidence and Validations at 4/10
Perplexity (Claude Opus) 18/80 (22%)
COLD
Non-functional static output. Perplexity generated 11 sheets of reasonable-looking structure but every cell is a hardcoded literal — 4,713 values, zero formulas. BS never balances (~$5.1M gap). The Dashboard tab earns the only non-floor score (5/10) because charts and layout exist, even though the underlying numbers are static. This is the baseline for what happens when the harness has no Excel write capability.
Claude Opus 57/80 (71%)
SKILLED
Small Blind with EXL Cloud skills loaded and cheat sheet. 2,388 anchor formulas plus ~26,567 dynamic-array spill children. Strong complexity (9/10) — full 5-tier revenue, convertible note, cap table, exit valuation. BS balances to 1e-8 but CFS breaks by ~$3.48M cumulative, capping Confidence and Validations at 4. Automation (9/10) reflects the dynamic-array architecture. The 5G harness produces the most sophisticated AI structure in this cohort.
Claude Opus 37/80 (46%)
COLD
Big Blind fail — same 5G architecture as the SB cheat cells but without skills, resulting in 41 #SPILL! errors where time-series formulas collide. Complexity still scores 9/10 (the structure and component coverage is there) but Confidence drops to 1/10 and Automation to 3/10 because the spill errors break downstream calculations. Shows that the 5G dynamic-array approach is fragile without guided setup.
Claude Opus 56/80 (70%)
SKILLED
Small Blind with extensive back-and-forth prompting plus cheat sheet. Nearly identical to Cell 2 (SB cheat) — same 5G architecture, same CFS break (~$3.55M vs $3.48M). Dashboards score slightly lower (6 vs 7) — Chart Data present but no dedicated Exec Summary. Demonstrates that additional prompting iterations don't materially improve the 5G build when the underlying CFS reconciliation issue persists.
Human Reference (Lance) 66/80 (82%)
REFERENCE
Lance's human reference build. 19,836 formulas, BS balances to <1e-8, CFS ties exactly. Full 3-Way with scenario manager. Automation lower (6/10) vs prior V7.11 benchmark (8/10) — reflects the specific brief's scope rather than a template ceiling. Fit-to-Brief is 10/10: every component of the case study brief is addressed. This is the practitioner benchmark for the FMI conference comparison.
Human Reference (Craig) 68/80 (85%)
REFERENCE
Craig's human reference build using the 5G/EXL Cloud methodology. 1,925 formulas with 883 named ranges and 24 sheets — the most complex tab structure in the cohort. Complexity 10/10 — the only cell to achieve a perfect complexity score, reflecting the full 5G architecture including dynamic arrays. Confidence at 7 (not 9) because CFS has a ~$3.48M gap (same structural issue as the AI 5G builds). Highest total score in the run at 68/80.
Claude Fable 58/80 (72%)
COLD
Fable 5 second release via Claude App (Big Blind — no skills loaded). 11,916 formulas, BS balances to 2.7e-9, CFS ties exactly. Zero killer flaws. Confidence low (2/10) despite clean audit because output magnitudes differ significantly from brief expectations — the model runs but numbers need calibration. This is Fable's best showing: jumping from 54 (Run 4 Desktop) and 62 (Run 5 Excel) to 58 on a harder brief, cold.
Claude Fable 50/80 (62%)
COLD
Fable 5 first release via Excel harness (Big Blind). 11,478 formulas, BS balances exactly across all 60 periods, CFS ties to BS cash. Zero killer flaws. Lower than the Claude App build (50 vs 58) — the Excel harness constrains Fable's output structure compared to the free-form Claude App approach. Fit-to-Brief capped at 5/10 due to missing convertible-note logic and limited exit valuation.
Claude Opus 37/80 (46%)
SKILLED
Small Blind with EXL Cloud skills but NO cheat sheet. The 5G architecture is present (883 named ranges, 21 sheets) but the rebuild process stripped formulas to values — only 574 of 944 intended formulas survive, dropping Automation to 3/10. Same CFS break as other 5G builds. This is the control case: skills alone without the cheat sheet produce a structurally complete but computationally broken model.
GPT 54/80 (68%)
SKILLED
GPT 5.6 via Microsoft Copilot, Small Blind. 1,914 formulas with 883 named ranges — adopts the same 5G/DA methodology as the Claude 5G builds. Complexity and Structure both 9/10, matching the best AI cells. The CFS break (~$1.08M) caps Confidence and Validations at 4. GPT 5.6 in Copilot is a major step up from GPT 5.5 (which scored 33 and 23 in prior runs) — the 5G methodology elevates it.
GPT 9/80 (11%)
COLD
Big Blind GPT 5.6 via Copilot — NON-BUILD. The output is the unmodified starting file: 171 formulas (all inherited from the template), 6 of 9 tabs empty, 12 broken cross-sheet links. Every factor floors at 1/10 except Structure (2/10, for having the starting file's tab layout). This is the worst result in the entire tracker history. GPT 5.6 in Copilot cannot build a model from scratch without skills.
Claude Fable 50/80 (62%) · subj 61/80
SKILLED
Fable 5.1 Small Blind on revised starting file (8.9.26 v2). 23-sheet dynamic-array build with ~120 custom LAMBDAs — the most formula-complex AI output in the cohort. Complexity 10/10 (the only AI cell to match Craig's perfect complexity). The CFS↔BS cash gap ($3,547,710) is inherited from the source design — identical to the defect in the human reference starting file — capping Confidence and Validations at 4. Recorded score 50/80; subjective score 61/80 adjusting for the inherited design limitation. Dashboards low (2/10) — Chart Data present but no dedicated summary views.
Claude Fable 61/80 (76%)
COLD
Fable 5.1 Big Blind on revised starting file (8.9.26 v2). LANDMARK RESULT: the only AI build in tracker history with ZERO killer flaws AND a perfect 10/10 on all deterministic audit checks. 17-sheet INDEX/MATCH + SUMPRODUCT row-driven architecture — closing cash ties to BS ($0.00 variance), BS balances exactly, net assets tie, Σ net cash movement ties. Validations 10/10 — the first AI cell to achieve a perfect validation score. Confidence at 2/10 because output magnitudes diverge from brief expectations (IRR 46.75% vs ground-truth 20.7–21.1%). Fit-to-Brief 9/10 — full convertible note, cap table, exit valuation. This is the new AI high-water mark at 61/80 (76%).
CONFIDENCE
Wide spread: humans 7–9, best AI 4 (capped by CFS breaks), worst 1 (non-build or static). The CFS reconciliation issue persists across 6 of 13 cells — both 5G and Fable 5.1 SB builds. Cell 13 (Fable 5.1 BB) breaks the pattern: clean CFS but Confidence still 2/10 due to magnitude divergence. Dive: root-cause the CFS↔BS gap and separate reconciliation confidence from magnitude confidence.
COMPLEXITY
5G methodology lifts both Claude and GPT to 9/10. Craig (human) and Fable 5.1 SB (Cell 12) share the only 10s — Fable 5.1 SB is the first AI cell to match human-level complexity with ~120 custom LAMBDAs. Cell 13 (Fable 5.1 BB) scores 9 with a simpler INDEX/MATCH architecture. Perplexity and BB GPT floor at 1–3. Dive: compare LAMBDA-driven vs INDEX/MATCH approaches for model sophistication.
STRUCTURE
5G tab taxonomy (Inp*/Time/Calcs/Statements) scores 8–9 across all 5G builds. Fable 5.1 BB also hits 9 with a distinct 17-sheet architecture. Fable 5.1 SB scores 8 with 23 sheets. The methodology, not the model, drives structure — but Fable 5.1 demonstrates that both LAMBDA-rich and row-driven approaches can achieve high structure scores. Dive: compare 23-sheet vs 17-sheet layouts for auditability.
FLEXIBILITY
Scenario selectors work in SB builds (8/10) including both Fable 5.1 cells. Cell 13 BB achieves 8/10 Flexibility — unusual for a Big Blind build and a significant advance over prior BB results (typically 1–3). The 5G architecture's spill-dependent drivers remain fragile without guided setup. Dive: how does Fable 5.1 BB maintain scenario flexibility without a starting file?
VALIDATIONS
Cell 13 (Fable 5.1 BB) achieves a PERFECT 10/10 — first AI cell in tracker history. Every deterministic check passes: BS balances, CFS ties, no formula errors, no broken links, full citation resolution. Fable 5.0 leads at 8/10. 5G builds cap at 4 because CFS doesn't reconcile. Dive: what architectural choices let Cell 13 pass all 10 checks where every other AI build fails at least one?
DASHBOARDS
Human Craig tops at 9/10 (Exec + SaaS dashboards). AI range: 1 (non-build) to 8 (Fable App). Cell 12 (Fable 5.1 SB) scores only 2/10 — Chart Data present but no dedicated summary views, the lowest Fable dashboard score. Cell 13 (Fable 5.1 BB) recovers to 7/10. Dive: why does the SB starting file constrain dashboard output vs the BB free-form approach?
AUTOMATION
5G dynamic-array builds score 9/10 (SB variants). Cell 12 (Fable 5.1 SB) scores 8/10 with ~120 custom LAMBDAs — a different automation approach to spill chains. Cell 13 (Fable 5.1 BB) scores 7/10 with INDEX/MATCH. The spectrum: LAMBDA-driven (Cell 12) vs dynamic-array (5G) vs row-driven (Cell 13) automation approaches. Dive: compare formula:input ratios and audit-trail clarity across automation styles.
FIT
Human Lance 10/10, Craig 9/10. Cell 13 (Fable 5.1 BB) matches Craig at 9/10 — the first AI cell to reach this level, with full convertible note, cap table, and exit valuation. Cell 12 (Fable 5.1 SB) scores 6/10. Prior AI range: 1 (non-build) to 7 (5G SB with cheat). Dive: what Fable 5.1 BB delivers that prior AI builds missed on cap-table and convertible-note logic.
2026-06-14
SAAS Model — Fable release (Excel Harness)
RUN_005 · Harness comparison: Excel live audit vs Desktop · 5 cells
COMPLETE
2026-06-14
Harness comparison: Excel live audit vs Desktop
COMPLETE
time Of Day: 10:00temperature: defaulttoken Limit: defaultprompt Length: extendednetwork Condition: stableretry Count: 0system Prompt: defaultthinking Mode: extended
Same ABC Pty Limited SaaS 3-Way brief as RUN_004 but scored via connected-workbook Excel harness (live read-only audit of actual .xlsb files) vs the Desktop harness used in RUN_004. Excel harness enables formula counting, colour-code sampling, structural verification, and BS/CFS tie-out — producing higher-confidence scores. Key finding: all Claude models scored higher under Excel harness scrutiny, with Fable jumping 54→62 (+8) and Opus 53→58 (+5). Copilot Opus was the biggest surprise, rising 40→48 (+8) — the #0000FF input audit confirmed proper colour coding missed by Desktop review. GPT dropped 33→23 as the Excel harness exposed that revenue/opex engines were never wired (all zeros despite clean BS).
CELL HARNESS VER CONFIDENCECOMPLEXITYSTRUCTUREFLEXIBILITYVALIDATIONSDASHBOARDSAUTOMATIONFIT TOTAL %
Claude Fable
SKILLED
Claude.ai 5.0 8 8 8 8 8 7 7 8
62
/80
78%
Claude Opus
SKILLED
Claude.ai 4.8 8 8 8 8 7 6 6 7
58
/80
72%
Claude Opus (Copilot)
COLD
Microsoft Copilot 4.8 7 6 6 6 6 6 6 5
48
/80
60%
GPT
COLD
Microsoft Copilot 5.5 3 3 4 3 2 2 3 3
23
/80
29%
Human Reference
REFERENCE
EXL Cloud 3-Way V7.11 9 9 9 9 10 9 9 10
74
/80
92%
KILLER FLAWS DETECTED
GPT · COLD: Revenue/opex engines never wired — all output zeros; 7 of 13 tabs completely empty; Repeated build failures (attempt 3 filename); No colour coding (135/636 inputs black)
Claude Fable 62/80 (78%)
SKILLED
Best-built AI model in the cohort. 11,478 formulas at >18x inputs, zero errors, balances and cash-ties across all 60 months / 20 quarters / 5 years. Full colour coding (blue inputs / green links / black formulas) and all 8 brief components present, incl. dual-condition convertible note with scenarios + IRR, PPT data PAL, AR & C equity rounds + 10% ESOP, exit valuation and a SaaS LTV/CAC dashboard. Original Desktop hand score under-rated Validations (6→8) and Automation (5→7); Excel evidence supports uplift. Dive deeper: convertible-note logic and SaaS metric definitions for assumption realism.
Claude Opus 58/80 (72%)
SKILLED
Structurally the most complete AI build — the only AI cell with a dedicated Change Log alongside Overview, Master Control, Dashboard and an 11-control Checks sheet. 8,068 formulas at 13.5x inputs, zero errors, BS balances every period. The single FLAG (18 periods of negative closing cash) is an output observation, not a build error — a worthy funding/review hold. Held back from Fable only by partial colour coding (funding inputs blue, many assumptions black). Dive deeper: the negative-cash periods and whether the Downside scenario drives them.
Claude Opus (Copilot) 48/80 (60%)
COLD
The biggest positive surprise of the run. Its COD/GST label and 48/80 original score understated it: #0000FF inputs on 20/20 sampled cells, all 6 internal checks pass, BS ties >2e-8, NMF reconciles to ~CFS, and a Dashboard + Sensitivity are present. The genuine gap is scope — no convertible-note logic, funding modelled as priced equity rounds only — which caps Complexity and Fit. Also no Instructions/Change Log and plain tab naming. Dive deeper: decide whether the missing convertible-note instrument is material to the ABC Pty brief.
GPT 23/80 (29%)
COLD
Marked DOWN on live audit. On paper it looks clean — 0 formula errors, BS balances, cash ties — but this is a hollow pass: every revenue/opex/funding line resolves to 0 because the engines were never wired in, and 7 of 13 tabs are completely empty. No colour coding (135/636 inputs black) and an attempt-3 filename pointing to repeated build failures. This is the case study for why a balanced balance sheet is necessary but not sufficient. Dive deeper: not worth salvaging cell-by-cell — re-run with skills loaded.
Human Reference 74/80 (92%)
REFERENCE
The benchmark, and it holds up: 19,830 formulas, zero errors, BS balances to <2e-8, dedicated Validations + Checks all passing, and full coverage of all 8 components including the Scenario Manager. Live audit confirms the original 74 with only offsetting nuance — a small structure deduction (no dedicated Change Log, plain tab naming) balanced by full automation. This is the standard the AI cells are measured against — use it to calibrate what good looks like per factor.
CONFIDENCE
Would you send this without re-checking it? Fable & both Opus builds earn 7-8 (clean, tie out). GPT drops to 3 — the output is all zeros. Dive: re-perform a sample of each model's headline outputs against the brief.
COMPLEXITY
Sophistication & completeness of the modelling. Driven by component coverage: Copilot-Opus capped at 6 (missing convertible notes); GPT at 3 (engines empty). Dive: convertible-note and ESOP mechanics.
STRUCTURE
Organisation, separation of inputs/calcs/outputs, navigation. Opus-Claude leads the AI cohort (dedicated Change Log). GPT's 7 empty tabs sink it. Dive: tab taxonomy and input/calc separation.
FLEXIBILITY
Scenario/driver flexibility. Working scenario managers in all Claude builds (Base/Upside/Downside); GPT's none functional. Dive: scenario switch wiring and driver sensitivity.
VALIDATIONS
Coverage & integrity of built-in checks. Fable's 20-check panel is best of cohort; GPT's Checks tab is empty. This factor shows the biggest original-vs-live swing. Dive: which checks each model actually runs vs claims.
DASHBOARDS
Output visualisation & decision-readiness. Fable's SaaS LTV/CAC dashboard is the strongest AI dashboard; GPT's dashboard tab is empty. Dive: are the dashboards linked live to outputs or static.
AUTOMATION
Formula-driven & dynamic vs manual/hardcoded. Measured by formula:input ratio + colour discipline. Human 21.5x, Fable >18x, GPT 2.66x with no colour coding. Dive: forecast-zone hardcode scan beyond the headline count.
FIT
Does it meet the ABC Pty SaaS brief end-to-end? Fable full hit; Copilot Opus dinged for the missing convertible-note instrument; GPT non-functional. Dive: brief line-items vs delivered components.
2026-06-11
SAAS Model — Fable release (Desktop Harness)
RUN_004 · Model release: Claude Fable 5.0 · 5 cells
COMPLETE
2026-06-11
Model release: Claude Fable 5.0
COMPLETE
time Of Day: 10:00temperature: defaulttoken Limit: defaultprompt Length: extendednetwork Condition: stableretry Count: 0system Prompt: defaultthinking Mode: extended
ABC Pty Limited SaaS 3-Way model brief — scored via Desktop harness (Claude.ai / Copilot UI review). Tests 5-tier revenue engine, payroll grades, convertible note dual-condition logic, debt P&I, equity rounds + ESOP, exit valuation, SaaS metrics dashboard. Human Reference is SAAS Financial Model Solution V7.11. File format .xlsb — audit based on metadata and structural signals due to MIME-type read limitation. See RUN_005 for the same brief re-scored under Excel harness with connected workbooks.
CELL HARNESS VER CONFIDENCECOMPLEXITYSTRUCTUREFLEXIBILITYVALIDATIONSDASHBOARDSAUTOMATIONFIT TOTAL %
Claude Fable
SKILLED
Claude.ai 5.0 7 7 8 7 6 6 5 8
54
/80
68%
Claude Opus
SKILLED
Claude.ai 4.8 7 7 8 7 6 6 5 7
53
/80
66%
Claude Opus (Copilot)
COLD
Microsoft Copilot 4.8 5 6 5 5 4 5 4 6
40
/80
50%
GPT
COLD
Microsoft Copilot 5.5 4 5 5 4 3 4 3 5
33
/80
41%
Human Reference
REFERENCE
EXL Cloud 3-Way V7.11 9 9 10 9 10 9 8 10
74
/80
92%
KILLER FLAWS DETECTED
GPT · COLD: Multiple build attempts needed; Likely hardcoded forecast values
2025-12-25
EXL Cloud SaaS Model Build — first benchmark
RUN_001 · Initial baseline run · 5 cells
COMPLETE
2025-12-25
Initial baseline run
COMPLETE
time Of Day: 14:00temperature: defaulttoken Limit: defaultprompt Length: standardnetwork Condition: stableretry Count: 0
First end-to-end evaluation. Christmas Day run. Established baseline scoring across cold and skilled tracks. Human reference fixed as EXL Cloud 3-Way V11.27.
CELL HARNESS VER CONFIDENCECOMPLEXITYSTRUCTUREFLEXIBILITYVALIDATIONSDASHBOARDSAUTOMATIONFIT TOTAL %
Claude Opus
COLD
Claude.ai 4.6 5 6 5 4 4 5 4 6
39
/80
49%
Claude Opus
SKILLED
Claude.ai 4.6 7 7 8 7 7 6 6 8
56
/80
70%
GPT
COLD
Microsoft Copilot 5.0 4 5 5 4 4 4 4 5
35
/80
44%
GPT
COLD
Microsoft Copilot 5.0 6 6 6 5 6 5 5 7
46
/80
57%
Human Reference
REFERENCE
EXL Cloud 3-Way V11.27 9 9 10 9 10 9 8 10
74
/80
92%
KILLER FLAWS DETECTED
Claude Opus · COLD: Hardcoded forecast in revenue line; Missing BS reconciliation
GPT · COLD: Hardcoded forecast values; Formula errors (#REF!) in CFS
GPT · COLD: BS not balanced

Score Trajectory Across Releases

TOTAL SCORE OVER TIME · MAX 80
0204060802025-12-252026-06-112026-06-142026-08-26Claude Opus · Cold: 39/80Claude Opus · Cold: 0/80Claude Opus · Cold: 0/80Claude Opus · Cold: 37/80Claude Opus · Skilled: 56/80Claude Opus · Skilled: 53/80Claude Opus · Skilled: 58/80Claude Opus · Skilled: 57/80GPT · Cold: 46/80GPT · Cold: 33/80GPT · Cold: 23/80GPT · Cold: 0/80Human Reference: 74/80Human Reference: 74/80Human Reference: 74/80Human Reference: 68/80Claude Fable · Skilled: 0/80Claude Fable · Skilled: 54/80Claude Fable · Skilled: 62/80Claude Fable · Skilled: 0/80Claude Opus (Copilot) · Cold: 0/80Claude Opus (Copilot) · Cold: 40/80Claude Opus (Copilot) · Cold: 48/80Claude Opus (Copilot) · Cold: 0/80Perplexity (Claude Opus) · Cold: 0/80Perplexity (Claude Opus) · Cold: 0/80Perplexity (Claude Opus) · Cold: 0/80Perplexity (Claude Opus) · Cold: 18/80Claude Fable · Cold: 0/80Claude Fable · Cold: 0/80Claude Fable · Cold: 0/80Claude Fable · Cold: 58/80GPT · Skilled: 0/80GPT · Skilled: 0/80GPT · Skilled: 0/80GPT · Skilled: 54/80GPT · Cold: 0/80GPT · Cold: 0/80GPT · Cold: 0/80GPT · Cold: 9/80Claude Fable 5.1 · Skilled: 0/80Claude Fable 5.1 · Skilled: 0/80Claude Fable 5.1 · Skilled: 0/80Claude Fable 5.1 · Skilled: 50/80Claude Fable 5.1 · Cold: 0/80Claude Fable 5.1 · Cold: 0/80Claude Fable 5.1 · Cold: 0/80Claude Fable 5.1 · Cold: 61/80
Claude Opus · Cold
Claude Opus · Skilled
GPT · Cold
Human Reference
Claude Fable · Skilled
Claude Opus (Copilot) · Cold
Perplexity (Claude Opus) · Cold
Claude Fable · Cold
GPT · Skilled
GPT · Cold
Claude Fable 5.1 · Skilled
Claude Fable 5.1 · Cold
RUN-OVER-RUN DELTAS
CELL 2025-12-252026-06-112026-06-142026-08-26 Δ TOTAL
Claude Opus · Cold 390037 -2
Claude Opus · Skilled 56535857 +1
GPT · Cold 4633230 -46
Human Reference 74747468 -6
Claude Fable · Skilled 054620 0
Claude Opus (Copilot) · Cold 040480 0
Perplexity (Claude Opus) · Cold 00018 +18
Claude Fable · Cold 00058 +58
GPT · Skilled 00054 +54
GPT · Cold 0009 +9
Claude Fable 5.1 · Skilled 00050 +50
Claude Fable 5.1 · Cold 00061 +61

Evaluation Methodology

Two Tracks per Run
Cold (no skills) vs Skilled (EXL Cloud SKILL.md loaded). Same matrix every run, isolating skill contribution from raw model capability.
Human Reference Fixed
EXL Cloud 3-Way model regardless of brief. Aspirational benchmark — apples-to-oranges by design, documented.
Killer-Flaw Caps
Hardcoded forecast values, formula errors, BS-balance failures auto-cap relevant rubric factors at 4/10. Surfaced as cell-comments.
8-FACTOR RUBRIC · MAX 80 POINTS
FACTOR 1
Confidence / Risk
0–10 points
FACTOR 2
Complexity
0–10 points
FACTOR 3
Structure
0–10 points
FACTOR 4
Flexibility
0–10 points
FACTOR 5
Validations & Checks
0–10 points
FACTOR 6
Dashboards
0–10 points
FACTOR 7
Automation
0–10 points
FACTOR 8
Fit to Brief
0–10 points
5-STEP PIPELINE
01 · eval-case-study-brief
02 · eval-model-audit
03 · eval-quality-scoring
04 · eval-comparison-workbook
05 · eval-trend-tracker
REGISTERED MODELS
Claude Opus
Claude.ai · v4.8
Claude Fable
Claude.ai · v5.0
Claude Fable
Claude.ai · v5.1
Claude Opus (Copilot)
Microsoft Copilot · v4.8
GPT
Microsoft Copilot · v5.5
Human Reference
EXL Cloud 3-Way · vV7.11 · REF
GPT
Copilot · v5.6
Perplexity (Claude Opus)
Perplexity · v4.5

How we score each AI model on financial modelling?

Every evaluation follows the same protocol to keep results comparable across models and prompt types.

Step 1: Task brief. The AI model receives a written brief describing a financial modelling task. For cold prompts, the brief contains only the task description and source data. For skilled prompts, the brief adds context, examples, formatting standards and step-by-step instructions.

Step 2: Output generation. The AI model produces its output, typically an Excel workbook or structured data. No manual corrections are made before scoring.

Step 3: Cell-by-cell scoring. Each of the 13 evaluation cells is scored independently against four criteria: accuracy (are the numbers correct?), formula logic (are formulas used instead of hardcoded values?), structure (is the layout logical and consistent?) and presentation (does it meet professional formatting standards?).

Step 4: Human reference comparison. The AI score is compared against the human reference score for the same task, completed by a qualified financial modeller under the same rubric.

Step 5: Documentation. Every run is documented with the full prompt, raw output, scored rubric and commentary. This documentation is what you see when you expand a run card in the tracker above.

What is a skilled prompt vs a cold prompt in AI financial modelling?

A cold prompt tests what an AI model can do with minimal guidance. A skilled prompt tests what it can do when guided by someone with domain expertise.

The distinction matters because it separates two questions: “How capable is the AI model?” and “How capable is the AI model when used by a qualified professional?”

In our evaluations, the gap between cold and skilled runs ranges from 15 to 20 points out of 80. That gap represents the modeller’s contribution through prompt design, not the AI’s native capability.

For accountants and finance professionals evaluating AI tools for financial modelling, the skilled-prompt score is more relevant. It reflects realistic usage: a professional using AI as an assistant, not a replacement.

Why we built this AI financial modelling tracker?

Most AI benchmarks test language tasks: summarisation, coding, reasoning puzzles. None of them test what matters to accountants and finance professionals: can this tool help me build, review or extend a financial model?

I built this evaluation framework because the question kept coming up in training sessions, client workshops and conference Q&As. “Which AI should I use for modelling?” There was no structured, comparable answer.

This tracker fills that gap. It applies the same scoring rubric across every model, every prompt type and every evaluation cell. When a new model version drops or a new tool enters the market, it gets the same 13-cell test.

The framework is designed for the accounting and finance profession specifically. The evaluation cells map to the tasks in a standard 3-way integrated financial model. The scoring criteria match the quality standards a senior modeller would apply when reviewing work.

We re-run evaluations as models improve and publish the results here so you can see which tools are ready for your workflow and where human oversight is still essential.

Frequently asked questions

Can AI build a financial model?

AI Financial Modelling: Can AI Build a Financial Model? We Tested Claude, GPT and Gemini

Yes, but with significant limitations. In our testing across 13 financial modelling tasks, leading AI models (Claude, GPT, Gemini) produce workable outputs for simpler cells like revenue builds and operating expenses, but consistently struggle with balance sheet reconciliation, cash flow linkage, and circular debt schedules. No model has yet produced a fully integrated 3-way model without manual correction.

Which AI is best for financial modelling?

AI Financial Modelling: Can AI Build a Financial Model? We Tested Claude, GPT and Gemini

Based on our structured evaluations, Claude (Anthropic) currently scores highest across financial modelling tasks, particularly on formula logic and structural consistency. GPT-4o (OpenAI) performs well on revenue and cost builds but drops on integration tasks. Gemini shows improving trend lines but lags on accuracy. Results are updated regularly as models improve.

How do you evaluate AI financial modelling accuracy?

AI Financial Modelling: Can AI Build a Financial Model? We Tested Claude, GPT and Gemini

We use a structured evaluation framework that tests each AI model against 13 financial modelling cells — from revenue builds and operating expenses through to full 3-way integration. Each cell is scored on four dimensions: accuracy (correct numbers), formula logic (proper Excel formulas, not hardcoded values), structure (layout, labelling, flow), and presentation (formatting, readability). Scores range from 0 to 10 across a 8 grading rubric.

Should accountants use AI for financial modelling?

AI Financial Modelling: Can AI Build a Financial Model? We Tested Claude, GPT and Gemini

Yes, as an assistant rather than a replacement. AI adds genuine value for first-draft generation, formula explanation, error-checking support and model documentation. It is not ready to produce a model that meets professional standards without human review. The skilled-prompt results show that the value of AI in financial modelling depends heavily on the quality of the instructions you give it.

What is an AI model evaluation framework for financial modelling?

AI Financial Modelling: Can AI Build a Financial Model? We Tested Claude, GPT and Gemini

An AI model evaluation framework is a structured scoring system that tests AI tools on defined financial modelling tasks. Our framework uses 13 evaluation cells covering revenue builds, operating expenses, balance sheets, cash flow and more. Each cell is scored on accuracy, formula logic, structure and presentation, with results compared against a human reference score. The framework allows consistent comparison across different AI models and prompt approaches.

How does the scoring rubric work?

AI Financial Modelling: Can AI Build a Financial Model? We Tested Claude, GPT and Gemini

Each evaluation cell is scored on four criteria, each worth up to 5 points: accuracy (correct numbers and calculations), formula logic (formula-driven rather than hardcoded), structure (logical layout and consistency) and presentation (professional formatting, labels and error checks). The maximum score per cell is 20. Runs typically score four cells at a time, giving a maximum of 80 per run.

What financial modelling tasks does this evaluation cover?

AI Financial Modelling: Can AI Build a Financial Model? We Tested Claude, GPT and Gemini

The framework covers 13 tasks that map to a standard 3-way driver-based financial model: revenue build, cost of goods sold, operating expenses, employee costs, depreciation, working capital, debt schedule, tax calculation, P&L consolidation, balance sheet, cash flow statement, 3-way integration check and presentation standards. These are the actual build steps a financial modeller would complete.

Share This

Related Articles

Project or Infrastructure Finance is arguable one of the most complex forms of financial modelling and the outcome most beneficial for the public.
There is certainly a big difference between a spreadsheeter and a financial modeler. However, the problem is who draws that line and determines who is placed on either side of it.
Most of this was very little hard-core coding but more a way of thinking and solving business problems with a financial wide-angle lens, not those really narrow ones.