Devansh Kamlani
The hardest meeting I sit in is the one where leadership asks “what is the ROI of our AI investment?” and the team has to answer honestly. I have been in plenty of those meetings, and I have learned that the honest answer is rarely what either side wants to hear. AI investments deliver real value, but the value is messy, distributed across teams, and often appears six months after the spend that produced it. Without a clear framework, the conversation devolves into anecdotes versus invoices, and the invoices always win in the short term.
AI ROI Frameworks: How Architects Justify Investments
Over the years I have built up a set of ai roi frameworks that survive contact with a CFO. They are not magic. They are disciplined ways to attribute value, account for timing, and present a credible case at investment time and a credible scorecard after launch. I use them both to justify new investments and to defend existing ones during budget season.
In this article I will share the calculation methods I rely on, the measurement challenges that make AI ROI uniquely hard, the use case benchmarks I have collected, the business case slide I always build, the post-launch tracking that keeps the conversation honest, the reasons most AI projects underdeliver against their projections, and the formal frameworks like NPV, payback and total economic impact that bring rigour to the discussion.
Why AI ROI is uniquely difficult to measure
Traditional IT ROI is usually clean. Replace a legacy system with a modern one, count the licence savings, the operational savings, and the reduced incident cost, and the maths is straightforward.
AI ROI is messier for four reasons:
- Distributed benefit. The savings show up in many small interactions across many teams, not in one consolidated line item.
- Attribution. Did revenue grow because of the AI capability, the marketing campaign, the seasonality, or all three?
- Lag. Productivity gains compound slowly. The first month often shows a productivity hit as people learn the new tool.
- Novelty effect. Initial enthusiasm inflates measured benefit. Sustained benefit is lower and harder to see.
The architects who survive ROI conversations are the ones who get ahead of these effects, name them explicitly, and present a framework that accounts for them rather than pretending they do not exist.
I have learned to lead with the framework, not with the number. A credible framework with conservative numbers is more persuasive than a dramatic number with no framework.
The four sources of AI value
I categorise every AI ROI claim into one of four buckets. The categorisation forces clarity about what is being measured.
| Source | Definition | Typical measurement |
|---|---|---|
| Cost reduction | Lower cost to deliver the same output | Hours saved, headcount avoidance, ticket deflection |
| Revenue uplift | Higher revenue from existing or new offerings | Conversion lift, basket size, retention |
| Productivity | More output per person per unit of time | Cycle time, throughput, quality |
| Risk reduction | Lower probability or impact of bad events | Incidents avoided, compliance fines avoided, defect rate |
A use case usually has a primary source and a secondary source. The discipline is to lead with one number and report the others as supporting evidence, not to mash them all together into a single inflated headline.
Cost reduction calculations
Cost reduction is the easiest to measure and the most likely to be challenged by finance. My standard formula:
Annual cost reduction = (Volume of work) × (Time per unit) × (Loaded hourly cost) × (Automation rate) × (Containment factor)
The factors that get manipulated:
- Volume of work. Use actual volumes from the last twelve months, not projections.
- Time per unit. Time studies, not estimates.
- Loaded hourly cost. Salary plus benefits plus overhead. Finance has the number; use theirs, not yours.
- Automation rate. What proportion of work the AI actually completes without human intervention.
- Containment factor. What proportion of automated work stays automated and does not bounce back to humans.
The containment factor is the one most often missed. A chatbot that handles 80 percent of queries but escalates 30 percent of them to humans is not delivering 80 percent cost reduction.
Revenue uplift calculations
Revenue uplift is the most attractive metric and the most fragile. The pitfalls are well-known: AI capabilities rarely cause revenue in isolation, and the temptation to claim credit for revenue that would have happened anyway is overwhelming.
My disciplined approach:
- Controlled experiments where possible. A/B test the AI capability against the control. Measure the difference, not the absolute.
- Cohort analysis. Compare users with the AI capability to comparable users without it, over similar time windows.
- Pre-post with controls. When experiments are not feasible, compare pre-launch and post-launch performance against control segments to net out seasonality.
- Attribution discounting. Apply a haircut to claimed revenue based on the confidence of attribution. Forty to sixty percent is reasonable for capabilities that influence revenue indirectly.
Finance teams have heard inflated revenue claims for decades. They respect a discounted, defensible number more than they respect an aggressive one.
Productivity calculations
Productivity is where AI most often delivers and most often fails to be credited. The reason is that productivity gains show up as either faster delivery or more delivery, not as line items in the P&L.
The metrics I track:
- Cycle time. How long it takes to complete a standard unit of work. Pull request time for engineers, ticket time for support, deal cycle for sales.
- Throughput. Units of work completed per person per period.
- Quality. Rework rate, defect rate, customer satisfaction on completed work.
- Capacity unlocked. If teams are doing the same work in less time, the hours freed up have a value. Quantify it.
Productivity gains only translate to ROI if they are redeployed to value-creating work. A team that gets faster but does not do more is generating slack, not value. The architect’s job is to make the redeployment visible.
I require productivity claims to include the redeployment story. Without it, the gain is theoretical.
Risk reduction and avoidance
Risk reduction is the hardest to quantify because the counterfactual is what did not happen. Yet it is often where AI delivers the most value, especially in compliance, fraud and operations.
My framework for risk reduction ROI:
- Baseline risk exposure. What is the expected annual cost of the risk without the AI capability?
- Risk reduction factor. What proportion of the risk does the AI capability mitigate?
- Adjusted exposure. Baseline × (1 - reduction factor).
- Value of reduction. Baseline - Adjusted exposure.
Calibration matters. Inflated baselines and optimistic reduction factors get this category dismissed. Conservative baselines, supported by historical data, and reduction factors validated by pilot results, get this category taken seriously.
Use cases where I have seen risk reduction dominate the ROI:
- Fraud detection reducing chargebacks and write-offs.
- Compliance review reducing regulatory fines.
- Predictive maintenance reducing unplanned downtime.
Measurement challenges and attribution
The technical measurement challenges I deal with regularly:
- Selection bias. Early users of an AI capability are not representative.
- Hawthorne effect. Performance improves when people know they are being measured, regardless of the capability.
- Confounding. Other changes (process improvements, hiring, market shifts) happen simultaneously.
- Drift. The baseline changes during the measurement period.
- Aggregation. Average effects can mask large variation across segments.
The methods that help:
- Randomised rollouts. Where feasible, assign users to treatment and control at random.
- Staggered rollouts. Roll out to teams in waves, comparing earlier waves to later waves.
- Difference-in-differences. Compare pre-post change in the treatment group to pre-post change in the control group.
- Instrumental variables. When randomisation is impossible, find variables that affect treatment exposure but not outcome.
I am not advocating for academic rigour in every measurement. I am advocating for enough rigour that the number survives scrutiny.
Use case benchmarks
Real benchmarks vary widely, but the ranges I have observed in production deployments:
| Use case | Typical productivity uplift | Typical cost reduction | Notes |
|---|---|---|---|
| Code assistance | 20-40% on eligible tasks | Limited direct cost reduction | Quality varies by language and seniority |
| Customer service triage | 30-60% containment | 25-40% cost reduction | Highly variable by domain |
| Document summarisation | 60-80% time saving | 30-50% cost reduction | High value in legal and research |
| Sales enablement | 10-25% cycle time reduction | Modest cost reduction | Revenue uplift is the dominant metric |
| Internal knowledge search | 40-70% time saving on lookups | Modest cost reduction | Productivity is the dominant metric |
| Marketing content | 50-80% draft time saving | 20-40% cost reduction | Quality control is the bottleneck |
These are anchors, not promises. Use them to sanity-check your projections. If your projection is at the top of every range, your projection is probably wrong.
I treat benchmarks as a credibility test. If a business case claims uplift well outside the benchmark range, it needs strong evidence to support it.
Building the business case
My standard business case slide for an AI investment includes:
- The use case in one sentence.
- The four ROI sources, with the primary clearly identified.
- The headline ROI number, the discounting applied, and the confidence level.
- The investment required, broken into one-off and recurring.
- The payback period.
- The key risks and the mitigations.
- The success metrics and the review cadence.
The slide is one page. Anything longer gets summarised at the front for the executive who reads only the first slide. The disciplined business case wins more often than the impressive one because executives prefer to fund the things they understand.
I always include a “what if” sensitivity table showing the ROI under conservative, base and optimistic assumptions. Executives know that base case is fiction. Showing the range tells them I have done the work.
NPV, payback and TEI
Formal financial frameworks bring structure to the conversation:
- NPV (Net Present Value). Discounts future cash flows to present value. The discount rate is set by finance, usually around 10 percent for IT investments. NPV positive at the chosen rate means the investment creates value.
- Payback period. How long until cumulative net benefit equals the investment. Useful for time-bound risk assessment. A two-year payback is comfortable for AI; longer than three years is hard to defend.
- IRR (Internal Rate of Return). The discount rate at which NPV is zero. Useful for comparing investments of different sizes.
- TEI (Total Economic Impact). A Forrester framework that combines benefits, costs, flexibility (optionality) and risk. Often used by vendors to justify their products; I have found it useful for internal cases too.
I default to NPV plus payback for most cases. The combination shows both magnitude and timing. TEI is helpful when the investment unlocks optionality that simple NPV understates.
Post-launch ROI tracking
The business case is the start. Post-launch tracking is what makes the next business case credible.
The minimum tracking I require:
- Quarterly review of actual versus projected ROI.
- Variance analysis. Where did actuals diverge, and why?
- Adjusted projections. Update forward-looking ROI based on learning.
- Decision points. Continue, scale, modify, or sunset.
I have seen organisations launch AI capabilities, declare victory, and never look back. Three years later, the capability is still running, still costing money, and nobody can say what it delivers. Sustained tracking prevents this.
Quarterly is the right cadence for most use cases. Faster creates noise. Slower lets drift accumulate.
Why most AI projects underdeliver
Studies routinely report that 70 to 80 percent of AI projects fail to deliver expected value. The reasons I see most often:
- Overoptimistic initial projections. Sales-led estimates rather than evidence-based projections.
- Insufficient adoption. The capability ships but users do not use it.
- Misaligned incentives. The team that builds is not the team that benefits.
- Underinvestment in change management. Technology is delivered, behaviour is not.
- Wrong use case. A solution looking for a problem.
- Inadequate measurement. No one tracks whether the value materialised.
The single biggest predictor of success I have seen is whether the business owner of the workflow is also the sponsor of the AI investment. When IT sponsors and the business consumes, projects often stall. When the business sponsors and IT enables, they tend to deliver.
Communicating ROI to executives
Executives have heard inflated ROI claims for years. They have learned to discount what they hear. The communication patterns that work:
- Lead with the headline number, then explain the framework. Not the other way round.
- Show your work. Source of each input, attribution method, confidence level.
- Be explicit about what you do not know. “We do not know the long-term retention effect; here is what we will measure.”
- Pre-empt the obvious counter-questions. “Yes, we adjusted for seasonality. Here is how.”
- Distinguish projected from realised. Be ruthless about which is which.
The credibility you build over multiple cycles compounds. The first overpromised case undermines the next ten honest ones. Honest projections, even if smaller, win more often over time.
Common ROI mistakes
The mistakes I see repeatedly:
- Stacking benefits. Counting the same productivity gain in multiple categories.
- Ignoring run costs. Headline benefit minus implementation, ignoring operational cost.
- Confusing usage with value. “We have ten thousand users” is not ROI.
- Vanity benchmarking. Comparing to vendor-quoted benchmarks rather than to your own baseline.
- No counterfactual. “Revenue grew 10 percent” without “and it would have grown 7 percent without the AI.”
- Static cost projections. Token costs go down. Operational costs go up as systems scale.
I keep a checklist of these and run it against every business case I review. About a third of cases fail the checklist on first pass.
