FISTA Solutions does not load Google Analytics until you accept. Rejecting keeps optional analytics off. Read the Cookie Policy.

All field notes

Playbook · 6 minute read

How to Recover a Failing AI Project Before It Dies

Recovering a failing AI project means diagnosing the real cause rather than the reported symptom, narrowing scope to something achievable, rebuilding the evidence that the narrowed version works, and deciding honestly whether recovery or stopping is the better outcome for the organisation.

By FISTA Solutions· AI-Native Engineering Team·
How to Recover a Failing AI Project Before It Dies article cover

Most failing AI projects fail for a small number of reasons, and most of those are recoverable if diagnosed honestly. This playbook covers finding the real cause and deciding whether to continue, drawing on FISTA Solutions' forward deployed engineers work.

When is this worth doing?

When a project has missed its dates, when stakeholders have lost confidence, or when the team cannot say what is blocking them.

Earlier is considerably better. A project diagnosed at the first missed milestone recovers more cheaply than one diagnosed after three, by which point the confidence problem is larger than the technical one.

What does the sequence look like?

StepPurpose
1. Diagnose the real causeNot the symptom
2. Check the four usual suspectsScope, data, definition, ownership
3. Narrow to something achievableThe most reliable lever
4. Rebuild evidenceEvaluation on the narrowed scope
5. Deliver something smallConfidence follows delivery
6. Decide honestlyRecover or stop

Step 1 — Diagnose the real cause

Talk to the team, the stakeholders, and the people whose work the system touches, separately.

The reported cause is usually a symptom. A project described as blocked on model quality is frequently blocked on nobody agreeing what a correct answer looks like, which no amount of model work resolves.

Look at the artefacts too: is there an evaluation set, does the data support the task, is there a named owner. Their absence is diagnostic.

Step 2 — Check the four usual suspects

Scope that was never definable. Data that does not support the task. No agreement on what correct means. Nobody who will own the result in production.

Most failing AI projects have at least one of these, and frequently the same one. Technology is rarely the cause, although it is reliably blamed because it is the visible part.

Test each directly rather than accepting the team's view. Ask to see the evaluation set; ask who signs off a correct answer; ask who will own it in production. The gaps answer the question.

Step 3 — Narrow to something achievable

Cut the scope to the subset the system can handle reliably, and ship that.

This is the most reliable recovery lever available. Most failing projects attempted too much, and a system that works on the highest-volume third of cases delivers real value while the full scope does not.

Narrowing requires stakeholder agreement and is easier to get than a date extension, because it comes with something delivered. Be specific about what is now out of scope and what happens to those cases.

Step 4 — Rebuild the evidence

Build or repair the evaluation set for the narrowed scope and measure honestly.

Projects in trouble frequently have no evaluation, which is why nobody can say whether progress is being made. Establishing it converts arguments about impressions into a number.

The measurement may show the narrowed scope also does not work, which is painful and useful. Better to know in week two of a recovery than week ten. See how to run an ai evaluation program.

Step 5 — Deliver something small

Get the narrowed version into production for a real audience as quickly as the quality allows.

Confidence follows delivery. Stakeholders who have seen two revised plans will not be persuaded by a third, and a working system serving real users changes the conversation in a way no document can.

Keep the first delivery genuinely small. The goal is demonstrating that the project can ship, not demonstrating the full ambition.

Step 6 — Decide honestly whether to continue

At the end of the diagnosis, say whether recovery is possible.

Some projects should stop. Where the data does not support the task, where no narrowed version has value, or where the organisation cannot supply someone to define correctness, recovery is not available and continuing is expensive.

Saying so is the most valuable output a recovery effort can produce, and it is considerably better received when it comes with evidence. See how to kill an ai project.

What if the team is the problem?

Occasionally, and less often than stakeholders assume.

Teams that appear to be underperforming are usually working on a badly specified problem with no way to measure progress. Fix the specification and the measurement first, and reassess.

Where a genuine capability gap exists — nobody with production AI experience, for instance — address it by adding capability rather than by replacing people who understand the domain.

How do you handle the stakeholder relationship?

With frequent, honest, specific updates including the bad ones.

Projects in trouble frequently go quiet, which is the worst response. Stakeholders assume the worst and are usually right, and the silence removes the chance to help.

Short weekly updates stating what was tried, what was learned, and what is next rebuild trust faster than a recovery plan. The plan matters; the pattern of honest reporting matters more.

Who needs to be involved?

Someone from outside the project to diagnose, the team lead, the sponsor, and someone who can define what correct means.

The outside diagnostician is important. Teams inside a failing project have usually stopped seeing the assumption that is causing the problem.

How long does it take?

One to two weeks for diagnosis, then four to eight weeks to deliver the narrowed version. Recovery plans promising the original date repeat the original mistake.

What are the common failure modes?

Treating the symptom. Adding people. Extending the date without narrowing. Recovering without evaluation. Going quiet with stakeholders. And continuing when the honest answer is to stop.

How do you know it worked?

A narrowed version in production serving real users, an evaluation set that shows whether it works, and stakeholders who can see progress rather than plans.

What does it cost?

Mostly people's time rather than tooling. The expensive version is the one that stalls halfway and leaves the organisation with neither the old state nor the new one, which is why a narrow first pass beats a comprehensive plan nobody finishes.

Budget the work as an operated change rather than a project with an end date, because most of these need a maintenance tail. See AI total cost of ownership.

What should you do first?

Ask who decides what a correct answer looks like for this system. If there is no clear answer, that is the cause and everything else is downstream of it.

How FISTA Solutions helps

FISTA Solutions runs this work alongside client teams rather than around them: diagnosis conducted by someone outside the project, scope narrowed to something deliverable and measured before anything else is promised, evidence produced as the work proceeds, and handover that leaves your people able to continue without us. Delivery runs through AI agents, AI enablement, and forward deployed engineers. The record is 150+ projects for 50+ companies across 12+ countries, with 47% average efficiency gains where measured.

To run this with support, message FISTA on WhatsApp, or read how to kill an AI project.

Share-ready article cover

Download the generated social format.

Download cover

Clear answers

Questions raised by this field note.

Straightforward guidance for evaluating scope, fit, and the next step.

01What usually causes AI projects to fail?

Scope that was never definable, data that does not support the task, no agreement on what a correct answer is, or nobody who will own the result. Technology is rarely the cause and frequently the blamed party.

02Why is narrowing the most reliable lever?

Because most failing projects attempted too much. A system that works reliably on a third of the cases is deliverable; the same system across all cases may not be, and narrowing converts a failure into a partial success.

03How do you rebuild stakeholder confidence?

With a small delivered result rather than a revised plan. Stakeholders who have seen a plan revised twice will not be persuaded by a third; they will be persuaded by something working in production.

04When is recovery not the answer?

When the data genuinely does not support the task, when no narrowed version has value, or when the organisation cannot supply someone to decide what correct means. Those are stopping conditions rather than recovery problems.

05How long does recovery take?

Usually longer than the original estimate for the remaining work, because the diagnosis and the confidence rebuilding both take time. Recovery plans that promise delivery on the original date repeat the original mistake.

Start with the hard problem

Need the outcome owned, not merely analyzed?

Tell us where delivery is constrained. We’ll map the fastest credible path from intent to verified production.

Start a project