Sales · Process breakdown

How should we analyse won and lost deals?

Can AI replace win loss analysis? This guide shows which tasks can be automated, where bounded AI helps and when humans must remain in control.

6 stepsTypical mix: Keep humanIllustrative analysisUpdated

Can AI replace win loss analysis? Short answer: not entirely. You can automate routines like transcription, tagging and structured data extraction, and use bounded AI to surface themes and draft summaries. Human reviewers must validate interview nuance, strategic judgement and causal claims. This guide lays out prerequisites, clear controls, failure modes and a small pilot to test what automation and AI can reliably do in your sales process.

What each step needs

01 Human review

Step 1: Define scope and goals

Decide which deal sizes, timeframes and win/loss categories to include. Clarify business questions: competitor reasons, product fit, pricing sensitivity or sales process gaps.

Include representative deals from the last 6 to 12 months and a clear set of research questions.
02 Standard automation

Step 2: Prepare data and consent

Gather CRM records, proposals and contact permissions. Record consent for interviews and for AI processing. Ensure data minimisation and retention rules before automation begins.

All buyer contacts must have explicit consent and data retention policies documented.
03 Standard automation

Step 3: Deterministic automation

Automate reproducible tasks: call recording, accurate timestamped transcription, CRM enrichment, and structured tagging of deal attributes using deterministic rules.

Use tested transcription and rule engines with audit logs and version control.
04 AI candidate

Step 4: Bounded AI assistance

Apply constrained models to extract sentiment, propose themes and draft neutral summaries. Limit generation to defined templates and ask the model to cite source timestamps and speaker turns.

Use models with evidence referencing and limit prompts to specific extraction tasks.
05 Human review

Step 5: Human review and synthesis

Experienced analysts validate AI outputs, reconcile conflicting evidence, assess buyer intent and produce final conclusions and recommended actions for sales, product and marketing.

A trained reviewer must audit every AI-generated summary and tag before publication.
06 Keep human

Step 6: Act, monitor and iterate

Share findings with stakeholders, track outcomes of recommended changes, and continuously measure whether themes recur. Update rules and model prompts based on new evidence.

Run quarterly checks on model accuracy and process effectiveness, and log changes.

A sensible first experiment

Run a small experiment on 10 recent deals: use deterministic automation to transcribe and tag, run bounded AI to draft themes, then have two human reviewers independently validate outputs. Compare time, disagreement causes and any missed nuances to decide what to scale. Capture audit logs and measure reviewer corrections.

The trap to avoid

Relying on unconstrained generative AI or skipping human validation risks false causal claims, invented quotes or overfitting to noisy data. Failure modes include poor transcription, misattributed speaker turns, biased sample selection, and unjustified generalisation from small samples. Mitigate by enforcing consent, versioned rules, explicit citation of source timestamps and mandatory human signoff.

Questions teams ask

Which parts are safest to automate?

Safest tasks are deterministic: recording, timestamped transcription, CRM enrichment and rule-based tagging. These are reproducible and auditable and reduce manual work while preserving source fidelity for later review.

What should bounded AI not be allowed to do?

Do not allow AI to make final causal claims, fabricate quotations or replace human judgement on buyer intent. Keep AI outputs as proposed drafts that cite evidence, and require human signoff before use.

How do we measure if the process is working?

Track reviewer correction rates, agreement between independent reviewers, time per analysed deal and whether implemented recommendations affect relevant KPIs. Regularly sample outputs for quality assurance.

Who should perform human review?

Prefer analysts with sales experience and qualitative research training. They must be skilled at interpreting buyer language, detecting bias and linking evidence to well supported recommendations.

Illustrative workflow guidance by Arcgent. Each business needs its own assessment. No integration or savings claim has been verified for your systems.

Now, what about your process?

Get an assessment based on your own steps, systems, and constraints.

Audit my process See an example report ↗