← LEARN

Where AI CanGo Wrong.

Generative AI can produce useful work quickly, but a polished answer is not proof that the answer is correct. Understanding how AI can fail helps you decide what to trust, what to check and when human judgment must take over.

01 / CONFIDENCE VS ACCURACY

A convincing answer can still be wrong.

Generative AI is designed to produce useful responses from the information and patterns available to it. That means an answer can be well written, detailed and professionally formatted while still containing incorrect information.

This is especially important at work because presentation can create a false sense of reliability. A neatly structured report, calculation or explanation may look ready to use before its facts have actually been checked.

IMPORTANT DISTINCTION

Fluency tells you that AI generated a coherent response. It does not tell you that every claim inside that response has been verified.

02 / COMMON FAILURE MODES

Six ways an AI response can become unreliable.

Not every mistake has the same cause. Recognising the type of failure makes it easier to decide how the output should be checked or improved.

01

Confidently wrong answers

AI can produce an answer that sounds clear and convincing even when some of the information is incorrect, invented or unsupported.

Plausible ≠ verified
02

Missing context

If important details are missing from your prompt, AI may fill the gaps with assumptions that do not match your actual situation.

Missing input → weaker output
03

Outdated information

An AI system may not automatically have the latest prices, policies, regulations, product details, news or internal company information.

Current facts need current sources
04

Calculation & logic errors

AI can make mistakes in arithmetic, comparisons, multi-step reasoning or data interpretation. Important figures should be checked independently.

Recalculate critical numbers
05

Incomplete or biased output

An answer can reflect incomplete information, patterns in its training data or the way a question was framed, leaving out important perspectives.

Check what may be missing
06

Following a weak instruction

AI may produce poor results simply because the task, audience, constraints or expected output were not clearly defined.

Better context improves control
03 / REAL-WORK EXAMPLE

AI should not invent the reason for an inventory variance.

Imagine the system shows 500 units of an item, while a physical count finds only 476 units. There is a shortage of 24 units.

If you simply ask AI, “Why are 24 units missing?”, it may suggest several possible causes: receiving errors, incorrect picking, unrecorded damage, transfer mistakes or theft.

✕ WRONG APPROACH

Treat the suggestion as the cause.

“AI says the shortage was caused by an unrecorded outbound transaction.”

AI has not inspected your warehouse, WMS transactions or physical stock.
✓ BETTER APPROACH

Use real records to establish the cause.

Recount the stock, review receiving and outbound transactions, transfers, adjustments, locations and other relevant records.

Once the evidence is collected, AI can help organise and communicate the findings.
01Evidence

Collect real operational records.

→
02Investigation

Determine what actually happened.

→
03AI assistance

Structure or summarise verified findings.

→
04Human approval

Review before taking action.

04 / RISK LEVEL

The amount of checking should match the consequence of error.

Not every AI response needs the same level of verification. A brainstorming mistake and an incorrect compliance instruction do not carry the same consequences.

01LOWER RISK

Brainstorming ideas

Generating possible names, topics, questions or early concepts where a wrong suggestion causes little harm.

Quick human review
02MEDIUM RISK

Workplace drafts

Emails, reports, SOP drafts and summaries that may influence other people but can be reviewed before use.

Careful review before sending
03HIGHER RISK

Decisions & critical facts

Financial, legal, medical, safety, compliance or operational decisions where incorrect information could cause serious consequences.

Verify with authoritative sources
GENERAL RULEThe greater the consequence of being wrong, the stronger the verification should be.
05 / HUMAN REVIEW

Ask questions about the output before you use it.

Reviewing AI output does not mean reading it once and deciding that it “looks good.” Focus your review on the parts most likely to create problems.

01

Which claims in this output need verification?

CHECK
02

Are names, dates, numbers and references correct?

CHECK
03

Did AI assume anything I did not provide?

CHECK
04

Is important context missing from the answer?

CHECK
05

Would an error here affect money, safety, customers or operations?

CHECK
06

Who should approve this before it is used?

CHECK
VERIFY AGAINSTReliable evidence
Official documentsCompany systemsOriginal recordsAuthoritative sourcesQualified professionals
06 / PRACTICAL TAKEAWAY

Use AI as an assistant, not automatic proof.

The goal is not to distrust every AI response. The goal is to understand what kind of confidence is justified for the task in front of you.

01Generate

Use AI to produce useful work.

→
02Question

Identify assumptions and claims.

→
03Verify

Check important facts independently.

→
04Decide

Apply human judgment before action.

BETTER INPUTS HELP

Give AI clearer context and constraints.

Better prompting cannot eliminate every AI error, but clear context, requirements and output instructions can reduce avoidable misunderstandings.

Open Prompt Builder
NEXT LESSON

AI vs Human Judgment

Learn where AI assistance ends and human experience, responsibility and judgment become essential.

CONTINUE →