Guide

Which source should an AI agent use when documents disagree?

Define the reference source for each information type, distinguish recent and approved versions, and route unresolved conflicts to a person.

By AIKUB ·

A client file contains an approved procedure and a draft edited more recently. Which should be used to prepare a reply? Before assigning that task to an AI agent, define which source has authority for each type of information. A recent date is not enough. This guide proposes a scoping method that keeps conflicts visible and sends them to an authorized person for resolution.

Why is the newest document not enough?

Consider a fictional customer service case: an approved procedure requires a supporting document, but a recent draft proposes removing that requirement. The draft’s modification date only shows that it was edited. It does not establish approval or when the change takes effect. Ask the agent to distinguish these facts instead of automatically selecting the newest file.

For this case, the rule could be to prepare the reply from the approved procedure that still applies and flag the draft separately. If approval or applicability cannot be confirmed, the affected reply stays pending. This example describes behavior to define and test, not a client result or a guarantee that every conflict will be detected.

How do you define the reference for each type of information?

Start with the information needed for one task. For each item, identify the authorized source, the field or passage to consult, the expected approval status, and the person who can confirm its meaning. The CRM may be the reference for the case number, while an approved procedure defines which documents to request. One tool does not have to be authoritative for everything.

The reference record should also specify excluded versions, an effective date where one exists, and how to handle unavailable sources. Record the priority rule before use. Do not let the agent invent that priority from a filename, a file’s position in a folder, or the confident wording of an email.

What should be prepared when a conflict remains unresolved?

Request a short discrepancy record: case reference, disputed information, relevant excerpts, links to accessible sources, and versions consulted. Separate confirmed facts from the open decision. The question for the human reviewer should be specific, such as: is this new requirement approved for this type of request?

Limit the record to necessary data and authorized recipients. Until the conflict is resolved, the agent should not merge both versions into an improvised rule, correct source documents, or present the reply as validated. It may prepare the internal context allowed by its mandate without expanding access to search elsewhere.

How should work resume after the human decision?

The authorized person specifies the selected source, the reason for choosing it, and the cases covered by the decision. If a source needs correction, assign that correction to someone with the necessary permissions. A decision for one case should not automatically become a general rule for every client.

Before preparation resumes, verify that the selected version is still accessible and applicable. If the document has changed since the decision, request another check when that change affects the reply. Keep the decision and its reference with the case, then review the resumed output. Resolving a conflict does not remove the approvals required before sending.

What should you bring to an AIKUB diagnostic?

Bring a repetitive computer task and anonymized examples of its sources. Identify who approves the documents, how your team recognizes the applicable version, and what output it expects when a reference is missing. If those rules are unclear, the first job is to define them, not to give the agent more documents.

AIKUB supports this scoping with personalized, governed agents, including support and training. Find your first quick win by choosing a preparation task whose sources can be checked. For that initial scope, define the reference record, human resolution process, and test cases before broader use.

Frequently asked questions

Does a modification date prove that a document is approved?

No. Define approval status and applicability separately. A recent draft may remain excluded from reply preparation even if the agent can access it.

Must all data be centralized in one tool?

Not necessarily. For this scoping exercise, specify which source has authority for each piece of information needed by the task, with limited access and a rule for conflicts.

Can the agent correct conflicting sources itself?

Not under a mandate limited to reading and preparation. A correction requires separate authorization, the necessary permissions, and the approvals defined by the company.