When an AI assistant recommends an action, an evidence ledger records more than its fluent explanation: it identifies the task, the source version used, the checks that actually ran, the human authority involved and the independently observed result. An investigator should be able to ask: who asked for this, which facts were available at the time, what changed, and can we verify the answer without trusting the model’s own account? This is the practical purpose of an agent evidence ledger. It is not proof that every model inference was true; it is a carefully scoped record of evidence and responsibility.
Start by separating four kinds of records. A conversation transcript preserves words; an operational trace links components and timing; an access log records selected events; a decision ledger connects a particular claim and proposed action to evidence, authorisation and outcome. In this guide we build a reproducible ledger for a fictional education-helpdesk agent, work through its arithmetic, distinguish replay from reenactment, test tampering and missing inputs, then transfer the design to another setting. Nothing here assumes artificial superintelligence already exists. The controls are useful for today’s limited AI-assisted workflows.
This chapter extends the How Super Intelligence Works library. Pair it with agent observability for timing and causal tracing, data consistency for independent verification and review queues for authorisation boundaries. All operational figures and names in the following workshop are deliberately invented teaching data, not measured provider performance.
Choose your route
- New to AI operations? Read Sections 1–4, then try matching each claim to an actual source and a recorded check.
- Auditing an agent in a workplace? Follow the worked sixty-decision ledger and independently recalculate the denominators.
- Responsible for privacy or policy? Focus on Sections 9–13 before collecting anything at scale.
- Teaching or studying AI? Cover the worked example, then solve the transfer problem before looking at its explanation.
Contents
- 1. Evidence is not a transcript
- 2. Define a decision chain
- 3. Record design: the minimal contract
- 4. Time, identity and authority
- 5. Worked laboratory: sixty decisions
- 6. Check the numerical ledger
- 7. Independently verify actions
- 8. Reproduce a historical decision
- 9. Detect gaps and tampering
- 10. Protect people in the ledger
- 11. Failure diagnosis and repair
- 12. Transfer challenge and solution
- 13. Limits and organisational responsibility
- Frequently asked questions
- Standards and source reading
- Reader pathways and next lessons
1. Evidence is not a transcript
Imagine that an assistant writes, “I checked the school calendar and successfully moved your session.” The first part is a claim about knowledge; the second is a claim about action. Neither sentence tells us which calendar version was read, whether the person giving the instruction had permission, whether the requested change remained valid after a concurrent edit, or whether the booking database recorded anything. The wording sounds complete, yet it could describe a mere intention. A useful ledger captures the gaps a fluent answer can hide, without turning every token of private conversation into a permanent record.
An evidence ledger is best understood as an append-oriented account of decision-relevant events. Each event should identify a stable task, the step being recorded, a time and producer, an evidence reference, an authorisation reference where relevant, and an outcome classification that can be independently checked. Append-oriented does not mean immortal or universally public. Retention and erasure still matter. It means correcting a mistaken historical event by recording a correction and preserving the relationship, rather than silently rewriting an important decision to make the history look cleaner.
Keep four questions distinct. “What did the model suggest?” is answered by a proposal record. “What information influenced the suggestion?” requires source references and frozen or versioned inputs. “Was the system permitted to act?” requires a grant, its scope, the person or policy that issued it, and its expiry. “What happened?” requires a receipt or readback from the system of record. Without that fourth question, the ledger can become an elaborate autobiography written by the same unreliable component it is meant to examine.
The W3C PROV ontology provides useful vocabulary: entities are things with identifiable aspects, activities use or generate entities, and agents bear responsibility for activities or entities. An operational ledger can borrow that conceptual discipline without claiming to implement every feature of PROV-O. The NIST AI Risk Management Framework also places documented measurement and governance within a wider risk-management cycle. Neither source says a particular ledger format will make a system trustworthy by itself.
2. Define a decision chain
A decision chain starts with an intended outcome, not with the model output. For a tutoring scheduler, that outcome may be “offer two available times, and change the booking only after a named guardian confirms.” The chain can be represented as intake, source read, candidate selection, verification, approval check, authorised write, independent readback and communication. These steps may be implemented by software, people or both. A step becomes an auditable event when it has enough context to explain why the next step was allowed.
Use an intent identifier to bind all steps concerning the same user request, and a separate attempt identifier for each execution. If a network timeout triggers a second attempt, the evidence should not make two attempted writes look like two independent requests. If a guardian submits an entirely new request, the system should not reuse the previous approval simply because the student’s name matches. This distinction makes duplicate suppression, delayed callbacks and human-review expiry comprehensible during an investigation.
Evidence references need version specificity. A URL pointing to a live calendar is not an adequate record of the calendar observed yesterday, because its contents may now differ. Prefer a source record with retrieval time, source authority, document or response version, stable location, digest where appropriate, and a precise description of what was checked. A digest helps detect changed bytes; it does not establish that those bytes were correct, fair, current or lawfully collected. Evidence quality also depends on who produced it and how the original source was verified.
The action boundary deserves special attention. The model can propose “reserve 16:00”; the review service can approve a scope-limited command; the booking service can accept, reject or time out; and only a separate query can establish whether the desired reservation exists. When the response is uncertain, record “outcome unknown” and reconcile before retrying. That small phrase prevents the attractive but false claim that sending a command is equivalent to completing the request.
3. Record design: the minimal contract
A useful record format starts small. Require a schema version, event ID, parent event or causal predecessor, intent ID, attempt ID, event type, event producer, trusted timestamp source, policy version, subject reference, source identifiers, permission decision, tool request reference and observed result where applicable. Not every field is relevant to every event. The schema should make missing values explicit rather than filling them with fictional placeholders. An event that documents a research-only suggestion has no booking receipt; a completed action does.
For example, an evidence envelope might read: intent EDU-041, attempt A1, source calendar-v17, policy approve-before-write-v4, proposal 16:00, guardian approval AP-86 with expiry 16:10, command booking-update with idempotency key EDU-041-change, and final booking readback revision 902. The identifiers are teaching labels, not real credentials. In a real system they would point to access-controlled records, and reviewers would verify that revisions and receipts came from the authoritative service rather than from a fabricated assistant summary.
Make event kinds strongly typed. Proposal, source_observation, policy_evaluation, approval_granted, approval_denied, tool_attempted, tool_receipt, state_readback, user_notified and correction are not interchangeable. A failed verification must not be stored under a generic success event. Enumerated outcomes such as proposed, denied, queued, executed, confirmed, uncertain, compensated and abandoned reduce ambiguity. They also make accurate metrics possible when the article later calculates results across many requests.
Design for access and expiry from the beginning. Store a pseudonymous learner reference rather than a full name whenever the task allows; keep contact details in a separately governed system; restrict who can follow evidence pointers; and declare which portions of the record are necessary for audit, incident response or a lawful retention obligation. A ledger is a second dataset with its own security risks. Copying every conversation, source PDF, access token and personal identifier into it makes later deletion and breach response harder.
4. Time, identity and authority
A timestamp is a statement by a clock, not a universal guarantee of order. Distributed services may have clock skew. A callback may arrive after the original request was cancelled. Keep both the source event time and the receipt or ingestion time, plus ordering identifiers where available. Do not infer that event A caused event B merely because its displayed time is earlier. For a reliable causal story, join events by stable identifiers and explicit dependencies, and record the time semantics the system actually provides.
Authority has a similar subtlety. “The user asked” is not proof that the authenticated account had the right to change the specified record. A guardian may approve one rescheduling action but not a billing change. An approval may expire, a role may be revoked, or a policy version may prohibit a previously acceptable operation. Store the type and validity window of the authorisation, record the policy evaluated at the time, and recheck permission at the irreversible action boundary. This is different from simply saving an image of a yes-button.
Keep signing and verification identities separate from the identity that generated prose. A service may sign an event envelope, but the signature only establishes possession of a signing capability under the relevant trust assumptions; it does not certify the truth of every sentence inside. Likewise, a cryptographic digest is useful only if a trusted verifier possesses the expected digest and checks it. A self-produced hash displayed inside the same untrusted response does not create independent verification.
The NIST SP 800-92 publication describes log-management processes and infrastructure, not an AI-specific product. Treat it as background for generation, storage, analysis and disposal. Operationally, designate a record owner, classify event sensitivity, define retention rules, test recovery, and confirm the ledger survives a model or application restart. The next section turns these design choices into numbers so readers can catch the difference between a convincing story and a completed action.
5. Worked laboratory: sixty decisions
Consider an invented service called Harbour Learning Desk. It can answer general study questions, request a guardian-approved booking change, or route a billing adjustment through a human finance reviewer. Its operators decide to audit one teaching-day sample of sixty distinct intentions. They create one intent ID per user request and store separate attempt IDs for any repeated command. The exercise uses deliberately small counts so a reader can check each total by hand. The fictional outcome distribution is a design experiment, not a report about a live provider or a forecast of what AI will achieve.
First group: twenty-four information requests. A separate reviewer compared the answer against the source version identified in the ledger. Twenty answers were supported by the cited material; four contained unsupported assertions or lacked enough source evidence. A model’s reassuring tone did not rescue those four. Each was marked “needs correction,” the reviewer identified the missing premise, and the outward-facing answer could be repaired only after the source was reread. The ledger stored source revision, verification criteria and reviewer outcome, not merely “the chatbot said it looked correct.”
Second group: twenty-two booking-change intentions. Four were denied or expired before any authorised write; eighteen received a valid action grant. Of those eighteen write attempts, sixteen produced a booking receipt followed by a matching readback, one was rejected because the slot had been taken, and one timed out without a usable receipt. For the timeout, the operator searched by the original idempotency key and booking revision. No matching change was found, so the event was finally classified “reconciled: not performed,” not “unknown forever” and not “successful because the system sent a request.”
Third group: fourteen billing-adjustment intentions. Three were refused under policy, three lacked required documents and eight passed human approval. Of eight authorised tool attempts, six returned an accepted adjustment reference and were verified against the billing record, one was rejected by the ledger of accounts, and one timed out. The team checked the authoritative adjustment register by request reference, found no recorded change, and closed that attempt as “not performed.” Importantly, the distinction between a denial, an incomplete request and a failed operation remains visible.
- Information: 24 requests = 20 source-supported answers + 4 needing correction.
- Booking: 22 requests = 4 denied or expired + 16 confirmed changes + 1 conflict rejection + 1 reconciled non-change.
- Billing: 14 requests = 3 denied + 3 missing-document cases + 6 confirmed adjustments + 1 rejection + 1 reconciled non-change.
- Total: 24 + 22 + 14 = 60 distinct intentions; no double counting of retry attempts.
A sample record for the sixteenth booking success should include original request EDU-016, relevant calendar snapshot, policy gate, guardian approval, the tool operation reference, the result returned by the booking system, and the booking’s final revision as read by a verification service. A sample record for the time-out case must instead contain a timed-out attempted operation, the exact reconciliation query made, the negative result and the responsible person’s closure. Recording the negative evidence prevents a later observer from interpreting silence as proof of an invisible success.
6. Check the numerical ledger
Now compute success with the right denominator. Confirmed, independently checked useful outcomes were twenty informational answers plus sixteen booking changes plus six billing adjustments: 20 + 16 + 6 = 42. The denominator for the day’s user intentions is 60, so the verified-intention fraction is 42 ÷ 60 = 0.70, or 70%. This fraction describes the fictional teaching packet. It is not model accuracy, not a field performance benchmark, and not evidence that the other eighteen cases should have executed. Correct refusals may protect users even though the request was not fulfilled.
For a different operational question, examine authorised write attempts only. There were 18 booking attempts and 8 billing attempts, making 26. Confirmed effects were 16 + 6 = 22. The confirmed-write proportion is 22 ÷ 26 = 0.846153…, approximately 84.6%. Two writes were known rejections; two were initially uncertain but later reconciled as non-effects. Thus 22 + 2 + 2 = 26, and the 15.4 percentage points outside confirmed writes are not all the same failure mode. A manager who states “the agent failed on 30% of authorised actions” has mixed populations and ignored why actions stopped.
For an evidence-completeness measure, imagine the team requires exactly eight essential events for each of sixty intentions: intake, policy context, source read or declared absence, proposal, review gate, tool outcome or “not applicable,” independent verification, and closure. The expectation is 60 × 8 = 480 event slots. If 466 complete, correctly linked records are present and fourteen are absent, completeness is 466 ÷ 480 = 97.0833%, approximately 97.1%. That impressive-looking number still says nothing about whether the missing fourteen are concentrated in the most dangerous actions. Auditors should inspect their distribution, not only an average.
Storage calculations can also be checked. If a conceptual record averages 750 bytes before indexing, 480 records occupy 480 × 750 = 360,000 bytes, approximately 351.6 KiB when one KiB is 1,024 bytes. If three retained copies are required, raw replicated bytes would be 1,080,000 before indexes and protection overhead. This small packet scales poorly if a production design stores full attachments, model outputs and personal information in every record; the real data budget must measure bytes in actual systems, encryption overhead, access patterns and retention. Use references and purpose-bound storage rather than indiscriminate duplication.
A final quality comparison illustrates why denominators matter. Suppose all fourteen missing event slots concerned four billing attempts and ten unrelated informational closures. Reporting 97.1% evidence completeness could conceal that half the authorised billing writes in this tiny sample have an incomplete chain. Inspect completeness by action class and consequence. The denominator for billing evidence would be eight authorised attempts multiplied by their required fields, with “not applicable” explicitly distinguished from “missing.” This disaggregation is not decorative; it determines which controls must be repaired first.
7. Independently verify actions
For each consequential operation, define verification before execution. A booking verification could compare student reference, class ID, start time, owner and record revision. A billing verification could compare adjustment reference, currency, amount, ledger entry and approval scope. Query the system of record through a separately authorised pathway. A screen message saying “success” is evidence of interface behaviour, not necessarily evidence of state. When there are replicas, cached search indexes or asynchronous processes, document whether the readback is strongly consistent, eventual or otherwise limited.
Consider an apparently successful confirmation: the booking tool returned HTTP success and an operation token, yet the follow-up query shows the previous appointment. Possible explanations include a queued write, a stale reader, a rejected asynchronous transaction, or a response that was mistaken for a final receipt. The investigator needs a bounded waiting and reconciliation policy: look up authoritative state by stable identifier, consider known propagation windows, and stop with “unconfirmed” if evidence does not arrive. A retry must be idempotent or manually controlled so that “trying to help” does not make two reservations.
Verification must also cover negative actions. If the system denied a request correctly, the ledger should show which active policy and authority boundary produced the denial, without disclosing secret rules to an unauthorised user. If the user withdrew consent during review, the ledger should show that the approval expired and the pending tool command was cancelled or never issued. Auditing includes documenting restraint: the absence of a dangerous action can be a successful control outcome, but it needs appropriate evidence rather than a model-authored assurance.
8. Reproduce a historical decision
There are three different meanings of replay. A document replay reconstructs the evidence and checks the decision against the versioned policy; it does not call a tool. A simulation replay feeds preserved inputs to a controlled test environment to see whether a procedure would select the same branch. A live reenactment repeats real operations and can change money, appointments, files or people’s access. These should never be conflated. A safe educational exercise replays a read-only decision or a sandboxed side effect, with production write permissions disabled.
To reconstruct EDU-016, freeze the relevant input record and source calendar snapshot, identify the model or deterministic policy configuration, recover the review decision and trace the authoritative receipt. Then re-evaluate the original acceptance rules. The assistant might generate different words today even with the same visible prompt, because stochastic sampling, hidden service versions or changing dependencies can differ. A successful reconstruction can establish that the recorded decision was supported by available evidence and authorised at the time without asserting byte-for-byte reproducibility of the model response.
When a source snapshot is unavailable, say so. For example, if “calendar-v17” was merely a mutable URL and the server now returns v21, the reconstructed story cannot prove which slots appeared at the earlier moment. A present-day test may explain what the service does now, but it cannot substitute for missing historical evidence. The corrective action is to version or securely snapshot future critical reads; retroactively inventing a “likely previous state” would corrupt the ledger.
9. Detect gaps and tampering
A record can be missing because a producer never emitted it, a queue dropped it, an administrator erased it, a collector failed or a reviewer used the wrong identifier. Those possibilities demand different repairs. First compare the expected sequence of event kinds against what is present for each intent. Then reconcile with source-system receipts, approval service records and message delivery acknowledgements. Missing data should produce a visible gap marker and an investigation state; it should never be filled with plausible prose invented by the same model under review.
Cryptographic integrity adds another layer. A record may carry a content digest and be linked to a preceding digest, while batches may be signed or anchored in a separately protected store. That can make later byte changes detectable under the chosen trust model. It cannot stop a fully compromised producer from submitting a false event in the first place, and it cannot protect a sequence if the verifier trusts an attacker-controlled starting point. Specify the verification key, expected root, storage separation and audit responsibilities. Test what happens when a timestamp is changed, an event is removed or the signing key is rotated.
Selective omission is harder than altered bytes. Suppose an assistant omits the “approval denied” event and records only a successful booking readback. A perfect signature on the surviving records does not reveal the omission unless the system also enforces sequence requirements, independent approval-service reporting and a reconciliation against each authorised action. That is why integrity, completeness and truthfulness are three different properties. Integrity asks whether recorded bytes changed. Completeness asks whether mandatory records exist. Truthfulness asks whether the records accurately describe reality.
Treat the ledger as evidence to be challenged, not an oracle. An auditor should be able to isolate an intent, reproduce the calculation, inspect the original source when permitted, review a counterexample and ask which observations would disprove the story. This habit is useful beyond AI engineering: it is the difference between reading a confident financial summary and reconciling it against the books. For practice, remove the verification event from one of the sixteen confirmed bookings and observe that its outcome must be downgraded until external evidence is restored.
10. Protect people in the ledger
Decision histories may contain student identities, employment details, complaints, financial information or health context. More logging is not automatically safer. Begin with a purpose map: which questions must the record answer, who may answer them, how long does evidence remain needed, and what identifiers are strictly necessary? Separate operational status from sensitive content. A booking audit may need a pseudonymous learner ID, authorised operation type and record revision; it usually does not need a transcript of a family conversation or a full payment instrument.
Use access control on both the ledger and the source repositories to which it points. A digest of a private document may reveal less than the document itself but can still be linkable, sensitive or useful for inference. Protect lookup indexes, encryption keys and audit exports. Provide a practical process for correction, lawful access and deletion requests, and distinguish immutable audit intent from the false promise of indefinite retention. Legal duties vary by setting and jurisdiction; engineering examples in this chapter do not replace legal assessment.
A retention schedule should distinguish a short-lived debug trace, a consent record, an operational receipt and evidence required for an ongoing dispute. When a record can legitimately be deleted or de-identified, coordinate the deletion across search indexes, caches and backups, and record a minimised completion attestation rather than retaining the original personal data for the sake of proving it was removed. A ledger that claims append-only permanence and ignores privacy will eventually defeat its own accountability objective.
If you operate in Singapore, read the PDPC advisory guidelines on key concepts, especially the retention limitation obligation, instead of assuming every audit record may be kept forever. The engineering lesson is broader: retain evidence for justified purposes, document the reason, and ensure security and governance teams can demonstrate that old information is not casually available long after its use has ended.
11. Failure diagnosis and repair
Failure A: the dashboard displays “100% audited” because every user request has one conversation transcript. Diagnosis: the metric counted presence of a chat record, not the required decision chain. Repair: define event completeness against the named mandatory states, verify action receipts independently and report by risk category. Retest on a case with a missing approval event; the dashboard should now show a genuine gap, not a green label.
Failure B: a post-hoc model summary says a booking succeeded after the tool timed out. Diagnosis: the model promoted a proposed operation into an observed outcome. Repair: make uncertain an explicit state, preserve attempt identifiers, reconcile against the authoritative booking service and forbid final success language until readback. Retest with a deliberately delayed receipt and confirm the system can tell “still pending” from “already finished.”
Failure C: an analyst replays an old task and gets a different answer, then declares the original decision fraudulent. Diagnosis: the analyst used live sources, a changed model setting or a new policy version. Repair: preserve versioned evidence and define what kind of replay is being attempted. An evidence replay may validate historical compliance without reproducing identical model words. If critical source material is missing, the honest result is “not reproducible from retained evidence,” followed by a design correction.
Failure D: the evidence repository grows so large that administrators shorten retention by deleting entire incident periods. Diagnosis: indiscriminate capture, missing cost forecasts and no ownership of record classification. Repair: split data by purpose and sensitivity, aggregate nonessential performance signals, preserve narrowly required incident evidence under clear authority and use retention controls that are tested before rollout. Do not change historical records silently; document any material correction or legally required deletion.
Failure E: one engineer can alter both the action database and the purported independent ledger. Diagnosis: the verification path is not meaningfully independent. Repair: separate credentials, writing privileges and approval ownership, and have controlled reviewers test whether a forged receipt or deleted event can pass. No single separation measure proves the system safe, but an explicit adversarial test turns a vague promise into a checkable control.
12. Transfer challenge and solution
Transfer the idea from a tutoring scheduler to a community-library book-loan assistant. It handles forty requests in a day: twenty-five catalogue questions, ten renewals and five cancellation attempts. Twenty-three catalogue answers are validated against the current catalogue. Of ten renewals, eight are authorised, six are confirmed by a fresh loan-record read, one is rejected because a reservation exists, one times out and is later confirmed absent; the other two are denied before execution. Of five cancellations, three are authorised and confirmed, and two require a human because another account is involved. Calculate the proportion of all intentions with verified fulfilled outcomes, and distinguish that from the proportion of authorised changes confirmed.
Solution: fulfilled, independently confirmed intentions are 23 catalogue answers + 6 renewals + 3 cancellations = 32. Since there were 40 intentions, the fulfilled-and-verified fraction is 32 ÷ 40 = 80%. Authorised change attempts are 8 renewals + 3 cancellations = 11; confirmed effects are 6 + 3 = 9, so the confirmed-change proportion is 9 ÷ 11 ≈ 81.8%. The one rejected renewal and one reconciled non-effect account for the remaining two authorised attempts. The original two denied renewals and two human-held cancellations are not silently counted as attempted changes. The difference in denominators is the centre of the exercise.
Now change one fact: the library has switched to an externally hosted catalogue that supplies only an eventually consistent index. The earlier method of immediately querying that search index might falsely classify a successful renewal as absent. A correct design adds a trusted loan-system read endpoint or a stated reconciliation window, keeps the request pending until that evidence is available, and never repeats the renewal merely to make the dashboard look finished. The evidence ledger transfers because it records what needs proof rather than prescribing that every service must use the same technical API.
13. Limits and organisational responsibility
An evidence ledger cannot read a model’s hidden reasoning, guarantee causal truth or restore a source that was never captured. It cannot make an unjust policy just, repair weak data collection, grant legal consent, or prove that no unauthorised copy of information exists. A robust ledger may even reveal uncomfortable uncertainty. That is its value: it makes unsupported claims more difficult to disguise, exposes repairable gaps and helps reviewers ask narrower, better questions.
Costs and risks rise with detail. Cross-system joins can fail, identifiers can leak, source versions can become unavailable, signatures can be mismanaged, logs can be tampered with before collection, and human reviewers can make correlated errors. An organisation needs tested procedures, retention governance, a clear owner for disputed outcomes and a way for affected people to seek correction. Without those social arrangements, cryptographic mechanisms remain sophisticated pieces of software without accountable decisions behind them.
The engineering target is not a system that produces a beautiful explanation every time. It is a system that makes bounded claims, knows when evidence is incomplete, obtains valid authority, checks the real outcome, and can tell a user what it did and did not do. That principle applies to current assistants and autonomous workflows. Claims about hypothetical future artificial superintelligence remain conjectural and should not be written as if such a system has already been demonstrated.
Frequently asked questions
Is an evidence ledger the same as an audit log?
No. A conventional audit log can be one input. The ledger adds decision-specific links among evidence versions, rules, approvals, attempts and independently verified results. It should use underlying logs when they are trustworthy and available, while recording precisely what those logs do not establish.
Can a cryptographic hash prove an AI answer is correct?
No. A trusted hash comparison can show that recorded bytes match an expected digest. It does not evaluate whether a sentence was supported by a source, whether the source was accurate or whether a proposed action was authorised. Those are separate reviews with their own evidence.
Does replay mean pressing the same button again?
For consequential tools, it should not. Historical evidence reconstruction is normally read-only. Test reruns belong in isolated environments. Repeating an external side effect in production is a new action requiring authorisation and idempotency safeguards.
What if the tool returned success but no source-system readback is possible?
Label the result as unverified at the level the service permits. Keep the receipt, record the limitation, seek a safer independent channel and avoid saying “completed” merely because the model believes it. A strong system should improve its verification integration before expanding the consequences of automatic actions.
Do we need to store every conversation forever?
No. Retain the minimum evidence required for legitimate purposes, apply security and access restrictions, and define expiry and deletion pathways. In some use cases a narrow event envelope and controlled reference can meet audit needs better than a full transcript copied into another database.
How can a student practice without production tools?
Use fabricated task IDs, a small spreadsheet of event types and simulated source receipts. Hide three events, compute the completeness by hand, reconstruct a decision and explain what cannot be proved. This builds the habits of independent checking without requiring private data or paid services.
Standards and source reading
- W3C PROV-O: a standard vocabulary for entities, activities, agents and derivations.
- NIST SP 800-92: published guidance for security log-management practice; its 2023 revision 1 remains listed as an initial public draft on NIST’s project pages as checked in October 2026.
- NIST AI RMF 1.0: governance, measurement and responsible use of AI systems.
- NIST SP 800-53 Rev. 5: audit-and-accountability and privacy control families, subject to each organisation’s scope.
- Singapore PDPC key-concepts guidance: purpose and retention limitation in the applicable Singapore context.
Reader pathways and next lessons
For system builders, continue with safe retries and reconciliation and agent change control. For reviewers, compare human approvals and expiry with the permissions recorded here. For students, the How X Works library offers neighbouring mechanisms, while the Gold Standard of Education makes the wider learning goal explicit: transfer a method, check the outcome and recognise what you still do not know.