Quick answer: An AI-assisted and automated civic civilisation uses computation to support work, learning, public services and collective decisions while retaining human responsibility for safety, rights, maintenance and correction. Automation, machine learning, generative AI, autonomous agents and legitimate public authority are different concepts. An advanced system is not automatically fair or reliable: citizens need to know what is automated, who is accountable, how evidence is checked and how a harmful decision can be challenged.
Did you know? A model can make 90 correct predictions out of 100 and still behave poorly for a vulnerable subgroup, produce convincing false explanations or hide the absence of an appeal route. The test of an AI-assisted civic system is not the number of screens with an AI logo. It is whether information, human responsibility, service outcomes and correction procedures can be checked.
CivitasLab is a fictional learning community. Wintour examines the human consequences of decisions; Rainbolt modifies a hidden assumption and prompts the class to revise its answer. Neither is an actual regulatory authority, test programme or product. The tasks below are paper simulations that make governance understandable to parents, students and tutors.
This chapter extends the Types of a Civilisation series. The earlier Digital and Information Networks guide discusses communication and digital institutions. This article asks the narrower question of how automated and AI-assisted actions can remain dependable, answerable and fair.
Five ways to use this article
- Busy parents: begin with Missions 01, 05, 08, 09 and the final test.
- Primary learners: learn what a decision is, what evidence supports it and who can correct an error.
- Secondary students: work with accuracy, percentages, confusion matrices, permission diagrams and limitations.
- Small-group tutors: teach two missions weekly and rotate three responsible learning roles.
- Research readers: examine NIST, UNESCO, OECD and Singapore IMDA sources and distinguish voluntary guidance from applicable law.
Six foundations of responsible automated civilisation
- Purpose: automate a clearly defined task that serves legitimate human needs.
- Authority: human accountability and bounded permissions for consequential actions.
- Evidence: data provenance, evaluation, relevant measurements and uncertainty.
- Rights: privacy, fair access, explanation and meaningful routes to contest decisions.
- Maintenance: monitor changes, test failures and preserve service continuity.
- Inheritance: retain versioned records, skills and authority for future corrections.
This article is educational. It does not establish that any specific AI system is safe, compliant or approved for use in public administration. Children should not enter private information into demonstration tools, authorise real transactions, access restricted systems or perform live security testing. The scenarios use invented data, paper workflows and institutional reading only.
Six original institutional reference files
Reference 1 — NIST Artificial Intelligence Risk Management Framework
NIST’s AI Risk Management Framework addresses trustworthy AI and risk across the system lifecycle; the 1.0 framework was under revision in 2026.
Read the originating source. Its source type matters: a principles document, a voluntary risk-management framework and a binding statute are not interchangeable. Consult current laws and qualified authorities for actual compliance questions; classroom examples are not assessments of real products.
Model reading task: extract the exact purpose of this document, identify the audience and date, and explain one conclusion it cannot establish. If a tool claims compliance based only on citing a framework, ask what evidence of testing, governance, operation and legal review would still be required. Do not confuse a checklist heading with measured performance.
Reference 2 — NIST AI RMF Core: Govern, Map, Measure, Manage
The framework’s four functions organise governance, context identification, measurement and risk response; they are not a guarantee of any particular model’s safety.
Read the originating source. Its source type matters: a principles document, a voluntary risk-management framework and a binding statute are not interchangeable. Consult current laws and qualified authorities for actual compliance questions; classroom examples are not assessments of real products.
Model reading task: extract the exact purpose of this document, identify the audience and date, and explain one conclusion it cannot establish. If a tool claims compliance based only on citing a framework, ask what evidence of testing, governance, operation and legal review would still be required. Do not confuse a checklist heading with measured performance.
Reference 3 — UNESCO Recommendation on Ethics of Artificial Intelligence
The UNESCO Recommendation emphasises human rights, dignity, transparency, accountability and meaningful human oversight; legal obligations depend on jurisdiction.
Read the originating source. Its source type matters: a principles document, a voluntary risk-management framework and a binding statute are not interchangeable. Consult current laws and qualified authorities for actual compliance questions; classroom examples are not assessments of real products.
Model reading task: extract the exact purpose of this document, identify the audience and date, and explain one conclusion it cannot establish. If a tool claims compliance based only on citing a framework, ask what evidence of testing, governance, operation and legal review would still be required. Do not confuse a checklist heading with measured performance.
Reference 4 — OECD AI Principles
Initially adopted in 2019 and updated in 2024, the OECD principles concern trustworthy AI that respects human rights and democratic values.
Read the originating source. Its source type matters: a principles document, a voluntary risk-management framework and a binding statute are not interchangeable. Consult current laws and qualified authorities for actual compliance questions; classroom examples are not assessments of real products.
Model reading task: extract the exact purpose of this document, identify the audience and date, and explain one conclusion it cannot establish. If a tool claims compliance based only on citing a framework, ask what evidence of testing, governance, operation and legal review would still be required. Do not confuse a checklist heading with measured performance.
Reference 5 — Singapore IMDA: Artificial Intelligence and AI Verify
Singapore’s IMDA describes AI Verify testing and an agentic-AI governance framework, including a May 2026 update addressing accountability and limits on autonomous action.
Read the originating source. Its source type matters: a principles document, a voluntary risk-management framework and a binding statute are not interchangeable. Consult current laws and qualified authorities for actual compliance questions; classroom examples are not assessments of real products.
Model reading task: extract the exact purpose of this document, identify the audience and date, and explain one conclusion it cannot establish. If a tool claims compliance based only on citing a framework, ask what evidence of testing, governance, operation and legal review would still be required. Do not confuse a checklist heading with measured performance.
Reference 6 — NIST AI RMF Playbook: Manage
The manage function highlights decisions about whether, when and how an AI system should proceed, with risk response and ongoing monitoring.
Read the originating source. Its source type matters: a principles document, a voluntary risk-management framework and a binding statute are not interchangeable. Consult current laws and qualified authorities for actual compliance questions; classroom examples are not assessments of real products.
Model reading task: extract the exact purpose of this document, identify the audience and date, and explain one conclusion it cannot establish. If a tool claims compliance based only on citing a framework, ask what evidence of testing, governance, operation and legal review would still be required. Do not confuse a checklist heading with measured performance.
Sixteen civic systems missions
- 01. Distinguish deterministic automation, machine learning and agents
- 02. Use human authority and meaningful oversight
- 03. Establish purpose, scope and a no-go boundary
- 04. Map data provenance and consent
- 05. Measure validity, accuracy and error distribution
- 06. Understand uncertainty and calibration
- 07. Explain automation bias and over-reliance
- 08. Protect public information from fabricated content
- 09. Provide meaningful explanation and contestability
- 10. Manage privacy, security and boundaries of access
- 11. Set independent tests before deployment
- 12. Understand agentic AI and bounded action
- 13. Recognise environmental and infrastructure costs
- 14. Protect workers, learning and professional judgment
- 15. Govern vendors, procurement and long-term maintenance
- 16. Leave successor-ready AI governance and correction logs
Mission 01 — Distinguish deterministic automation, machine learning and agents
Opening case: CivitasLab’s fictional town hall compares an arithmetic rule, a text classifier, a writing assistant and a service agent.
How the automated system works
A simple rule-based system follows defined instructions; machine-learning models infer patterns; generative models produce content; agentic systems may coordinate sequences of actions under constraints. Each requires different boundaries and checks.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, distinguish deterministic automation, machine learning and agents is studied using civitaslab’s fictional town hall compares an arithmetic rule, a text classifier, a writing assistant and a service agent. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: A simple rule-based system follows defined instructions; machine-learning models infer patterns; generative models produce content; agentic systems may coordinate sequences of actions under constraints. Each requires different boundaries and checks. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Four labels classify four paper systems, but the count does not establish which is safer or more capable.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt reveals the writing assistant was mistakenly given permission to approve requests rather than draft replies.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour asks who authorised the tool and how residents can challenge its output.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour asks who authorised the tool and how residents can challenge its output. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Sort paper examples by input, output, authorised action and possible error.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: CivitasLab’s fictional town hall compares an arithmetic rule, a text classifier, a writing assistant and a service agent. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of distinguish deterministic automation, machine learning and agents is under test. The underlying mechanism is A simple rule-based system follows defined instructions; machine-learning models infer patterns; generative models produce content; agentic systems may coordinate sequences of actions under constraints. Each requires different boundaries and checks. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Four labels classify four paper systems, but the count does not establish which is safer or more capable. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of distinguish deterministic automation, machine learning and agents is under test. The underlying mechanism is A simple rule-based system follows defined instructions; machine-learning models infer patterns; generative models produce content; agentic systems may coordinate sequences of actions under constraints. Each requires different boundaries and checks. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt reveals the writing assistant was mistakenly given permission to approve requests rather than draft replies. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of distinguish deterministic automation, machine learning and agents is under test. The underlying mechanism is A simple rule-based system follows defined instructions; machine-learning models infer patterns; generative models produce content; agentic systems may coordinate sequences of actions under constraints. Each requires different boundaries and checks. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour asks who authorised the tool and how residents can challenge its output. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of distinguish deterministic automation, machine learning and agents is under test. The underlying mechanism is A simple rule-based system follows defined instructions; machine-learning models infer patterns; generative models produce content; agentic systems may coordinate sequences of actions under constraints. Each requires different boundaries and checks. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Distinguish deterministic automation, machine learning and agents becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 02 — Use human authority and meaningful oversight
Opening case: The class considers a hypothetical application-review tool where an officer must read a reason before deciding.
How the automated system works
A human-in-the-loop label is insufficient if the person lacks time, information, authority or a practical way to override an automated action.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, use human authority and meaningful oversight is studied using the class considers a hypothetical application-review tool where an officer must read a reason before deciding. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: A human-in-the-loop label is insufficient if the person lacks time, information, authority or a practical way to override an automated action. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Twelve of fifteen sample decisions receive substantive review: 80% of the toy cases, not proof that review was effective.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt shortens the officer’s review time so a nominal checkpoint becomes automatic approval.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour insists that legal authority, dignity and access to review remain with accountable people and institutions.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour insists that legal authority, dignity and access to review remain with accountable people and institutions. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Design a paper sign-off record, not a live decision service.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: The class considers a hypothetical application-review tool where an officer must read a reason before deciding. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of use human authority and meaningful oversight is under test. The underlying mechanism is A human-in-the-loop label is insufficient if the person lacks time, information, authority or a practical way to override an automated action. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Twelve of fifteen sample decisions receive substantive review: 80% of the toy cases, not proof that review was effective. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of use human authority and meaningful oversight is under test. The underlying mechanism is A human-in-the-loop label is insufficient if the person lacks time, information, authority or a practical way to override an automated action. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt shortens the officer’s review time so a nominal checkpoint becomes automatic approval. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of use human authority and meaningful oversight is under test. The underlying mechanism is A human-in-the-loop label is insufficient if the person lacks time, information, authority or a practical way to override an automated action. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour insists that legal authority, dignity and access to review remain with accountable people and institutions. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of use human authority and meaningful oversight is under test. The underlying mechanism is A human-in-the-loop label is insufficient if the person lacks time, information, authority or a practical way to override an automated action. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Use human authority and meaningful oversight becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 03 — Establish purpose, scope and a no-go boundary
Opening case: A fictional school wants an AI service for timetables and proposes extending it to make disciplinary decisions automatically.
How the automated system works
A service needs a clear purpose and an explicit account of tasks it cannot safely or lawfully perform. A capable model need not be an appropriate system for every social problem.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, establish purpose, scope and a no-go boundary is studied using a fictional school wants an ai service for timetables and proposes extending it to make disciplinary decisions automatically. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: A service needs a clear purpose and an explicit account of tasks it cannot safely or lawfully perform. A capable model need not be an appropriate system for every social problem. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Three of ten proposed tasks require qualified judgement beyond the initial scope: 30% in the exercise, not an acceptable risk threshold.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt adds a safety-critical use case that was never evaluated.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour asks whose rights would be affected by expanding the tool without public scrutiny.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour asks whose rights would be affected by expanding the tool without public scrutiny. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Make allowed, prohibited and needs-review paper columns.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: A fictional school wants an AI service for timetables and proposes extending it to make disciplinary decisions automatically. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of establish purpose, scope and a no-go boundary is under test. The underlying mechanism is A service needs a clear purpose and an explicit account of tasks it cannot safely or lawfully perform. A capable model need not be an appropriate system for every social problem. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Three of ten proposed tasks require qualified judgement beyond the initial scope: 30% in the exercise, not an acceptable risk threshold. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of establish purpose, scope and a no-go boundary is under test. The underlying mechanism is A service needs a clear purpose and an explicit account of tasks it cannot safely or lawfully perform. A capable model need not be an appropriate system for every social problem. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt adds a safety-critical use case that was never evaluated. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of establish purpose, scope and a no-go boundary is under test. The underlying mechanism is A service needs a clear purpose and an explicit account of tasks it cannot safely or lawfully perform. A capable model need not be an appropriate system for every social problem. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour asks whose rights would be affected by expanding the tool without public scrutiny. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of establish purpose, scope and a no-go boundary is under test. The underlying mechanism is A service needs a clear purpose and an explicit account of tasks it cannot safely or lawfully perform. A capable model need not be an appropriate system for every social problem. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Establish purpose, scope and a no-go boundary becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 04 — Map data provenance and consent
Opening case: CivitasLab’s catalogue mixes public documents, fictional profiles and a resident’s private letter.
How the automated system works
AI systems depend on data whose origin, quality, permissions, time and representativeness influence the result. Training and deployment data raise different privacy and governance questions.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, map data provenance and consent is studied using civitaslab’s catalogue mixes public documents, fictional profiles and a resident’s private letter. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: AI systems depend on data whose origin, quality, permissions, time and representativeness influence the result. Training and deployment data raise different privacy and governance questions. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Five of twenty model records lack clear provenance: 25% undocumented in the lesson, not a real compliance score.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt reveals that an internal document was treated as a public reference.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour protects personal data and the rights of people not present when a system was built.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour protects personal data and the rights of people not present when a system was built. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Create a dataset card describing source, purpose, lawful basis questions, limits and retention.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: CivitasLab’s catalogue mixes public documents, fictional profiles and a resident’s private letter. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of map data provenance and consent is under test. The underlying mechanism is AI systems depend on data whose origin, quality, permissions, time and representativeness influence the result. Training and deployment data raise different privacy and governance questions. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Five of twenty model records lack clear provenance: 25% undocumented in the lesson, not a real compliance score. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of map data provenance and consent is under test. The underlying mechanism is AI systems depend on data whose origin, quality, permissions, time and representativeness influence the result. Training and deployment data raise different privacy and governance questions. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt reveals that an internal document was treated as a public reference. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of map data provenance and consent is under test. The underlying mechanism is AI systems depend on data whose origin, quality, permissions, time and representativeness influence the result. Training and deployment data raise different privacy and governance questions. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour protects personal data and the rights of people not present when a system was built. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of map data provenance and consent is under test. The underlying mechanism is AI systems depend on data whose origin, quality, permissions, time and representativeness influence the result. Training and deployment data raise different privacy and governance questions. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Map data provenance and consent becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 05 — Measure validity, accuracy and error distribution
Opening case: A fictional model labels 90 of 100 papers correctly but fails disproportionately on one category.
How the automated system works
A high headline accuracy can conceal a poor result for a smaller subgroup or a particularly important category. Relevant performance measures depend on real costs of mistakes.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, measure validity, accuracy and error distribution is studied using a fictional model labels 90 of 100 papers correctly but fails disproportionately on one category. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: A high headline accuracy can conceal a poor result for a smaller subgroup or a particularly important category. Relevant performance measures depend on real costs of mistakes. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Ninety correct out of 100 means 90% overall accuracy, not proof of fairness or adequate safety.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt moves ten difficult examples into a previously underrepresented group.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour asks which people face the harm of false acceptance and false rejection.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour asks which people face the harm of false acceptance and false rejection. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Build a small confusion matrix with paper counters and explain the rates.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: A fictional model labels 90 of 100 papers correctly but fails disproportionately on one category. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of measure validity, accuracy and error distribution is under test. The underlying mechanism is A high headline accuracy can conceal a poor result for a smaller subgroup or a particularly important category. Relevant performance measures depend on real costs of mistakes. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Ninety correct out of 100 means 90% overall accuracy, not proof of fairness or adequate safety. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of measure validity, accuracy and error distribution is under test. The underlying mechanism is A high headline accuracy can conceal a poor result for a smaller subgroup or a particularly important category. Relevant performance measures depend on real costs of mistakes. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt moves ten difficult examples into a previously underrepresented group. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of measure validity, accuracy and error distribution is under test. The underlying mechanism is A high headline accuracy can conceal a poor result for a smaller subgroup or a particularly important category. Relevant performance measures depend on real costs of mistakes. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour asks which people face the harm of false acceptance and false rejection. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of measure validity, accuracy and error distribution is under test. The underlying mechanism is A high headline accuracy can conceal a poor result for a smaller subgroup or a particularly important category. Relevant performance measures depend on real costs of mistakes. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Measure validity, accuracy and error distribution becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 06 — Understand uncertainty and calibration
Opening case: An automated guide displays ’92’ on a screen with no explanation of whether it means confidence, score or priority.
How the automated system works
A model score may be uncalibrated and can be mistaken for a probability. Effective uncertainty communication also depends on the person using the result.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, understand uncertainty and calibration is studied using an automated guide displays ’92’ on a screen with no explanation of whether it means confidence, score or priority. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: A model score may be uncalibrated and can be mistaken for a probability. Effective uncertainty communication also depends on the person using the result. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
A group records 18 correct out of 20 predictions marked ‘high confidence’, an observed 90% on the toy set, not general calibration evidence.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt changes the case mix and the old percentage ceases to be representative.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour asks whether a user can seek qualified help instead of being overruled by a score.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour asks whether a user can seek qualified help instead of being overruled by a score. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Compare clearly labelled predictions with invented outcomes; avoid live risk classification.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: An automated guide displays ’92’ on a screen with no explanation of whether it means confidence, score or priority. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of understand uncertainty and calibration is under test. The underlying mechanism is A model score may be uncalibrated and can be mistaken for a probability. Effective uncertainty communication also depends on the person using the result. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: A group records 18 correct out of 20 predictions marked ‘high confidence’, an observed 90% on the toy set, not general calibration evidence. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of understand uncertainty and calibration is under test. The underlying mechanism is A model score may be uncalibrated and can be mistaken for a probability. Effective uncertainty communication also depends on the person using the result. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt changes the case mix and the old percentage ceases to be representative. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of understand uncertainty and calibration is under test. The underlying mechanism is A model score may be uncalibrated and can be mistaken for a probability. Effective uncertainty communication also depends on the person using the result. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour asks whether a user can seek qualified help instead of being overruled by a score. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of understand uncertainty and calibration is under test. The underlying mechanism is A model score may be uncalibrated and can be mistaken for a probability. Effective uncertainty communication also depends on the person using the result. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Understand uncertainty and calibration becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 07 — Explain automation bias and over-reliance
Opening case: A fictional clerk ignores a correct paper record because the automated summary looks polished.
How the automated system works
People may place too much weight on machine output, especially when it appears fast or authoritative. Meaningful oversight requires practice noticing disagreement.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, explain automation bias and over-reliance is studied using a fictional clerk ignores a correct paper record because the automated summary looks polished. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: People may place too much weight on machine output, especially when it appears fast or authoritative. Meaningful oversight requires practice noticing disagreement. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Of ten training cases, four contain deliberate errors; a reviewer spots two, giving 50% recall of planted errors in the lesson.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt changes the model’s persuasive tone while preserving the same error.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour values independent checking and protects those affected by careless reliance.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour values independent checking and protects those affected by careless reliance. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Use a paper answer key and compare evidence-first versus model-first decisions.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: A fictional clerk ignores a correct paper record because the automated summary looks polished. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of explain automation bias and over-reliance is under test. The underlying mechanism is People may place too much weight on machine output, especially when it appears fast or authoritative. Meaningful oversight requires practice noticing disagreement. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Of ten training cases, four contain deliberate errors; a reviewer spots two, giving 50% recall of planted errors in the lesson. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of explain automation bias and over-reliance is under test. The underlying mechanism is People may place too much weight on machine output, especially when it appears fast or authoritative. Meaningful oversight requires practice noticing disagreement. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt changes the model’s persuasive tone while preserving the same error. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of explain automation bias and over-reliance is under test. The underlying mechanism is People may place too much weight on machine output, especially when it appears fast or authoritative. Meaningful oversight requires practice noticing disagreement. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour values independent checking and protects those affected by careless reliance. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of explain automation bias and over-reliance is under test. The underlying mechanism is People may place too much weight on machine output, especially when it appears fast or authoritative. Meaningful oversight requires practice noticing disagreement. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Explain automation bias and over-reliance becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 08 — Protect public information from fabricated content
Opening case: The town website displays a fabricated opening time generated from a plausible pattern rather than a service record.
How the automated system works
Generative AI can produce fluent but incorrect information. Public explanations require grounded sources, dates, appropriate approvals and accessible corrections.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, protect public information from fabricated content is studied using the town website displays a fabricated opening time generated from a plausible pattern rather than a service record. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: Generative AI can produce fluent but incorrect information. Public explanations require grounded sources, dates, appropriate approvals and accessible corrections. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Eight of ten public statements are sourced, 80% documentation in the scenario; the two unsourced claims may still be most consequential.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt inserts a non-existent legal rule into an AI summary.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour asks who would miss a service or lose trust because of the claim.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour asks who would miss a service or lose trust because of the claim. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Check five fictional notices against a dated source packet, not public systems.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: The town website displays a fabricated opening time generated from a plausible pattern rather than a service record. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of protect public information from fabricated content is under test. The underlying mechanism is Generative AI can produce fluent but incorrect information. Public explanations require grounded sources, dates, appropriate approvals and accessible corrections. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Eight of ten public statements are sourced, 80% documentation in the scenario; the two unsourced claims may still be most consequential. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of protect public information from fabricated content is under test. The underlying mechanism is Generative AI can produce fluent but incorrect information. Public explanations require grounded sources, dates, appropriate approvals and accessible corrections. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt inserts a non-existent legal rule into an AI summary. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of protect public information from fabricated content is under test. The underlying mechanism is Generative AI can produce fluent but incorrect information. Public explanations require grounded sources, dates, appropriate approvals and accessible corrections. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour asks who would miss a service or lose trust because of the claim. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of protect public information from fabricated content is under test. The underlying mechanism is Generative AI can produce fluent but incorrect information. Public explanations require grounded sources, dates, appropriate approvals and accessible corrections. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Protect public information from fabricated content becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 09 — Provide meaningful explanation and contestability
Opening case: A fictional benefits applicant receives only ‘algorithm rejected’ with no responsible officer or appeal route.
How the automated system works
A system may be hard to interpret internally, yet affected people still need intelligible reasons, accessible communication and a way to contest consequential outcomes.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, provide meaningful explanation and contestability is studied using a fictional benefits applicant receives only ‘algorithm rejected’ with no responsible officer or appeal route. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: A system may be hard to interpret internally, yet affected people still need intelligible reasons, accessible communication and a way to contest consequential outcomes. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Only six of ten sample decisions include an accessible explanation: 60% in the worksheet, not procedural fairness.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt changes the reason code to an unexplained label.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour asks who can correct records and whether appeal is practical for people with disabilities.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour asks who can correct records and whether appeal is practical for people with disabilities. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Write a paper decision notice naming human contact, evidence and review path.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: A fictional benefits applicant receives only ‘algorithm rejected’ with no responsible officer or appeal route. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of provide meaningful explanation and contestability is under test. The underlying mechanism is A system may be hard to interpret internally, yet affected people still need intelligible reasons, accessible communication and a way to contest consequential outcomes. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Only six of ten sample decisions include an accessible explanation: 60% in the worksheet, not procedural fairness. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of provide meaningful explanation and contestability is under test. The underlying mechanism is A system may be hard to interpret internally, yet affected people still need intelligible reasons, accessible communication and a way to contest consequential outcomes. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt changes the reason code to an unexplained label. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of provide meaningful explanation and contestability is under test. The underlying mechanism is A system may be hard to interpret internally, yet affected people still need intelligible reasons, accessible communication and a way to contest consequential outcomes. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour asks who can correct records and whether appeal is practical for people with disabilities. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of provide meaningful explanation and contestability is under test. The underlying mechanism is A system may be hard to interpret internally, yet affected people still need intelligible reasons, accessible communication and a way to contest consequential outcomes. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Provide meaningful explanation and contestability becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 10 — Manage privacy, security and boundaries of access
Opening case: A student assistant has been offered access to a fictional private health file when it only needs a public timetable.
How the automated system works
Automation can increase the speed of accidental disclosure. Safe public systems need roles, permissions, data minimisation and audit records under legitimate oversight.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, manage privacy, security and boundaries of access is studied using a student assistant has been offered access to a fictional private health file when it only needs a public timetable. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: Automation can increase the speed of accidental disclosure. Safe public systems need roles, permissions, data minimisation and audit records under legitimate oversight. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
One of four demonstration permissions is excessive; a simple count cannot quantify security risk.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt causes a public-summary tool to reveal a confidential record.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour prioritises privacy, redress and responsible public communication.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour prioritises privacy, redress and responsible public communication. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Use coloured paper for public, internal and protected files; no actual private data.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: A student assistant has been offered access to a fictional private health file when it only needs a public timetable. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of manage privacy, security and boundaries of access is under test. The underlying mechanism is Automation can increase the speed of accidental disclosure. Safe public systems need roles, permissions, data minimisation and audit records under legitimate oversight. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: One of four demonstration permissions is excessive; a simple count cannot quantify security risk. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of manage privacy, security and boundaries of access is under test. The underlying mechanism is Automation can increase the speed of accidental disclosure. Safe public systems need roles, permissions, data minimisation and audit records under legitimate oversight. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt causes a public-summary tool to reveal a confidential record. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of manage privacy, security and boundaries of access is under test. The underlying mechanism is Automation can increase the speed of accidental disclosure. Safe public systems need roles, permissions, data minimisation and audit records under legitimate oversight. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour prioritises privacy, redress and responsible public communication. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of manage privacy, security and boundaries of access is under test. The underlying mechanism is Automation can increase the speed of accidental disclosure. Safe public systems need roles, permissions, data minimisation and audit records under legitimate oversight. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Manage privacy, security and boundaries of access becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 11 — Set independent tests before deployment
Opening case: CivitasLab’s tool works on five polished examples, and promoters declare it ready for every resident.
How the automated system works
Demonstrations on a favourite example do not prove reliability across populations, dates or operating conditions. Testing should include plausible failure modes and a clear decision to halt.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, set independent tests before deployment is studied using civitaslab’s tool works on five polished examples, and promoters declare it ready for every resident. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: Demonstrations on a favourite example do not prove reliability across populations, dates or operating conditions. Testing should include plausible failure modes and a clear decision to halt. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Five of five correct examples give 100% on the tiny selected sample; this is not a credible general test.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt adds cases from an unseen language variety and performance changes.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour checks fairness, accessibility and public accountability.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour checks fairness, accessibility and public accountability. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Build separate paper test sets for ordinary, edge and out-of-scope cases.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: CivitasLab’s tool works on five polished examples, and promoters declare it ready for every resident. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of set independent tests before deployment is under test. The underlying mechanism is Demonstrations on a favourite example do not prove reliability across populations, dates or operating conditions. Testing should include plausible failure modes and a clear decision to halt. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Five of five correct examples give 100% on the tiny selected sample; this is not a credible general test. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of set independent tests before deployment is under test. The underlying mechanism is Demonstrations on a favourite example do not prove reliability across populations, dates or operating conditions. Testing should include plausible failure modes and a clear decision to halt. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt adds cases from an unseen language variety and performance changes. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of set independent tests before deployment is under test. The underlying mechanism is Demonstrations on a favourite example do not prove reliability across populations, dates or operating conditions. Testing should include plausible failure modes and a clear decision to halt. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour checks fairness, accessibility and public accountability. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of set independent tests before deployment is under test. The underlying mechanism is Demonstrations on a favourite example do not prove reliability across populations, dates or operating conditions. Testing should include plausible failure modes and a clear decision to halt. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Set independent tests before deployment becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 12 — Understand agentic AI and bounded action
Opening case: A fictional municipal assistant may draft a booking but must not confirm spending or change a resident’s records.
How the automated system works
An agent may coordinate multi-step actions, but its tools, permissions, checkpoints, logging and human escalation must be deliberately limited.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, understand agentic ai and bounded action is studied using a fictional municipal assistant may draft a booking but must not confirm spending or change a resident’s records. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: An agent may coordinate multi-step actions, but its tools, permissions, checkpoints, logging and human escalation must be deliberately limited. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Two approved actions out of five requested actions are 40% in the lesson; this is not an ‘autonomy score’.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt creates a chain where an innocuous read step attempts a high-impact write.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour demands accountable human approval before consequential changes.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour demands accountable human approval before consequential changes. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Draw permission and approval cards; no live systems or unauthorised transactions.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: A fictional municipal assistant may draft a booking but must not confirm spending or change a resident’s records. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of understand agentic ai and bounded action is under test. The underlying mechanism is An agent may coordinate multi-step actions, but its tools, permissions, checkpoints, logging and human escalation must be deliberately limited. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Two approved actions out of five requested actions are 40% in the lesson; this is not an ‘autonomy score’. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of understand agentic ai and bounded action is under test. The underlying mechanism is An agent may coordinate multi-step actions, but its tools, permissions, checkpoints, logging and human escalation must be deliberately limited. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt creates a chain where an innocuous read step attempts a high-impact write. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of understand agentic ai and bounded action is under test. The underlying mechanism is An agent may coordinate multi-step actions, but its tools, permissions, checkpoints, logging and human escalation must be deliberately limited. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour demands accountable human approval before consequential changes. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of understand agentic ai and bounded action is under test. The underlying mechanism is An agent may coordinate multi-step actions, but its tools, permissions, checkpoints, logging and human escalation must be deliberately limited. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Understand agentic AI and bounded action becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 13 — Recognise environmental and infrastructure costs
Opening case: A classroom imagines computing resources consumed by a public helpdesk and compares an automated process with other service options.
How the automated system works
AI depends on electricity, cooling, networks, hardware, maintenance and supply chains. Claims that automation is resource-free or automatically sustainable are unfounded.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, recognise environmental and infrastructure costs is studied using a classroom imagines computing resources consumed by a public helpdesk and compares an automated process with other service options. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: AI depends on electricity, cooling, networks, hardware, maintenance and supply chains. Claims that automation is resource-free or automatically sustainable are unfounded. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
At an invented constant 0.5 kW for four hours, energy equals 2 kWh. It does not represent a real inference workload or emissions.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt reveals shared infrastructure with another critical service.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour asks about worker dignity, energy choices, purchasing and the lives affected by environmental costs.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour asks about worker dignity, energy choices, purchasing and the lives affected by environmental costs. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Create a service dependency diagram and avoid invented industry-wide energy statistics.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: A classroom imagines computing resources consumed by a public helpdesk and compares an automated process with other service options. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of recognise environmental and infrastructure costs is under test. The underlying mechanism is AI depends on electricity, cooling, networks, hardware, maintenance and supply chains. Claims that automation is resource-free or automatically sustainable are unfounded. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: At an invented constant 0.5 kW for four hours, energy equals 2 kWh. It does not represent a real inference workload or emissions. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of recognise environmental and infrastructure costs is under test. The underlying mechanism is AI depends on electricity, cooling, networks, hardware, maintenance and supply chains. Claims that automation is resource-free or automatically sustainable are unfounded. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt reveals shared infrastructure with another critical service. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of recognise environmental and infrastructure costs is under test. The underlying mechanism is AI depends on electricity, cooling, networks, hardware, maintenance and supply chains. Claims that automation is resource-free or automatically sustainable are unfounded. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour asks about worker dignity, energy choices, purchasing and the lives affected by environmental costs. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of recognise environmental and infrastructure costs is under test. The underlying mechanism is AI depends on electricity, cooling, networks, hardware, maintenance and supply chains. Claims that automation is resource-free or automatically sustainable are unfounded. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Recognise environmental and infrastructure costs becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 14 — Protect workers, learning and professional judgment
Opening case: CivitasLab’s librarians use software to draft summaries but must retain professional source checking and access support.
How the automated system works
Automation changes tasks, skills, oversight duties and possible workload. The social outcome cannot be measured solely by time saved.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, protect workers, learning and professional judgment is studied using civitaslab’s librarians use software to draft summaries but must retain professional source checking and access support. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: Automation changes tasks, skills, oversight duties and possible workload. The social outcome cannot be measured solely by time saved. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
A fictional task falls from 40 to 25 minutes but adds 10 minutes for verification: the net change is five minutes, not 15.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt introduces an error that requires a complex correction and new training.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour checks staff participation, retraining and effects on people who need human assistance.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour checks staff participation, retraining and effects on people who need human assistance. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Interview invented stakeholder cards rather than collecting private worker records.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: CivitasLab’s librarians use software to draft summaries but must retain professional source checking and access support. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of protect workers, learning and professional judgment is under test. The underlying mechanism is Automation changes tasks, skills, oversight duties and possible workload. The social outcome cannot be measured solely by time saved. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: A fictional task falls from 40 to 25 minutes but adds 10 minutes for verification: the net change is five minutes, not 15. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of protect workers, learning and professional judgment is under test. The underlying mechanism is Automation changes tasks, skills, oversight duties and possible workload. The social outcome cannot be measured solely by time saved. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt introduces an error that requires a complex correction and new training. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of protect workers, learning and professional judgment is under test. The underlying mechanism is Automation changes tasks, skills, oversight duties and possible workload. The social outcome cannot be measured solely by time saved. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour checks staff participation, retraining and effects on people who need human assistance. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of protect workers, learning and professional judgment is under test. The underlying mechanism is Automation changes tasks, skills, oversight duties and possible workload. The social outcome cannot be measured solely by time saved. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Protect workers, learning and professional judgment becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 15 — Govern vendors, procurement and long-term maintenance
Opening case: The town’s procurement team compares a documented service with a cheaper one lacking an exit plan.
How the automated system works
Purchasing an AI service brings dependence on providers, updates, data arrangements, contracts and migration plans. Newer technology is not automatically better public value.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, govern vendors, procurement and long-term maintenance is studied using the town’s procurement team compares a documented service with a cheaper one lacking an exit plan. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: Purchasing an AI service brings dependence on providers, updates, data arrangements, contracts and migration plans. Newer technology is not automatically better public value. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
A fictional annual licence is 60 units and oversight adds 40: a total of 100, before hidden maintenance and exit costs.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt removes access to the vendor and asks how essential records remain available.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour reviews public interest, accessibility, competition and service continuity.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour reviews public interest, accessibility, competition and service continuity. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Make a paper procurement matrix with lawful authority and evidence categories.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: The town’s procurement team compares a documented service with a cheaper one lacking an exit plan. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of govern vendors, procurement and long-term maintenance is under test. The underlying mechanism is Purchasing an AI service brings dependence on providers, updates, data arrangements, contracts and migration plans. Newer technology is not automatically better public value. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: A fictional annual licence is 60 units and oversight adds 40: a total of 100, before hidden maintenance and exit costs. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of govern vendors, procurement and long-term maintenance is under test. The underlying mechanism is Purchasing an AI service brings dependence on providers, updates, data arrangements, contracts and migration plans. Newer technology is not automatically better public value. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt removes access to the vendor and asks how essential records remain available. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of govern vendors, procurement and long-term maintenance is under test. The underlying mechanism is Purchasing an AI service brings dependence on providers, updates, data arrangements, contracts and migration plans. Newer technology is not automatically better public value. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour reviews public interest, accessibility, competition and service continuity. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of govern vendors, procurement and long-term maintenance is under test. The underlying mechanism is Purchasing an AI service brings dependence on providers, updates, data arrangements, contracts and migration plans. Newer technology is not automatically better public value. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Govern vendors, procurement and long-term maintenance becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Mission 16 — Leave successor-ready AI governance and correction logs
Opening case: CivitasLab passes its projects to new learners without the original team or vendors.
How the automated system works
An automated society remains accountable only when its successors can find purposes, sources, versions, test results, human decision owners and records of failures.
Start with the actual human problem. Is the service meant to help a person understand information, distribute work, make an appointment, obtain a benefit or study an evidence base? Those purposes are not equivalent. An attractive algorithmic architecture does not answer whether the service is needed or who bears responsibility for its consequences.
In this particular mission, leave successor-ready ai governance and correction logs is studied using civitaslab passes its projects to new learners without the original team or vendors. The learner identifies the legitimate purpose, what the automation is actually permitted to do, and what remains a human decision. The point is not to admire a model’s sophistication but to check whether its role is intelligible.
Map authority, information and hidden dependencies
Map the workflow before the model. Draw data entering, processing, people interpreting outputs, authorising actions, storing records and handling corrections. Each arrow should identify an actor or a system boundary. An AI output that is never used may raise different risks from the same output automatically changing a record.
Classify evidence by source and context. An external policy framework can describe responsible practices; a benchmark may show performance on a particular dataset; a fictional case can teach the arithmetic; and an internal operational audit can reveal actual failures. Do not promote one category into another without supporting evidence.
The central mechanism is this: An automated society remains accountable only when its successors can find purposes, sources, versions, test results, human decision owners and records of failures. Ask which part requires a measured output and which requires a responsible person, institution or legal process. A model should be evaluated in the context in which people will use it, not merely on an isolated demonstration screen.
The mathematics behind a headline
Twelve of sixteen folders include source, owner and revision date: 75% documented, not a trustworthiness score.
Always name the numerator, denominator and situation. Overall correctness may conceal rare but serious errors. A decision count says nothing about fairness without understanding who was included, the types of mistakes and the consequences for those wrongly classified.
Change one assumption while retaining clearly defined units and case labels. Calculate again, then ask whether the resulting number proves safety, fairness, compliance or public value. Often it cannot: an invented sample is not an evaluation of an actual model, and average performance does not reveal the importance of individual mistakes.
A challenge, an incident and a visible repair
Rainbolt changes a model version and an earlier claim becomes unsupported.
Rainbolt changes a key assumption or inserts an error. The learners should not merely replace one neat conclusion with another. They mark the changed data, explain why the old claim is no longer justified, and decide whether the proper response is a narrower statement, a human escalation, additional testing or no deployment.
The class draws a boundary around what the original claim supported. If an untested decision is proposed, a legitimate response is to refuse automation or escalate to a qualified human. If a private record is involved, the learning activity stops at the paper model; no real data is accessed.
Human rights, worker dignity and review
Wintour asks whether future residents can obtain explanations and challenge decisions.
Wintour asks whose experience was excluded, how a person would learn that automation was involved, and how they could obtain a real review. An appeal link that nobody can access or a nominal human checkpoint without authority may look accountable while failing the substantive need.
A meaningful audit asks about both measurable outcomes and failures that metrics can hide. Model accuracy, response time and cost do not by themselves establish whether people understand a decision, receive fair treatment or can contest a mistake. Documentation should connect system numbers to actual human purposes.
The ethical issue is not a decorative note. Here it concerns wintour asks whether future residents can obtain explanations and challenge decisions. State who would be affected, what information they deserve, and whether they have a meaningful channel to correct or contest a decision. Keep clear that actual rights and procedures depend on the law and institution.
Parent task and tutor extension
Have an unfamiliar reader audit the record and correct the handover instructions.
The tutor assigns three children distinct jobs: explain the mechanism, check the quantity and protect the affected person’s perspective. They should rotate roles after each challenge. The most important teaching result is an answer that remains accurate when someone asks a difficult but legitimate question.
These are literacy exercises, not operational software instructions. Pupils can examine imaginary workflows, dataset cards and printed notices. They should not enter identifiable data, deploy a live agent, probe cybersecurity weaknesses, change accounts or conduct unauthorised transactions. Real systems require specialised controls and legal authority.
Transfer the idea across sectors carefully. A school timetable, a hospital appointment system and a public-benefits decision may all involve automation, but the risks, safeguards, data and legal obligations differ. A method that is useful in one context should not be copied into another without re-evaluation.
Make room for a no-go decision. The responsible outcome of a design exercise may be to say that no automation should be deployed for this decision, or only a low-risk part should be assisted. Restraint demonstrates that the class understands the role of technology as a means rather than an automatic goal.
Four case files for serious thinking
What does the label really mean?
The chapter’s starting case is: CivitasLab passes its projects to new learners without the original team or vendors. Ask whether ‘AI’, ‘automated’, ‘accurate’ or ‘approved’ is being used beyond the evidence. Write a replacement headline that names the purpose and the limits.
Worked reasoning: first specify which aspect of leave successor-ready ai governance and correction logs is under test. The underlying mechanism is An automated society remains accountable only when its successors can find purposes, sources, versions, test results, human decision owners and records of failures. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Can we reconstruct the quantity?
Use this toy calculation: Twelve of sixteen folders include source, owner and revision date: 75% documented, not a trustworthiness score. Name the total count, what was classified, which cases may be absent and how a different sample could alter the conclusion.
Worked reasoning: first specify which aspect of leave successor-ready ai governance and correction logs is under test. The underlying mechanism is An automated society remains accountable only when its successors can find purposes, sources, versions, test results, human decision owners and records of failures. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
What requires immediate correction?
Rainbolt changes the scenario: Rainbolt changes a model version and an earlier claim becomes unsupported. The group must say whether to seek more testing, narrow the claim, involve a qualified person or halt an automated action.
Worked reasoning: first specify which aspect of leave successor-ready ai governance and correction logs is under test. The underlying mechanism is An automated society remains accountable only when its successors can find purposes, sources, versions, test results, human decision owners and records of failures. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Who has a right to be heard?
Wintour identifies this legitimate concern: Wintour asks whether future residents can obtain explanations and challenge decisions. Draft a paper review notice that gives clear reasons and does not promise an appeal mechanism that the fictional institution has not actually built.
Worked reasoning: first specify which aspect of leave successor-ready ai governance and correction logs is under test. The underlying mechanism is An automated society remains accountable only when its successors can find purposes, sources, versions, test results, human decision owners and records of failures. Keep the operational, statistical, ethical and legal claims distinct. A clear conclusion should state what the pupil has examined and what only qualified evidence, a real authority or a further test could establish.
In a group of three, assign one learner to argue for the intended benefit, one to identify the most important evidence gap and one to consider a person’s experience of a mistake. Swap roles and write a revised conclusion together. The exercise should produce a dated source or fictional assumption card, not a declaration that an actual civic service is ready.
Learning transfer: Leave successor-ready AI governance and correction logs becomes useful knowledge when a newcomer can identify who is authorised, which evidence is required, what error may occur and how people would be protected and heard.
Eight-week AI civic literacy course
Week 1 — Distinguish deterministic automation, machine learning and agents and Use human authority and meaningful oversight
The first lesson studies distinguish deterministic automation, machine learning and agents through its fictional case. The second introduces use human authority and meaningful oversight, allowing the students to challenge whether their original analysis identified the right human, data and institutional boundaries. The week is successful if the revised explanation is more accurate, not longer.
Begin with a plain-language purpose statement and a paper workflow. Next, calculate the invented number with labels and check what it cannot establish. Invite pupils to propose a more appropriate test, a human checkpoint or a no-go boundary. The teacher should ensure no live private records, accounts or public services are involved.
Three-person tutorial roles rotate among system explainer, mathematical challenger and citizen-rights reviewer. Each writes one sentence for the group’s record. A parent may ask how the student would know whether a chatbot answer or automated notice was correct, and who should be responsible if it were wrong.
For assessment, require an accessible explanation, evidence source, numeric limitation, human-impact concern and a visible correction. Do not reward invented regulatory approvals or absolute claims that a machine can never make a mistake. A prudent refusal to automate a high-impact task can be the strongest result.
Week 2 — Establish purpose, scope and a no-go boundary and Map data provenance and consent
The first lesson studies establish purpose, scope and a no-go boundary through its fictional case. The second introduces map data provenance and consent, allowing the students to challenge whether their original analysis identified the right human, data and institutional boundaries. The week is successful if the revised explanation is more accurate, not longer.
Begin with a plain-language purpose statement and a paper workflow. Next, calculate the invented number with labels and check what it cannot establish. Invite pupils to propose a more appropriate test, a human checkpoint or a no-go boundary. The teacher should ensure no live private records, accounts or public services are involved.
Three-person tutorial roles rotate among system explainer, mathematical challenger and citizen-rights reviewer. Each writes one sentence for the group’s record. A parent may ask how the student would know whether a chatbot answer or automated notice was correct, and who should be responsible if it were wrong.
For assessment, require an accessible explanation, evidence source, numeric limitation, human-impact concern and a visible correction. Do not reward invented regulatory approvals or absolute claims that a machine can never make a mistake. A prudent refusal to automate a high-impact task can be the strongest result.
Week 3 — Measure validity, accuracy and error distribution and Understand uncertainty and calibration
The first lesson studies measure validity, accuracy and error distribution through its fictional case. The second introduces understand uncertainty and calibration, allowing the students to challenge whether their original analysis identified the right human, data and institutional boundaries. The week is successful if the revised explanation is more accurate, not longer.
Begin with a plain-language purpose statement and a paper workflow. Next, calculate the invented number with labels and check what it cannot establish. Invite pupils to propose a more appropriate test, a human checkpoint or a no-go boundary. The teacher should ensure no live private records, accounts or public services are involved.
Three-person tutorial roles rotate among system explainer, mathematical challenger and citizen-rights reviewer. Each writes one sentence for the group’s record. A parent may ask how the student would know whether a chatbot answer or automated notice was correct, and who should be responsible if it were wrong.
For assessment, require an accessible explanation, evidence source, numeric limitation, human-impact concern and a visible correction. Do not reward invented regulatory approvals or absolute claims that a machine can never make a mistake. A prudent refusal to automate a high-impact task can be the strongest result.
Week 4 — Explain automation bias and over-reliance and Protect public information from fabricated content
The first lesson studies explain automation bias and over-reliance through its fictional case. The second introduces protect public information from fabricated content, allowing the students to challenge whether their original analysis identified the right human, data and institutional boundaries. The week is successful if the revised explanation is more accurate, not longer.
Begin with a plain-language purpose statement and a paper workflow. Next, calculate the invented number with labels and check what it cannot establish. Invite pupils to propose a more appropriate test, a human checkpoint or a no-go boundary. The teacher should ensure no live private records, accounts or public services are involved.
Three-person tutorial roles rotate among system explainer, mathematical challenger and citizen-rights reviewer. Each writes one sentence for the group’s record. A parent may ask how the student would know whether a chatbot answer or automated notice was correct, and who should be responsible if it were wrong.
For assessment, require an accessible explanation, evidence source, numeric limitation, human-impact concern and a visible correction. Do not reward invented regulatory approvals or absolute claims that a machine can never make a mistake. A prudent refusal to automate a high-impact task can be the strongest result.
Week 5 — Provide meaningful explanation and contestability and Manage privacy, security and boundaries of access
The first lesson studies provide meaningful explanation and contestability through its fictional case. The second introduces manage privacy, security and boundaries of access, allowing the students to challenge whether their original analysis identified the right human, data and institutional boundaries. The week is successful if the revised explanation is more accurate, not longer.
Begin with a plain-language purpose statement and a paper workflow. Next, calculate the invented number with labels and check what it cannot establish. Invite pupils to propose a more appropriate test, a human checkpoint or a no-go boundary. The teacher should ensure no live private records, accounts or public services are involved.
Three-person tutorial roles rotate among system explainer, mathematical challenger and citizen-rights reviewer. Each writes one sentence for the group’s record. A parent may ask how the student would know whether a chatbot answer or automated notice was correct, and who should be responsible if it were wrong.
For assessment, require an accessible explanation, evidence source, numeric limitation, human-impact concern and a visible correction. Do not reward invented regulatory approvals or absolute claims that a machine can never make a mistake. A prudent refusal to automate a high-impact task can be the strongest result.
Week 6 — Set independent tests before deployment and Understand agentic AI and bounded action
The first lesson studies set independent tests before deployment through its fictional case. The second introduces understand agentic ai and bounded action, allowing the students to challenge whether their original analysis identified the right human, data and institutional boundaries. The week is successful if the revised explanation is more accurate, not longer.
Begin with a plain-language purpose statement and a paper workflow. Next, calculate the invented number with labels and check what it cannot establish. Invite pupils to propose a more appropriate test, a human checkpoint or a no-go boundary. The teacher should ensure no live private records, accounts or public services are involved.
Three-person tutorial roles rotate among system explainer, mathematical challenger and citizen-rights reviewer. Each writes one sentence for the group’s record. A parent may ask how the student would know whether a chatbot answer or automated notice was correct, and who should be responsible if it were wrong.
For assessment, require an accessible explanation, evidence source, numeric limitation, human-impact concern and a visible correction. Do not reward invented regulatory approvals or absolute claims that a machine can never make a mistake. A prudent refusal to automate a high-impact task can be the strongest result.
Week 7 — Recognise environmental and infrastructure costs and Protect workers, learning and professional judgment
The first lesson studies recognise environmental and infrastructure costs through its fictional case. The second introduces protect workers, learning and professional judgment, allowing the students to challenge whether their original analysis identified the right human, data and institutional boundaries. The week is successful if the revised explanation is more accurate, not longer.
Begin with a plain-language purpose statement and a paper workflow. Next, calculate the invented number with labels and check what it cannot establish. Invite pupils to propose a more appropriate test, a human checkpoint or a no-go boundary. The teacher should ensure no live private records, accounts or public services are involved.
Three-person tutorial roles rotate among system explainer, mathematical challenger and citizen-rights reviewer. Each writes one sentence for the group’s record. A parent may ask how the student would know whether a chatbot answer or automated notice was correct, and who should be responsible if it were wrong.
For assessment, require an accessible explanation, evidence source, numeric limitation, human-impact concern and a visible correction. Do not reward invented regulatory approvals or absolute claims that a machine can never make a mistake. A prudent refusal to automate a high-impact task can be the strongest result.
Week 8 — Govern vendors, procurement and long-term maintenance and Leave successor-ready AI governance and correction logs
The first lesson studies govern vendors, procurement and long-term maintenance through its fictional case. The second introduces leave successor-ready ai governance and correction logs, allowing the students to challenge whether their original analysis identified the right human, data and institutional boundaries. The week is successful if the revised explanation is more accurate, not longer.
Begin with a plain-language purpose statement and a paper workflow. Next, calculate the invented number with labels and check what it cannot establish. Invite pupils to propose a more appropriate test, a human checkpoint or a no-go boundary. The teacher should ensure no live private records, accounts or public services are involved.
Three-person tutorial roles rotate among system explainer, mathematical challenger and citizen-rights reviewer. Each writes one sentence for the group’s record. A parent may ask how the student would know whether a chatbot answer or automated notice was correct, and who should be responsible if it were wrong.
For assessment, require an accessible explanation, evidence source, numeric limitation, human-impact concern and a visible correction. Do not reward invented regulatory approvals or absolute claims that a machine can never make a mistake. A prudent refusal to automate a high-impact task can be the strongest result.
Questions for parents, learners and public readers
Is automation always AI?
No. Many automated systems follow predefined rules. Machine learning, generative AI and agents have different properties and responsibilities.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Does high accuracy guarantee fairness?
No. Performance may differ across groups, tasks and the consequences of mistakes. A meaningful evaluation looks beyond the headline average.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Who is responsible when an AI system makes a public decision?
People and legally accountable institutions retain responsibilities. The precise obligations depend on context and applicable law; AI output is not a substitute for accountable authority.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
What does human oversight mean?
More than a rubber-stamp. The reviewer needs relevant information, time, authority and a practical way to challenge or stop an automated result.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Is an AI confidence score a calibrated probability?
Not necessarily. Its interpretation depends on the system and method. The score requires validation before users can interpret it as a meaningful probability.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Can AI invent official information?
Generative systems can produce fluent, unsupported statements. Public claims should be checked against current official sources and corrected visibly when wrong.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
What is automation bias?
The tendency to defer to machine output even when independent evidence suggests a mistake. Good review procedures make disagreement possible.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Is an appeal route always legally required?
Legal requirements vary. Consequential decisions should be evaluated with qualified legal and institutional guidance, not decided from a classroom guideline alone.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Why is data provenance important?
It helps determine what material was used, whether it may be used, its quality and whether the system’s conclusions can be evaluated responsibly.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
What is agentic AI?
Systems described as agentic may plan or carry out sequences of actions using tools under some degree of autonomy. Their permissions and human checkpoints are central governance questions.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Can children create a civic AI agent from this guide?
This is a paper-and-source programme only. Real deployment, data processing and public-service decisions require appropriate institutional approval and professional controls.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Do NIST principles constitute a legal certificate?
No. The AI RMF is a voluntary risk-management framework and should not be presented as a blanket legal certification of a specific product.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Does AI Verify approve every AI model?
No. IMDA describes testing frameworks and tools, but a reference to testing does not prove a particular system has passed a particular assessment.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Will AI always save labour?
Not necessarily. Verification, retraining, correcting errors and assisting users can consume time and resources. Compare complete service outcomes rather than one step.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Is more automation always more advanced civilisation?
No. Institutional capability includes safety, dignity, access, maintenance and the ability to decline an unsuitable technology.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
What can a child remember from this chapter?
Ask who authorised the machine’s role, what evidence supports its output, who may be harmed and how a mistake can be corrected.
Tutors can ask the learner for a small fictional counterexample and a revised answer that avoids universal certainty. For Secondary Mathematics, request a numerator and denominator or a labelled comparison where appropriate. For English, ask the child to rewrite a confident but misleading claim as a precise, accessible public sentence.
Vocabulary that improves public reasoning
Automation
Execution of predefined processes with limited or varying human intervention.
In a three-pupil tutorial, ask for a sentence using ‘Automation’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Machine learning
Methods that learn patterns from data for prediction or other tasks.
In a three-pupil tutorial, ask for a sentence using ‘Machine learning’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Generative AI
Models that can generate content such as text or images in response to inputs.
In a three-pupil tutorial, ask for a sentence using ‘Generative AI’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
AI agent
A system that may coordinate decisions and tool actions within defined boundaries.
In a three-pupil tutorial, ask for a sentence using ‘AI agent’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Human oversight
Meaningful responsibility and control by authorised people.
In a three-pupil tutorial, ask for a sentence using ‘Human oversight’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Provenance
Origin and history of data or evidence.
In a three-pupil tutorial, ask for a sentence using ‘Provenance’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Accuracy
Share of predictions correct under a specified evaluation; its usefulness depends on context.
In a three-pupil tutorial, ask for a sentence using ‘Accuracy’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
False positive
An incorrect positive classification under a defined decision threshold.
In a three-pupil tutorial, ask for a sentence using ‘False positive’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
False negative
An incorrect negative classification under a defined decision threshold.
In a three-pupil tutorial, ask for a sentence using ‘False negative’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Calibration
Relationship between predictions or scores and observed outcomes under specified conditions.
In a three-pupil tutorial, ask for a sentence using ‘Calibration’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Automation bias
Over-reliance on machine output in human judgement.
In a three-pupil tutorial, ask for a sentence using ‘Automation bias’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Contestability
Practical possibility of challenging a decision or explanation.
In a three-pupil tutorial, ask for a sentence using ‘Contestability’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Accountability
Identifiable responsibility and mechanisms for review and correction.
In a three-pupil tutorial, ask for a sentence using ‘Accountability’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Privacy
Appropriate protection of information about people.
In a three-pupil tutorial, ask for a sentence using ‘Privacy’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Safety case
Structured evidence and argument supporting a bounded safety claim in a particular context.
In a three-pupil tutorial, ask for a sentence using ‘Safety case’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Audit trail
Record of source, decision, test, change and authorised review.
In a three-pupil tutorial, ask for a sentence using ‘Audit trail’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
No-go boundary
Condition under which a proposed use should not proceed.
In a three-pupil tutorial, ask for a sentence using ‘No-go boundary’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Model drift
Change in the relationship between model operation and its relevant environment or data over time.
In a three-pupil tutorial, ask for a sentence using ‘Model drift’ accurately, an example that misuses it, and a correction. The child should link the word to a particular human or technical decision rather than memorise a definition in isolation. Rotate the role of checker so all three pupils practise precision and explanation.
Illustration, provenance and final test
The featured image is a pre-existing conceptual editorial illustration of a structured information-governance workspace. It illustrates how records move through controlled pathways but does not document a functioning or independently certified AI deployment. No invented AI vendor or public authority should be attributed to it. Truthful source information matters more than decorative keywords.
Every CivitasLab example, rate, cost and model result is fictional and designed solely to support educational reasoning. The official source links identify real institutional publications and should be checked in their current form. This material is not legal, security, procurement or public-administration advice.
Final CivitasLab question: If the original programme builders leave tomorrow, can citizens still find out what the automated system is allowed to do, challenge a harmful outcome, preserve private records and teach successors how to investigate an error? An AI-assisted civilisation becomes worthy of trust through that accountability, not through automation alone.
