← Research
Research

What board oversight of AI actually looks like

A governance framework designs the control. Oversight is whether the human part of it operates, and that question sits in none of the three lines of defence.

Last reviewed: 21 September 2026 · Next review due: 21 September 2027

Article 14 treats the capability to override as the content of oversight rather than the presence of a person. NIST expects reversal thresholds before they are needed. A 2025 judgment made the verification duty non-delegable and extended it to those supervising AI-assisted work. And one national framework has written the entry-level capability risk in.

Questions this page answersQuestions this page partly answersAll 1323 questions this research covers

Most boards now have an AI item. Fewer have a clear picture of what oversight of it actually consists of, beyond a quarterly paper and a risk register line. This page sets out what the frameworks require, what belongs on an agenda, and the one question none of the frameworks answers.

The answer, in one line

In practice, five things a board should be able to get a straight answer to, quarterly. The declared position on whether AI is being used to augment or replace, by domain and in writing, checked against what the business cases count as the benefit.

Share as a card

What the frameworks actually require#

Three documents do most of the work in board conversations, and they are worth knowing at the level of what they oblige rather than what they signal.

The vocabulary, and where it stops working#

Boards run oversight through structures that predate this technology and mostly transfer well. Three lines of defence puts operational management first, risk and compliance second, internal audit third. Assurance mapping asks who is testing what and where the duplication and the holes are. Risk appetite sets how much of a given exposure the board is willing to carry. Every one of those applies to AI, and a board that already runs them has most of the machinery.

The difficulty is specific rather than general. The capability question does not sit in any of the three lines. The first line runs the system. The second checks that policy was followed. The third audits whether the second did its job. None of them is asked whether the organisation’s people could still do the work if the system stopped, and none of them would be at fault for not asking. That is the gap this research exists to describe, and it sits in the assurance map rather than in anybody’s performance.

Share this line as a card

Why a human in the loop is not a control#

The most common answer to a board question about AI risk is that a person reviews the output. Vaccaro, Almaatouq and Malone’s preregistered meta-analysis of 106 experimental studies and 370 effect sizes found human and AI combinations performed significantly worse on average than the better of human or AI alone, at Hedges’ g of -0.23, with the losses concentrated in decision-making.

Their conclusion belongs in front of any board being offered a human reviewer as a mitigation: adding a human is not a control, and undesigned pairing can subtract. Article 14 arrives at the same place from the legal side by specifying competence, training and authority together rather than presence. A named reviewer without the standing to say no is a control on paper. See human in the loop is not a safeguard for the longer version.

Reversal has to exist before it is needed#

The NIST Playbook, at MANAGE 2.4, requires mechanisms and assigned responsibilities to supersede, disengage or deactivate systems performing inconsistently with intended use, and names five triggering conditions: end of system lifetime; risks exceeding tolerance thresholds; mitigation beyond the organisation’s capacity; feasible mitigations failing regulatory, legal or normative standards; and impending risk detected in monitoring.

An authoritative framework therefore treats deployment as reversible and expects the mechanism, its thresholds and its fallback to be in place beforehand. The board question follows directly: who holds the authority to stop this, what would trigger it, and what happens to the work in the meantime. Thresholds set while everyone is pleased with a system are the only ones worth having, because the people defending a decision cannot set them afterwards.

Accountability is arriving through the courts, and it runs upward#

Directors should know about Ayinde v London Borough of Haringey and Al-Haroun v Qatar National Bank, heard together in 2025 under the Hamid jurisdiction after fabricated citations were placed before the court. In Ayinde, five cited authorities did not exist.

The court held at [6] that freely available generative AI tools are not capable of conducting reliable legal research, and at [7] that those using them carry a professional duty to check accuracy against authoritative sources. Two further points matter more for governance than the headline. At [8] the duty extends to lawyers relying on other people’s AI-assisted work. At [81] a lawyer is not entitled to rely on their client for accuracy.

In England and Wales the verification duty is therefore settled, non-delegable, and travels upward to whoever supervises. This is a professional obligations case rather than a company law one, and no reported case yet covers somebody who checked competently and was misled anyway. The direction is clear enough for a board to act on: accountability for AI-assisted output does not stop at the person who produced it.

One national framework has already written in the capability risk#

Boards told that capability loss is a soft concern should see Singapore’s Model AI Governance Framework for Agentic AI, version 1.0, at section 2.4.3.

As agents take over entry level tasks, which typically serve as the training ground for new staff, this could lead to loss of basic operational knowledge for the users. Organisations should identify core capabilities of each job and provide sufficient training and work exposure so that users retain foundational skills.

IMDA, Model AI Governance Framework for Agentic AI, version 1.0, section 2.4.3

A national government has put the removal of entry-level work, and the loss of the training ground that goes with it, into an operative governance framework. It is guidance rather than law, it states a risk and a duty to train rather than evidence that deskilling has occurred, and it sets no measurement. What it establishes is that the missing rungs argument is now inside the governance literature rather than outside it, which changes what a director can reasonably say they had not considered.

What actually goes on the agenda#

The practical shape, for a board meeting quarterly. None of this requires technical depth, and all of it requires somebody to have prepared an answer.

On what a paper should contain, the test is simple. If the reporting is adoption rates, licences issued or hours saved, the board is being shown procurement. The question a paper should answer is whether anybody got better at anything, and whether anybody could still do the work without the system. For the full set of questions, see what a board should ask about AI.

Where this sits in my own argument#

My position throughout this research is that a governance framework designs the control, and the work I do tests whether the human part of it operates. The frameworks above are good. Read them closely and you find that each one specifies what should exist rather than whether it functions, which is reasonable, since that is what frameworks are for.

The oversight failure I keep meeting involves no absent control at all. Something exists, is documented, has a named owner, and would not catch anything. That is drift in its governance form: nobody decided the oversight would be decorative, and nobody has checked.

What I have observed in organisations#

The clearest thing I have seen about board-level oversight is how much of it depends on whether the senior team uses the tools at all. In one accounting firm, several partners were slow to use ChatGPT or Copilot for anything, including email. The question of what AI meant for the firm was pushed down the agenda and treated as a process matter, because the people at the top had no working feel for what they were governing.

It changed when the chair of the board changed the ethos around AI. Not a new policy, and not a framework. A different expectation from the top about whether this was something the board engaged with personally.

Which answers a question people ask me often. Should leaders use these tools themselves? Yes, and not for productivity. A director who has never watched a model produce a confident, wrong answer in their own domain has no calibration for the risk they are being asked to oversee, and no way to tell a real control from a described one.

20 September 2026: what companies disclose about who is in charge, and what managers already run#

Two measurements surfaced together in CNBC’s report of 20 September on whether organisations will need a “robot relations” function, and both belong on this page’s agenda. The first is Just Capital’s analysis of 1 April 2026. Its survey of 2,012 US adults ranked the public’s priorities for corporate AI: preventing harm, deception and manipulation first, keeping humans in charge second, protecting personal data third. It then read the disclosures of 110 companies, six hyperscalers and 104 others chosen for strong reporting, and found that 50 per cent disclose board-level oversight of AI risk, 37 per cent disclose responsible AI principles, and 27 of the 110 say anything about human oversight. Across 933 companies, reported AI training fell from 24.34 to 21.96 hours per employee between 2024 and 2025. So the thing the public ranks second is the thing a quarter of the best-disclosing companies mention, and half of them do not say who on the board is watching.

The second is the OECD’s survey of algorithmic management, 6,047 firms in six countries, fielded by Ipsos between June and August 2024 and published in December 2025, which The Next Web reported on 20 September. By that report, 90 per cent of US managers said their workplace used at least one software tool to instruct, monitor or evaluate workers, against 81 per cent in France, 78 in Germany and Spain, 76 in Italy and 40 in Japan; 67 per cent of US firms used such a tool to sanction poor performance, against 4 per cent across the four European countries. The OECD’s own summary records that managers reported “unclear accountability when it comes to algorithmic decisions” and an “inability to easily follow the tools’ logic”. Darrell West of Brookings proposed on 30 July that firms “supplement HR with robot relations” to handle complaints that “algorithms are unfair or biased”; CNBC’s report is what carried the phrase into the business press.

Put the two together and the fourth Rules Before Tools question fails on both sides of the annual report at once. Outside, the company does not say who is in charge of its AI. Inside, nine in ten US firms already run software that instructs, monitors or evaluates people, two thirds use it to discipline them, and the managers operating it say they cannot follow its logic or name who is accountable for its decisions. That is a machine judging people with the override authority undefined, at scale, before any agent has been deployed. The agenda item this adds is a plain one: does our own disclosure say which decisions software makes about our people, who can stop each one, and how a worker gets a human to look again? If management cannot answer it for the board, it cannot answer it for a tribunal.

The frameworks are sound; whether anyone follows them is unmeasured#

It does not claim the frameworks are inadequate. NIST gives a board vocabulary it can use, Article 14 is the most serious text written on human oversight, and Article 12 makes reconstruction a legal requirement. Each is doing its job.

It does not claim any of this is happening. The Article 14 oversight provisions carry 2 December 2027 as a longstop rather than a start, NIST is voluntary, the Singapore framework is guidance, and nothing in Article 12 requires anybody to read a log. What exists is an obligation to be able to; whether organisations do is unmeasured.

And it offers no legal advice. Ayinde is a professional obligations case in England and Wales, and how the duty to verify translates into directors’ duties in a given jurisdiction is a question for counsel rather than for this page.

Evidence review · SS-2026-157 · Graded against the published rubric · 2 institutional surveys, 1 compiled review, 1 modelling study and 1 of other kinds

Cite this page

Hirji, R. (2026). What board oversight of AI actually looks like. The SuperSkills evidence base, SS-2026-157. https://thesuperskills.com/research/what-board-oversight-of-ai-looks-like. Last reviewed 21 September 2026.

An evidence review by Rahim Hirji, not peer-reviewed research. For a material claim, cite the underlying study as well; every study here carries its own permanent link.

How citations and IDs work
Questions answered on this page

What does board oversight of AI actually look like?

In practice, five things a board should be able to get a straight answer to, quarterly. The declared position on whether AI is being used to augment or replace, by domain and in writing, checked against what the business cases count as the benefit. The capability floor: what the organisation must still be able to do unaided in three years, with a named owner and a date when it was last checked. Decision rights in writing before an incident, including who can override a system and whether anybody recently has. Reversal thresholds that have been tested rather than rewritten. And one reconstructed AI-assisted decision per quarter, showing how it was actually reached. If the reporting is adoption rates, licences issued or hours saved, the board is being shown procurement rather than oversight.

What do the AI governance frameworks actually require of a board?

Three documents carry most board conversations. The NIST AI Risk Management Framework 1.0 organises around Govern, Map, Measure and Manage and gives a board a shared vocabulary, but it is voluntary and confers no legal status. Article 14 of the EU AI Act requires high-risk systems to be designed so natural persons can effectively oversee them, and requires those persons to understand the system's capacities and limits, to remain aware of automation bias which the legislation names directly, and to be able to disregard, override, reverse or stop the system: the content of oversight is the capability to override rather than the presence of a person. Those provisions carry a longstop rather than a start date: under the Digital Omnibus the high-risk rules follow the availability of standards, with Annex III obligations applying no more than sixteen months later than first envisaged, reported as 2 December 2027. Article 12, with Article 19, requires automatic recording of events across the system lifetime and retention of logs for at least six months, though nothing requires anybody to read them.

Where does AI oversight sit in the three lines of defence?

Most of it transfers cleanly. The first line runs the system, the second checks that policy was followed, the third audits whether the second did its job, and assurance mapping and risk appetite both apply to AI as they do to anything else. The specific difficulty is that the capability question sits in none of the three. Nobody is asked whether the organisation's people could still do the work if the system stopped, and no line would be at fault for not asking. That is a gap in the assurance map rather than a failure by any function.

Is a human in the loop an adequate control?

No, and the evidence is direct. Vaccaro, Almaatouq and Malone's preregistered meta-analysis of 106 experimental studies and 370 effect sizes found human and AI combinations performed significantly worse on average than the better of human or AI alone, at Hedges' g of minus 0.23, with losses concentrated in decision-making. Their conclusion is that adding a human is not a control and undesigned pairing can subtract. Article 14 of the EU AI Act arrives at the same place from the legal side by specifying competence, training and authority together rather than mere presence. A named reviewer without the standing to say no is a control on paper.

Who is accountable when AI-assisted work goes wrong?

In England and Wales the position on professional verification is settled and travels upward. In Ayinde v London Borough of Haringey and Al-Haroun v Qatar National Bank, heard together in 2025 under the Hamid jurisdiction after fabricated citations reached the court, the court held at paragraph 6 that freely available generative AI tools are not capable of conducting reliable legal research, and at paragraph 7 that those using them carry a professional duty to check accuracy against authoritative sources. Two points matter more for governance: at paragraph 8 the duty extends to lawyers relying on other people's AI-assisted work, and at paragraph 81 a lawyer is not entitled to rely on their client for accuracy. The duty is therefore non-delegable and reaches whoever supervises. This is a professional obligations case rather than company law, and how it translates into directors' duties in a given jurisdiction is a question for counsel.

Should leaders and directors use AI themselves?

Yes, and not for productivity. A director who has never watched a model produce a confident, wrong answer in their own domain has no calibration for the risk they are being asked to oversee, and no way to distinguish a real control from a described one. In one accounting firm I worked with, several partners were slow to use ChatGPT or Copilot for anything including email, and the question of what AI meant for the firm was pushed down the agenda and treated as a process matter because nobody senior had a working feel for it. What changed it was not a policy or a framework. It was the chair of the board changing the expectation about whether this was something the board engaged with personally.

Do any AI governance frameworks address capability loss?

One does, explicitly. Singapore's Model AI Governance Framework for Agentic AI, version 1.0, states at section 2.4.3: as agents take over entry level tasks, which typically serve as the training ground for new staff, this could lead to loss of basic operational knowledge for the users, and organisations should identify core capabilities of each job and provide sufficient training and work exposure so that users retain foundational skills. It is guidance rather than law, states a risk and a duty to train rather than evidence that deskilling has occurred, and sets no measurement. What it establishes is that the removal of entry-level work, and the loss of the training ground with it, now sits inside the governance literature rather than outside it.

When should a board stop or reverse an AI deployment?

The NIST AI RMF Playbook, at MANAGE 2.4, requires mechanisms and assigned responsibilities to supersede, disengage or deactivate systems performing inconsistently with intended use, and names five triggering conditions: end of system lifetime; risks exceeding tolerance thresholds; mitigation beyond the organisation's capacity; feasible mitigations failing regulatory, legal or normative standards; and impending risk detected in monitoring. An authoritative framework therefore treats deployment as reversible and expects the mechanism, its thresholds and its fallback to exist beforehand. Thresholds set while everyone is still pleased with a system are the only ones worth having, because the people defending a decision cannot set them afterwards.

In this hub

Judgement, oversight and accountability

Who decides, who checks, and who is answerable when the machine was involved.

Ask the evidence
What does the evidence actually show?What should our board be asking about this?Where does Rahim disagree with the consensus?
Bring this into your organisation

If this describes something happening in your teams, say so.

Keynotes, board sessions and advisory work, drawing on research across more than 200 organisations in 30 countries. Tell me the room, the date and the shift you need. A reply within 24 hours.

Start a conversation

Topics and audiences  ·  All research

Most board papers report adoption. Almost none reports who owns the capability floor, or what a week without the system would cost. Putting that item on the agenda properly is the engagement. Board advisory.

This argument is one a board usually meets for the first time in the room. There is AI keynote for boards and leadership offsites, and the full range of topics and audiences.

Running a session on this for your board? See how to run a board away day on AI, what a board briefing on AI should cover and questions for a board dinner on AI.

These questions are one of a set. Arranged for a board, with what each one is trying to establish: board oversight of AI. If the board would rather have the argument in the room than on a page, there is a board away day, and AI fluency for boards and leaders for the directors who want to be able to read the paper themselves.

Box of Amazing

Rahim’s free weekly letter on AI and human capability

If this was useful, the weekly letter is where the thinking happens first. Most of what ends up on this site starts there. Every week, an essay and ten links to broaden your view of the world. Read by 25,000 people, every week since 2017. Free, and one click to stop.

Opens Substack to confirm. No pitch in it, unsubscribe in one click, and nobody follows up because you read something.