← The questions map
Research

Learning: questions about AI

How children, students and adults acquire capability when the answer is free.

Last reviewed: 3 November 2026 · Next review due: 3 November 2027

One of the 20 territories of the questions map. 88 questions, phrased the way people ask them, each marked answered, partial or open: 49 answered, 29 partly, 10 open.

Answered means a dedicated research page exists. Partial means the closest research covers part of it. Open means it is on the roadmap and not yet written. Every question has its own link. Last reviewed: 3 November 2026 · Next review due: 3 November 2027.

AnsweredWhat is the expertise reversal effect?#

Instructional support that helps a beginner learn can hinder someone who already knows the material. Kalyuga, Ayres, Chandler and Sweller named it in 2003; the mechanism is redundancy against the learner's own stored patterns.

AnsweredWhat is guidance fading?#

Reducing instructional support step by step as knowledge grows. Renkl and colleagues found a fading procedure beat an abrupt switch from worked examples to problems. No general-purpose AI interface does it.

AnsweredDoes using GPS damage your brain?#

No study has shown it. The taxi driver research measured acquisition over four years; the one study of removal is behavioural, has 13 people at follow-up and never used a scanner.

AnsweredWhat is the Knowledge of London?#

Transport for London's taxi examination, introduced in 1865: 320 Blue Book runs within six miles of Charing Cross, seven stages, three to four years.

AnsweredIs there good evidence that delegating a skill makes you lose it?#

Much less than the acquisition evidence, and the asymmetry is a fact about research design rather than about safety. Removal studies need someone to take a working tool away from a professional.

AnsweredDoes the brain really stop developing at 25?#

No, and the number came from a 2004 magazine interview rather than a finding. A 2025 study of 3,802 people puts the end of the adolescent epoch nearer 32.

AnsweredWhich capabilities are built by practice rather than instruction?#

The ones that need effortful repetition with feedback. Those are exactly the ones a machine can now perform without you.

AnsweredHow do you assess students when AI can do the assignment?#

Not by detection. Sydney concedes prohibition is unenforceable; Denmark now requires oral defence of home-written exams.

Evidence that bears on this
  • The 2026 AI Index Report: The scale the question is operating at: the education chapter reports most US high-school and college students now using AI for schoolwork while institutional policy lags well behind.
Where I have argued this at length

AnsweredShould children use AI?#

How they use it matters far more than whether they do. Age-banded, and declining to advise on under-8s because the evidence does not exist.

Where I have argued this at length
  • What I Tell Kids About AI: Written to the teenager rather than about them, and it sequences the answer: understand it, learn with it, build with it, play with it, in that order, because the order decides what they think it is for.

AnsweredWhat is desirable difficulty?#

Bjork. Conditions that make study feel harder improve long-term retention. The mechanism underneath half of this research.

Evidence that bears on this
Where I have argued this at length
  • The Flake 99 Theory of Being Human: The idea carried through three generations of one family rather than through the experimental literature, which is where it becomes obvious that the constraint was doing the teaching.

AnsweredWhat is productive struggle?#

Struggling before being taught beats being taught first, at g = 0.36 across 53 studies. It reverses for young children and for general skills, which the authors report themselves.

Where I have argued this at length

AnsweredWhat happens to homework?#

Marks rise while the tool is present and unaided performance falls afterwards, in both a Turkish classroom experiment and a thirty-month panel of 26,811 Chinese students. The damage concentrates in whichever students actually hand the work over rather than work through it.

AnsweredHow should teachers use AI?#

For preparation, on the strength of a school-randomised trial that cut planning time 31 per cent with no quality difference a blinded panel could detect. English teachers have already concentrated it there: 35 per cent plan with it, 5 per cent mark with it.

AnsweredHow do adults learn with AI?#

Answered 14 September 2026 by assembling the four designs that withdraw the assistance before measuring. The split is delegation against engagement, not access against abstinence, and it reproduces in professional developers, in 1,222 online participants, in a school field experiment and in a thirty-month panel of 26,811 students.

Evidence that bears on this
Where I have argued this at length
  • Learn Anything: The twenty-hours rather than ten-thousand-hours case, with the argument that incumbents rather than new entrants would absorb AI learning, which is what happened.

AnsweredWhat happens when people stop practising?#

Measured in nineteen endoscopists: unassisted detection fell six percentage points within months of AI exposure. Capability does not disappear on a schedule anyone tracks, which is what makes it a debt rather than a cost.

AnsweredWhy does rereading feel like it works?#

Because fluency is mistaken for knowing. Restudying beat testing at five minutes, 81 per cent to 75, and lost badly at one week, 42 to 56.

AnsweredDoes struggling always help learning?#

No, and the meta-analysis says so itself. It works at g = 0.36 for older learners on specific content, and reverses for second to fifth graders and for domain-general skills.

AnsweredShould my child's school ban AI?#

The evidence supports neither a blanket ban nor a rollout. New York City paused student-facing generative AI to 8th grade for a year on 2 September 2026 while keeping teacher use and supervised pilots, and NPR reported a Stanford review of more than 800 papers that found the research extremely limited. The useful decision is by task and by age: which work pupils do unaided, who may bring a tool in, and a conversation before any accusation.

Where I have argued this at length
  • AI Education and the Future of Learning: The April 2023 answer, argued through Bloom's two-sigma problem: banning the tool repeats the calculator argument, and the prize is one-to-one tutoring at a price schools can bear.

AnsweredWhy does AI get harder questions wrong more often than easy ones?#

Because a hard question chains rules that change by year, threshold and sequence, and a model produces the shape of a correct answer whether the rule inside it is current or not. In one test of 18 chatbots on UK money questions the error rate rose from 57 per cent overall to 88 per cent on the harder questions, and the prose read the same either way.

AnsweredHow quickly must an AI incident be reported, and to whom?#

For high-risk systems in the EU, from 2 August 2026, to the national authority within fifteen days of awareness, two where critical infrastructure is disrupted, ten where someone has died. Almost no other AI use carries a clock; the Medicare case took eighty-four days from access to notice and broke no reporting rule, so the clock that matters is the one an organisation sets itself.

AnsweredIs an AI tutor as good as a human tutor?#

On an immediate test, in one 2,383-person randomised trial, yes: an hour of AI tutoring matched an hour with an expert human tutor within a quarter of a standard deviation. No trial has compared what remains weeks later, and the one experiment that withdrew the tool found unrestricted users 17 per cent worse off.

AnsweredWhat are the models of human judgement?#

About twenty named frameworks, of which five give an organisation a method and the rest give it vocabulary. The page grades each one and says which is which.

AnsweredWhat is a noise audit?#

The measurement of how much two people in the same role disagree on the same case. It raises consistency rather than accuracy, which is the part usually dropped.

AnsweredDo algorithms make better decisions than experts?#

Across 136 studies, better in roughly half the comparisons and equal in roughly half, with an average advantage near ten per cent. The modal result is a tie.

AnsweredWhat makes a decision good?#

Six links, and the weakest one sets the quality of the whole. Most AI investment lands on the two that were already strongest.

AnsweredHow much of a task should a machine do?#

Four separate questions rather than one dial: acquisition, analysis, decision selection and action, each automated to a chosen degree.

AnsweredIs human judgement a skill or an organisational property?#

The consensus treats it as a personal capacity to sharpen. This research treats it as an allocation of decisions, and training has not moved anything measurable.

AnsweredWhat do business schools say about AI and judgement?#

Broadly one account, named and sourced on this page, from Likierman's six elements to judgement work and intelligent choice architectures. Useful vocabulary, largely untested.

AnsweredDoes AI detection work?#

Not well enough to accuse anyone, and the errors fall hardest on second-language writers.

Where I have argued this at length
  • Human-Generated: Argues from the author's own experience of being scored as machine-written on text he wrote by hand, which is a more useful account of detector reliability than the vendor claims.

AnsweredWhat is the illusion of competence?#

The gap between felt and actual capability. It is why deskilling is not reported by the deskilled, and why every self-report survey of AI and skills is measuring worry rather than capability.

AnsweredWhat is retrieval practice?#

Recall strengthens memory; rereading mostly strengthens the feeling of knowing. The winner reverses with delay, so a short-horizon test prefers whichever method taught least.

AnsweredShould teachers use AI to mark work?#

Marking is where all four deskilling conditions converge. It is also the application English teachers use least, at 5 per cent. European law reached the same place: evaluating learning outcomes is named high risk in Annex III.

AnsweredShould every school have an AI strategy?#

A report by Sir Anthony Seldon and Tim Bunting asked on 22 September 2026 for one in every school, assessed by Ofsted. The useful version is written by task rather than by tool: which tasks the machine may do, who can stop it, what teachers must remain able to do, marking above all, and how the school would know if it went wrong. None of that waits for a national framework.

AnsweredHow should apprentices use AI?#

The trades, and the German and Swiss models.

AnsweredWhat is kind and wicked learning environments?#

A kind learning environment returns feedback that is quick, accurate and drawn from a complete sample, so that experience builds accurate judgement. A wicked one returns feedback that is delayed, noisy, censored by the learner's own deci...

AnsweredWhat is after action review?#

A structured review, held soon after an event, of what was intended, what happened, why the two differ and what to do differently, conducted so that the participants reach the conclusions themselves rather than being told them.

AnsweredWhat is cognitive apprenticeship?#

An instructional framework holding that expertise in cognitive work transfers only when the expert's reasoning is made explicit, through six methods: modelling, coaching, scaffolding, articulation, reflection and exploration.

AnsweredWhat is knowledge collapse?#

Knowledge collapse is the progressive narrowing over time of the knowledge a society actually holds and treats as worth knowing, relative to the broad historical stock it inherited, as cheap AI-mediated access pulls learning towards the ...

AnsweredWhat is never-skilling?#

Never-skilling is the failure to form foundational competence during training, because AI substituted for the cognitive effort that would have built it. It differs from deskilling in having no earlier capability to return to.

AnsweredWhat is mis-skilling?#

Mis-skilling is the acquisition of incorrect reasoning patterns, learned by uncritically adopting AI output that was erroneous or biased. The capability is built rather than lost, and built wrong.

AnsweredWhy does experience not always produce judgement?#

Because the feedback most professional work returns is delayed, noisy or censored by the decisions themselves. In that setting experience reliably produces confidence and does not reliably produce accuracy.

AnsweredWhat is an after action review?#

A structured review of what was intended, what happened and why the two differ. Across 46 studies, properly conducted debriefs improved subsequent performance by around a fifth.

AnsweredHow does expertise transfer when the work is invisible?#

Only if the reasoning is spoken aloud. The output of cognitive work carries almost none of the process that made it, which is the problem AI makes worse by producing the output without the process.

AnsweredWhich school districts have banned AI?#

New York City announced a one-year moratorium on student-facing generative AI from 2-K to 8th grade on 2 September 2026, affecting nearly 600,000 pupils, with companion chatbots prohibited in all grades; teachers may still use AI and up to 50,000 high-school students join supervised pilots. NPR reported that Los Angeles Unified has barred students from using AI on district devices. Neither is a ban on AI in schools as such.

AnsweredAre pupils writing worse on purpose to avoid being accused of using AI?#

Some say they are. A September 2026 report from the Center for Digital Thriving at Harvard, based on interviews with 31 teenagers, quotes students who cap their effort or perform mediocrity on purpose so that their work is not flagged; one of its authors, Beck Tench, called this cognitive withholding in Education Week on 30 September. It rests on interviews and has not been measured at scale.

AnsweredDo most schools have rules on AI?#

Not that pupils can see. RAND's Melissa Kay Diliberti said on 30 September 2026 that when its youth panel was asked in December whether their school had rules on AI use, only about a third said there were schoolwide rules and many did not know. US self-reports from 1,214 young people; the schools page sets them beside New York's moratorium and the Harvard report on accusation.

AnsweredDid AI make human Go players better?#

Yes, by the best measure available. Across 5.8 million professional moves from 1950 to 2021, scored by a superhuman program, decision quality improved comparatively little for sixty-six years and rose after superhuman Go AI arrived in 2016 and 2017, with novel moves associated with the better decisions.

AnsweredWas the Bastani study on generative AI and learning corrected or retracted?#

Corrected, not retracted. PNAS published one correction notice online on 20 August 2025, recorded here as fixing a printed affiliation, with no change to the finding. The notice's text could not be re-read on 26 October 2026, so that description rests on a reading of 12 September.

AnsweredWhat is the DOI of the correction to Bastani et al. (2025)?#

10.1073/pnas.2518204122, volume 122, issue 34 of PNAS, dated 26 August 2025. The original paper is 10.1073/pnas.2422633122.

PartialShould beginners use AI more than experts, or less?#

It depends on what is being measured. On output produced with the tool in hand, the less experienced person gains more, in four separate field experiments. On what people can do once it is taken away, the direction inverts.

PartialIs my child skipping the part that builds the skill?#

The question to ask about any homework. If the difficulty was the point, removing it removes the lesson.

PartialHow do I tell whether my child understands or has just produced?#

Ask them to explain it a day later, without the work in front of them. Fluency while reading is not knowledge.

PartialAt what age does AI use start to matter for capability?#

Wrong shape of question. It depends on which capability and when its practice normally happens, not on an age at which something completes.

PartialShould a teenager use AI differently from an adult?#

Yes, but the reason is exposure to unformed practice rather than an unfinished brain. What matters is which repetitions are being skipped.

PartialDoes AI help or harm learning?#

Both, and the interface decides which. The same model produced the best and the worst outcome in the same experiment.

PartialDoes corporate training still work?#

Completion is not capability. Five structural reasons, and the published data that would change the position.

PartialWhat should schools teach now?#

Tools change faster than any curriculum can be rewritten, so the durable question is which capabilities a school still builds deliberately once drafting, summarising and first-pass analysis are available to every pupil.

PartialHow do people become experts?#

Through repetitions at the edge of current ability, with feedback, over years. Remove the repetitions and the mechanism has nothing to work on.

PartialCan AI provide productive struggle, or only simulate it?#

The guardrailed arms of two experiments preserved most of the gain and removed most of the harm, which suggests it can be designed for.

PartialHow should learning be assessed when the process is invisible?#

Not by detection. Denmark now requires oral defence of home-written exams.

PartialCan judgement be measured?#

Disagreement can, in an afternoon, by having several people judge the same real cases independently. Judgement itself, in open-ended work with a model in the loop, has no validated instrument anywhere.

PartialHow do you get people to rely on AI appropriately?#

Nobody knows. Explanations raise acceptance without raising accuracy, cognitive forcing is mixed, and training reduces automation bias without removing it.

PartialDoes the aviation research apply to AI?#

The mechanisms transfer and the measurements do not. Those industries also hold the automation level fixed, define the envelope and fund the practice, which knowledge work does not.

PartialShould primary schools stop pupils using generative AI?#

The guidance page holds what the DfE and others say; the first large-system ban is New York City's one-year moratorium on student-facing generative AI from pre-kindergarten to eighth grade, announced 2 September 2026 with exceptions for assistive and language tools. Whether the ban protects learning is not measured; the coalition it created is to report within the year.

PartialWhat should education protect from AI?#

The first attempt, and the moment of recall. Both are what the learning evidence says does the work, and both are what an assistant removes first.

PartialWhat is epistemic debt?#

Epistemic debt is the gap between being able to produce working output with AI and being able to understand or repair it, producing practitioners whose functional usefulness masks low corrective competence.

PartialWhat should a teacher do before accusing a pupil of using AI?#

Talk to the pupil. The Harvard Center for Digital Thriving's report of September 2026 quotes students who were told there would be no discussion if a detector flagged their work, and who now write below their ability to avoid it. The schools page holds the rule, a conversation before any accusation; the detection page holds why software cannot make the accusation.

PartialWho decides whether pupils get an AI chatbot at school?#

Sometimes a supplier's setting. Education Week reported on 1 September 2026 that Google Classroom opened Gemini to pupils of all ages wherever a district had already allowed the app, with the option to switch it off; Common Sense Media's Robbie Torney called that defaulting to adoption over permission. The schools page holds the answer a school can write: a named person who can bring a tool in and switch it off.

PartialDoes an AI thinking partner improve critical thinking?#

Not on standard tests, in two small course studies. Zahra and colleagues (arXiv 2609.37880 and 2609.38029, 29 September 2026) found self-reported AI literacy rose while critical thinking scores did not move, and note that the gains 'may reflect growth in confidence instead of capacity'. One study had 14 students and no control group. The critical thinking page holds the larger studies.

PartialDoes AI lesson planning save teachers time without lowering quality?#

In one randomised trial, yes: 464 primary teachers encouraged to use Oak's Aila spent about 49 minutes a week less on planning, a 24 per cent cut, with lessons found not to be of lower quality, the Education Endowment Foundation reported on 6 October 2026. Use fell over the ten weeks and fewer than one in five said it changed their teaching. What it does to teachers' own planning skill was not measured.

PartialDoes ChatGPT's study mode stop pupils just getting the answer?#

Not according to Common Sense Media, which reported on 7 October 2026 after more than 4,000 test prompts that study mode could be bypassed with an option to show the answer and that full assignments were completed. OpenAI disputes the testing. No independent study of learning outcomes with the feature was found; one would settle it.

PartialCan teenagers tell when a chatbot is wrong?#

Many do not check. In a Digital Inquiry Group pilot described in Education Week on 7 October 2026, 117 high school students were shown a detailed and false chatbot answer with no sources: about three in ten trusted it, nearly half were not sure, and none of those who said they would follow it up did. A small pilot, reported by its authors.

PartialDoes a profession get better or worse after AI surpasses it?#

In Go it got better, once players could train with programs rather than only watch them, and while they still decided alone at the board. Where AI sits inside the decision, as in endoscopy, the measured result has gone the other way. One closed game is not yet a rule for work.

PartialCan randomised trials tell us whether an AI tool helps children learn?#

Not on their own, Sandra Leaton Gray argued in Times Higher Education on 29 October 2026: outcome trials measure whether a tool raises scores, not what happens to a child's development when they no longer need to do the thing themselves, and a tool might work on the chosen measure while diminishing something else. She proposes a national observatory for AI and child development. The page holds what is known about AI in teaching.

PartialIs time saved by an AI lesson-planning tool evidence of better teaching?#

No, and the Budget of 28 October 2026 offers the figure as if it were: it states that the Department for Education's AI lesson-planning tool is saving teachers an average of around three hours a week, with no source and nothing about what the hours became or what happened to the planning. The page holds why time saved is not the measure.

PartialWhat should a university do about teaching when nearly all students use AI for assessed work?#

Assess what AI cannot produce, and the week offered one attempt: a preprint of 26 October 2026 describes a 13-week engineering course with 87 students who could hand production to AI but stayed responsible for planning, verification, review and explanation, through six evidence channels, finding that collecting evidence scales more easily than interpreting it. The page holds the assessment problem; the course reports no comparison group.

PartialWhen AI can produce the artefact, what evidence of competence should teachers and employers assess instead?#

The reasoning and the checking, on two papers of the same week: the engineering course of 26 October 2026 assessed planning, verification, review, integration and explanation, and Marcin Mirończuk's paper of 23 October proposed claim-level authorial warrant, a contributor's capacity to understand, justify and defend their claims. The page holds the capability-versus-output problem; neither proposal has been tested against outcomes.

PartialShould students treat AI as a starting point rather than the final authority for life decisions?#

A survey of more than 4,800 international students in 106 countries, reported by Tes on 28 October 2026, found 23 per cent saying AI changed their university preferences and 61 per cent that it confirmed them, with a headmaster quoted saying AI should be a starting point rather than the final authority and counsellors described as most relevant for high-stakes personal questions. The page holds what a student should not hand over.

OpenDoes the expertise reversal effect apply to AI assistance?#

Untested. Nobody has varied AI scaffolding against measured prior expertise in a domain and then tested unaided performance. Bastani varied the interface, not the learner.

OpenShould schools and employers give young people the same advice?#

Open, and currently they do not. Schools are protecting formation; employers are buying output. Nobody owns the handover.

OpenDoes AI harm younger learners more than older ones?#

Open. Plausible on the practice argument, and the age-stratified evidence to settle it does not yet exist.

OpenIs it different for maths than for writing?#

Open, and probably yes. Skill decay research is domain-specific and the transfer question has not been settled for AI.

OpenCan AI help someone see what they do not know?#

Open, and the most useful thing it could do. Currently it does the opposite: fluent answers inflate estimates of one's own knowledge.

OpenWhat is Paradoxe de la facilitation?#

The facilitation paradox is that effort is part of satisfaction. Difficulty produces the good tiredness that comes from work done well, so removing it can strip work of the thing that made it worth doing.

OpenWhat is learn, unlearn, relearn?#

A widely repeated claim that the illiterate of the twenty-first century will be those who cannot learn, unlearn and relearn, universally attributed to Alvin Toffler's Future Shock.

OpenHow do I learn about AI properly for free?#

Open. There is a short list of free courses worth doing and no page here naming them, which is a gap rather than a judgement.

OpenCan teachers control what an AI chatbot tells students?#

Only partly, on one small study. Riahi and colleagues (arXiv 2609.29993, 24 September 2026) had 27 middle-school teachers configure classroom chatbots and found the settings matched the teacher's intent 88.9 per cent of the time for responsiveness, 81.5 for persona, 70.4 for rules and 59.3 for purpose; 'configurable controls alone do not ensure pedagogical fidelity'. What would settle it is a measurement of what the pupils were told, which the study did not take.

OpenDoes a fact-checking chatbot make people better at spotting misinformation?#

At once, and not a week later, on one trial. Jaidka and colleagues (arXiv 2609.32739, 26 September 2026) randomised about 2,200 people in the US, India and Singapore; a Socratic chatbot gave the largest immediate gain in telling true from false images, and a week later, unaided, the advantage had gone and the chatbot group had declined against control. A preregistered preprint with small effects; a longer follow-up with repeated use would settle whether anything lasts.

The other territories

The same questions, cut by who is asking: boards and directors, chros and hr leaders, school and university leaders, university students, early career and graduates, managers and team leads, regulated and expert professions, parents.

Reference · SS-2026-461 · How I use AI here

Cite this page

Hirji, R. (2026). Learning: questions about AI. The SuperSkills evidence base, SS-2026-461. https://thesuperskills.com/research/questions/learning. Last reviewed 3 November 2026.

An evidence review by Rahim Hirji, not peer-reviewed research. For a material claim, cite the underlying study as well; every study here carries its own permanent link.

How citations and IDs work

In this hub

Start here

Where this research begins, and how it is done.

Bring this into your organisation

If this describes something happening in your teams, say so.

Keynotes, board sessions and advisory work, drawing on research across more than 200 organisations in 30 countries. Send me the date, who the audience is and the shift you need. I reply myself, within a working day.

Enquire

Topics and audiences  ·  All research

Box of Amazing

Rahim’s free weekly letter on AI and human capability

New questions arrive here every month. The weekly letter is where they get worked through before they are answered. Every week, an essay and ten links to broaden your view of the world. Read by 25,000 people, since 2017. Free, and one click to stop.

Opens Substack to confirm. No pitch in it, unsubscribe in one click, and nobody follows up because you read something.

Running an event, or responsible for how AI arrives in your organisation? AI keynote speaker  ·  Advisory  ·  Boards  ·  Enquire