Bloom’s 2-sigma problem, forty years later.

In 1984, Educational Researcher published a paper by Benjamin Bloom that gave learning science its most famous number. Two of Bloom’s doctoral students at the University of Chicago had run controlled experiments comparing three ways of teaching the same material: a conventional classroom, a mastery-learning classroom, and one-to-one tutoring. The headline result was that the average tutored student performed about two standard deviations — two sigma — above the average of the conventional class, which is to say better than roughly 98 percent of students taught the ordinary way (Bloom, 1984).

Bloom did not present the number as a victory lap. He presented it as a problem. One-to-one tutoring was, in his words, too costly for most societies to bear on a large scale, so the task he set the field was to find methods of group instruction as effective as a personal tutor (Bloom, 1984). Forty years later, that assignment has structured an entire research programme: mastery-learning systems, intelligent tutoring systems, and now large-language-model tutors are all, in one way or another, attempts to hand in Bloom’s homework.

What Bloom actually measured

The details matter more than the legend. The two-sigma figure comes primarily from dissertation studies by Joanne Anania and Arthur Burke, run with fourth-, fifth- and eighth-grade students learning short, well-structured units such as probability and cartography (Anania, 1983). The three conditions were carefully staged: conventional classes of about thirty with periodic tests; mastery-learning classes that added formative tests with corrective feedback until each unit was mastered; and tutoring in groups of one to three, which kept the mastery procedures and added a tutor.

Two features of the result are routinely forgotten. First, mastery learning alone — no tutor, just formative testing with required correctives — moved students roughly one standard deviation above the conventional class (Bloom, 1984). Half of the fabled gap came from procedures that need no tutor at all. Second, the tutoring condition included the mastery requirement: tutored students were not merely talked to individually; they were not allowed to move on until they had demonstrated mastery of each unit. The famous 2.0 is the effect of tutoring and mastery together, under near-ideal conditions, measured with tests closely aligned to exactly what was taught.

Two sigma was the ceiling, not the norm

How typical is that benchmark of tutoring in the wild? Not very. A meta-analysis of school tutoring programmes — real tutors, real classrooms, no laboratory staging — found an average effect on tutored students of about 0.40 standard deviations (Cohen, Kulik & Kulik, 1982): clearly valuable, nowhere near two sigma.

When Kurt VanLehn later reviewed experiments that directly compared human tutoring against classroom or no-tutoring baselines, he found the typical effect of human tutoring to be d ≈ 0.79 — large, but far short of Bloom’s 2.0 (VanLehn, 2011). On this reading, Bloom’s studies were an outlier produced by stacking every advantage at once: trained tutors, mastery thresholds, short curated units, and outcome tests built to match the instruction. That reframing matters because it moves the finish line. The realistic target for “as effective as a human tutor” is closer to 0.8 standard deviations than to 2.0 — and that target, it turns out, is reachable.

What a tutor actually does

The mechanism behind the effect is easy to misread. A tutor’s advantage is not superior explanation — lectures from a tutor are still lectures. It is a loop that group instruction cannot run: the tutor continuously diagnoses the learner’s current state, often from a single wrong step; guides with a hint or question calibrated to that specific error; and verifies that the learner can now do the thing before moving on. Mastery learning captures the verify step alone — which is presumably why it is worth around a full sigma by itself in Bloom’s data (Bloom, 1984). Tutoring adds high-frequency diagnosis and guidance in between.

VanLehn’s synthesis offers the sharpest version of this claim, the interaction granularity hypothesis: instructional effectiveness rises as the feedback loop tightens — from feedback on final answers, to feedback on every step of a solution — and then plateaus, with finer-than-step granularity adding little in the studies he reviewed (VanLehn, 2011). If that plateau is real, it is extraordinarily good news for software, because step-level interaction is precisely the granularity a machine can sustain indefinitely, for every learner at once.

How close have machines come?

Intelligent tutoring systems (ITS) were built as an explicit run at Bloom’s target — Carnegie Mellon’s cognitive-tutor group even titled a paper “Cognitive computer tutors: solving the two-sigma problem,” arguing from evaluations of its programming and algebra tutors that mastery-based cognitive tutors could recover much of the tutoring advantage (Corbett, 2001). These systems model the knowledge a task requires, track each learner’s mastery of each component skill, give feedback within a solution attempt rather than after it, and gate progression on demonstrated mastery: the tutoring loop, mechanized.

The meta-analytic verdict is more positive than most people outside the field expect. In VanLehn’s comparison, step-based tutoring systems produced d ≈ 0.76 against the same kinds of baselines on which human tutoring produced 0.79 — a difference too small to be meaningful (VanLehn, 2011). Ma and colleagues, synthesizing 107 comparisons, found that ITS outperformed conventional large-group instruction by a moderate margin, and found no significant difference between ITS and one-on-one human tutoring (Ma et al., 2014). Kulik and Fletcher, reviewing 50 evaluations of full ITS courses, reported a median effect of 0.66 standard deviations, with the tutoring system outperforming the comparison condition in the large majority of studies (Kulik & Fletcher, 2016).

Against Bloom’s 2.0, those numbers look like failure. Against the realistic human-tutoring benchmark of roughly 0.8, they read very differently: on the outcomes these studies measured, well-built tutoring software performs in the same band as a human tutor — at a marginal cost per learner approaching zero.

The LLM turn

Why, then, doesn’t every course ship with a tutor? Mostly authoring economics. A classic ITS demanded years of cognitive task analysis and rule engineering per course, which is one reason the successes cluster in mathematics, physics and programming (Kulik & Fletcher, 2016). Large language models change that constraint: tutor-style dialogue no longer requires a hand-built domain model for every topic — though it very much still requires pedagogical guardrails.

The early controlled evidence is promising. In a randomized trial in a Harvard introductory physics course, students who worked through lessons with a purpose-built AI tutor — engineered around the same principles the ITS tradition converged on: activate prior knowledge, guide rather than answer, check understanding before advancing — learned substantially more than students in an actively taught classroom, and did so in less time (Kestin et al., 2025). It is one course, one population, and a short duration. But it is exactly the shape of result Bloom’s challenge calls for, and the first trials of this new generation are only now arriving.

What the evidence doesn’t show

This literature is genuinely strong, and it is routinely oversold. Four caveats keep the claims honest:

• Nothing reliably delivers two sigma. No replicated programme — human or machine — has reproduced Bloom’s 2.0 under realistic conditions. Typical effects for tutoring of all kinds cluster between roughly 0.4 and 0.8 (Cohen, Kulik & Kulik, 1982) (VanLehn, 2011). Two sigma is a ceiling observed under ideal conditions, not an achievable KPI.
• Effects shrink on standardized tests. Kulik and Fletcher found markedly larger effects when outcomes were measured with locally developed tests than with standardized ones (Kulik & Fletcher, 2016). Some of that is legitimate alignment, some of it is teaching to the measure — either way, the gains are narrower than a single headline number implies.
• Results vary by population and subject. A meta-analysis restricted to K–12 mathematics found overall ITS effects close to zero, with weaker results for lower-achieving students (Steenbergen-Hu & Cooper, 2013). The averages conceal real heterogeneity.
• Implementation dominates at scale. In the largest randomized effectiveness trial of a mature ITS — Cognitive Tutor Algebra I across dozens of schools — there was no detectable effect in the first year; a positive effect of roughly a fifth of a standard deviation appeared only in the second year of implementation (Pane et al., 2014). The software is a necessary ingredient, not a sufficient one.

None of this undermines the core result. It bounds it: tutoring-style instruction produces large, replicable gains on outcomes aligned to what was taught; those gains shrink with distance from the taught material, vary across populations, and depend heavily on how the system is actually used.

Where that leaves the problem

Read at forty years’ distance, Bloom’s paper makes two claims, and history has treated them differently. The empirical claim — two full standard deviations as a typical effect — has not survived; it was the ceiling, not the norm (VanLehn, 2011). The structural claim has aged perfectly: the active ingredients of tutoring are continuous diagnosis, calibrated guidance and verified mastery, and the only reason every learner does not get them is that human loops do not scale. That was never a pedagogy problem. It was an economics problem — and it is the one part of the 1984 paper that technology can straightforwardly attack (Bloom, 1984).