Back to blog
Test Prep

Building SAT Practice Sets That Adjust in Real Time

SAT practice test booklet with pencil

Most SAT prep programs give students a diagnostic test at the start of instruction, organize students into broad skill-level groups, and then run them through the same practice sets adjusted for difficulty tier. This works reasonably well for students whose weak areas happen to align with the tier they are placed in. For many students, it misses the actual problem.

The SAT math section tests a relatively bounded set of concepts, but those concepts have prerequisites. A student who scores low on the algebra section might have a weak grasp of linear equations -- but the root cause might be a shakier understanding of how to manipulate fractions that predates any algebra instruction. Giving that student more algebra practice addresses the symptom. It does not address the actual problem, which sits one or two conceptual levels below the surface of the test content.

The structure of SAT math prerequisites

The College Board's official content specifications for SAT math organize questions into categories -- linear equations, quadratic functions, geometry, data analysis, and so on. What the specifications do not make explicit is that these categories are not independent. They are arranged in a conceptual dependency structure that mirrors the K-12 curriculum the test draws on.

Geometry questions on the SAT often require students to set up and solve algebraic equations -- which means that a student who struggles with geometry might actually have an algebra weakness rather than a geometry weakness. Data analysis questions that involve percentages will stump students who have fragile fraction-to-percent conversion skills. Problems that look like they are about functions often reduce to questions about ratios and proportional reasoning.

This dependency structure means that a practice set organized by SAT category is not necessarily organized by what each student actually needs to work on. A student spending four hours on quadratic functions might be better served spending two hours on linear equations and two hours on the fraction manipulation that underlies both.

What real-time adjustment looks like

An adaptive practice set is not just a test that gives harder or easier questions based on whether you got the last one right. That kind of item-response-theory adaptation adjusts difficulty but does not diagnose conceptual gaps. It tells you that a student is performing at a certain level; it does not tell you why.

Conceptually-adaptive practice works differently. It starts with a model of the prerequisite structure for the content being tested, and it uses a student's response patterns across a short set of questions to locate where in that structure the knowledge becomes unreliable. A student who gets standard algebra problems right but consistently fails when the same problem is embedded in a word problem context is showing a specific kind of brittleness -- they have the procedural skill but not the abstraction to extract the equation from context. That is a different instructional need than a student who cannot execute the algebraic procedure at all.

Real-time adjustment means that the practice set redirects before the student has spent significant time in the wrong area. If the first four questions reveal that the student has a ratio and proportion gap, questions five through twelve address that gap rather than continuing with the category the student was nominally assigned to. The session ends with the student having done meaningful work on the actual bottleneck, not on the surface symptom.

The test-prep context has different constraints than K-12

Test prep operates under time pressure that K-12 schools generally do not face in the same way. A student preparing for the SAT in three months does not have the luxury of a full curriculum remediation. Every hour of practice time has to be allocated toward the highest-leverage gap. This makes the accuracy of gap detection more consequential in test prep than in a typical school context.

Test-prep programs also tend to have better-defined success criteria than school curricula. The goal is a score. This makes it possible to model which concept gaps are most likely to be pulling down a given student's score, and to prioritize those. A student who is currently scoring at a certain level on the math section is losing points in a predictable distribution across concept categories; knowing which distribution applies to this specific student tells you where to focus.

The implication is that test prep is actually a better environment than school for demonstrating the value of adaptive practice, because the feedback loop is shorter and the outcome is measurable. A student who improves their score over a six-week program provides a clear signal about whether the practice set allocation was right. That signal is harder to observe in a year-long school curriculum where the outcome measure is a unit test rather than a standardized score.

What test-prep organizations need to implement this

For a test-prep organization to run adaptive practice sets effectively, they need three things. First, a prerequisite model for the specific exam content they are teaching -- not a generic adaptive learning graph, but one calibrated to the particular concept distribution of the SAT, ACT, or other exam. Second, a question bank that is tagged at the prerequisite level, not just by exam category, so that the practice set can route to fraction manipulation questions when that is what the diagnosis indicates. Third, an instructor-facing view that shows which students have been routed to which areas, so that in-class instruction can reinforce what the adaptive practice is addressing.

Without the instructor view, adaptive practice tends to run parallel to instruction rather than integrated with it. Students might be doing better-targeted individual practice, but the in-class sessions are still calibrated to a group-level average. The combination of adaptive practice and adaptive instruction is more powerful than either alone, and it requires the instructor to know what the adaptive system has learned about each student.

The technology to do this is not exotic. The hard part is building and maintaining the prerequisite model for the exam content, and building the question bank at sufficient depth in the prerequisite concepts. Those are knowledge problems as much as software problems. They are also the reason that off-the-shelf adaptive learning platforms often underperform in test-prep contexts -- they bring the infrastructure but not the content models tuned to the specific exam the student is actually preparing for.

See gap detection in action

Join the early-access program and run a pilot with your classroom or program.