# Why Practice Test Scores Overestimate Readiness

> Practice test scores run high mainly because you start recognizing questions you've already seen, and recognition feels like knowing. Research on illusions of competence shows people's sense of how well they've learned is a poor guide to later recall. The score worth trusting is your first attempt on questions you've never seen, taken under real time limits, checked against whether you can state the rule behind each answer.

Source page: https://clinchedprep.com/blog/practice-test-scores-readiness/
Last reviewed: 2026-11-08

Practice test scores usually run higher than your real readiness, and the main reason is simple. After a few rounds, you stop answering the question and start recognizing it. Recognition feels like knowledge, but the real exam will ask about the same rule in words you haven't seen. You don't need to stop taking practice tests. You need to know which scores to believe.

## Recognition feels like knowing

Psychologists call this an illusion of competence. Koriat and Bjork (2005) showed that people judge how well they've learned something while the answer is in front of them, and that sense of familiarity doesn't carry over to a test where the answer is missing.[1] The judgment comes from what you can see during study, and the recall comes from what you can produce without it.

Other studies point the same way. In Roediger and Karpicke's 2006 experiment, students who reread a passage felt more confident about remembering it than students who had tested themselves, yet they remembered less a week later.[2] In Kornell and Bjork's 2008 study, people rated the less effective study method as more effective, even after their own test results showed the opposite.[3] Karpicke, Butler and Roediger surveyed 177 college students and concluded that many experience these illusions while studying, which shapes how they choose to study.[4]

Your feeling of readiness is a weak signal. Your score can be a stronger one, but only if you read it the right way.

## Four ways a practice score gets inflated

### You've seen the questions before

This is the big one. Every repeat of a question adds memory of that exact wording and that exact answer letter. A score of 90% on a bank you've cycled through three times says much less than 75% on questions you've never seen.

### You learned the answer, not the rule

Pan and Rickard reviewed 192 effect sizes from 122 experiments on whether learning from practice tests carries over to new questions. It does on average, but the carryover was strongest for application and inference questions and weakest for items that were simply rearranged.[5] Elaborated retrieval, meaning you work out why the answer is right, made carryover more likely.[5] Butler (2010) found that repeated testing beat repeated studying even on new inference questions given a week later.[6] Practice questions help, as long as the reasoning goes in with the answer.

### The conditions were easier

Untimed practice, pausing to look something up, or doing ten questions between meetings are all fine for learning. None of them predicts how you'll do in a two-hour sitting with a clock running and no notes.

### The questions were easier or narrower

A practice bank can lean on the topics that are easy to write questions about. If it never asks about a section of the official outline, your score says nothing about that section.

## Memorizing a bank vs learning the rule

Here's what the difference looks like on the [FAA Part 107 test](/exams/faa-part-107/). Someone who memorized a question bank knows the answer to "What is the maximum altitude for a small drone?" is 400 feet. Someone who learned the rule knows that 14 CFR 107.51 caps altitude at 400 feet above ground level unless the drone stays within a 400-foot radius of a structure and no higher than 400 feet above the structure's top.[7]

Now the real test asks about inspecting a 300-foot tower. The first person picks 400 feet and gets it wrong. The second works out that 700 feet above ground is allowed near the tower. Same rule, new wording, different result.

This is why Clinched shows the source under every answer, so you can check the regulation or handbook line the question is built on instead of remembering a letter. Whatever you study with, look up the rule behind any answer you can't explain.

## How to read your score

Count only first attempts: A question you've answered before doesn't count toward readiness, even if you got it right. Keep a separate tally for questions seen for the first time.
Take full tests under real conditions: Use the real number of questions and the real time limit, in one sitting, with no notes and your phone away.
Look at topics, not just the total: A passing total can hide a weak section. Sort misses by topic from the official outline.
Explain the right answer out loud: For each question you got right, say why the other choices are wrong. If you can't, count it as a lucky right answer.
Watch the trend: One score is noisy. Two or three full tests on fresh questions, a week apart, tell you more than any single one.


The score to trust is your first try on questions you've never seen, under the real time limit. Everything else measures memory of the practice bank.


## What practice tests are good for

None of this means practice tests are a waste. Answering questions from memory is one of the best ways to learn, and it beat rereading in the studies above.[2][6] The problem is only in reading the score as a forecast. Think of each practice session as doing two jobs. Most questions are there to teach you, and those can repeat as often as you like. A smaller set, kept aside and never peeked at, is there to measure you.

A simple way to do that is to set aside one or two full practice tests at the start and not open them until the last two weeks. Everything else is fair game for drilling. When you finally take the reserved tests, you get a number that hasn't been inflated by recognition, and you'll know whether to book the exam or give it another week.

## What margin to aim for

No study links a particular practice score to passing a particular licensing exam across different practice banks, and anyone who quotes a magic number is guessing. Practice banks vary in difficulty, and real exams change their questions.

A reasonable personal rule is to want a clear margin above the passing mark, on fresh questions, on more than one full-length attempt. If you're right at the passing line on your best day, you're not ready yet. Some questions on exam day will be harder than your practice and some easier, and a margin absorbs that.

## When the score drops

A lower score on a fresh test is useful. It may be the first honest number you've had. Go back to the topics it exposed, study the rules behind them, and test again a week later on new questions. That's the same spacing that helps you remember the material long after the exam, which matters because licenses like the [EPA Section 608 certification](/exams/epa-608/) cover rules you'll use on the job. For a full plan that builds this in, see [how to study while working full time](/blog/study-while-working-full-time/).

## FAQ

### What practice test score means I'm ready for the real exam?
No research gives a universal cutoff, because practice banks differ in difficulty from each other and from the real exam. A useful sign is scoring comfortably above the passing mark on full-length tests of questions you haven't seen before, taken under real time limits, on more than one attempt.

### Is it bad to retake the same practice test?
Retaking it is fine for learning, but the second score doesn't measure readiness. By then you partly remember the questions and answers. Use fresh questions, or a test you haven't seen in weeks, when you want to know where you stand.

### Why did I score lower on the real exam than on practice tests?
Common reasons are repeated practice questions you had started to recognize, practice tests taken without a time limit or with breaks, and real questions that test the same rule from a different angle. Studies on transfer show recall practice helps most on new questions when you learned the reasoning behind the answer.


## Sources

1. Illusions of competence in monitoring one's knowledge during study (Koriat and Bjork, 2005), Journal of Experimental Psychology: Learning, Memory, and Cognition. https://doi.org/10.1037/0278-7393.31.2.187
2. Test-enhanced learning: Taking memory tests improves long-term retention (Roediger and Karpicke, 2006), Psychological Science. https://doi.org/10.1111/j.1467-9280.2006.01693.x
3. Learning concepts and categories: Is spacing the enemy of induction? (Kornell and Bjork, 2008), Psychological Science. https://doi.org/10.1111/j.1467-9280.2008.02127.x
4. Metacognitive strategies in student learning: Do students practise retrieval when they study on their own? (Karpicke, Butler and Roediger, 2009), Memory. https://doi.org/10.1080/09658210802647009
5. Transfer of test-enhanced learning: Meta-analytic review and synthesis (Pan and Rickard, 2018), Psychological Bulletin. https://doi.org/10.1037/bul0000151
6. Repeated testing produces superior transfer of learning relative to repeated studying (Butler, 2010), Journal of Experimental Psychology: Learning, Memory, and Cognition. https://doi.org/10.1037/a0019902
7. 14 CFR 107.51, Operating limitations for small unmanned aircraft, eCFR, National Archives. https://www.ecfr.gov/current/title-14/chapter-I/subchapter-F/part-107/subpart-B/section-107.51
