
Listen to this article
Read by Coach Nigel Casey ยท 6 min read audio
Why Self-Assessment Fails: What 12,000 Data Points Tell Us
You can watch The Crown without subtitles. You understand your manager's emails. You read industry reports in English every week. By any reasonable standard, you're fluent.
Then you sit in a meeting with your German client, they ask you a question, and your mind goes blank.
This is the gap I've seen in 12,000 coaching sessions. It's the gap between comprehension and production. And it's the single reason self-assessment is unreliable.
Why Watching English TV Isn't Evidence of Fluency
Comprehension is a passive skill. You're receiving language. You can rewind. You can pause. You can pick up the gist from context clues and visual information. You're not under pressure.
Production is an active skill. You're creating language. You have one chance. Your colleagues are watching. There's no rewind button.
These are not the same thing.
I coached a CFO last year. She read the Financial Times every morning. She'd done it for five years. She could summarise articles perfectly. But when her CEO asked her opinion in a board call, she froze. Completely froze. Not because she didn't understand the question. She did. But because moving from understanding to speaking requires different neural pathways, and she'd never trained them.
The data proves this. In our assessments, we measure both comprehension and production separately. Across 12,000 students, approximately 68% overestimate their production level compared to their comprehension level. They think they're B2. They're actually B1. Some think they're C1. They're B1.
The Self-Assessment Illusion
Here's why this matters: self-assessment doesn't just tend to be inaccurate. It tends to be inaccurate in one direction.
When you assess yourself, you assess what you think you know. You think about the articles you've read, the meetings where you followed along, the presentations you understood without effort. Your brain doesn't measure the moments you couldn't speak.
Why? Because those moments are uncomfortable. Your brain avoids them. You remember them less clearly. You tend to think of them as exceptions or bad days, not as patterns in your actual level.
The CEFR framework, the European standard that actually defines what each level means, explicitly measures productive ability: can you speak it, write it, use it in real time?
Self-assessment measures something else. It measures confidence plus comprehension plus selective memory. That's not a level. That's a feeling.
What the Assessment Actually Measures
The difference between a proper assessment and self-assessment is that a proper assessment forces production under real conditions.
Our assessment asks you to:
- โListen to naturally spoken English and answer questions about it (comprehension, yes, but in real time, with no pause button)
- โSpeak about work topics, think aloud, respond to unexpected questions (this is where the gap shows)
- โWrite a short professional email (again, under time pressure)
- โRead a short article and answer questions (comprehension under time pressure)
The speaking section is where most people's self-assessment falls apart. They think they'll say something intelligent. They freeze. They search for words. They switch to Italian (or Spanish, or French, or whatever their L1 is) halfway through a sentence. They know what they want to say but can't say it fast enough.
This isn't a reflection of overall intelligence. I've assessed investment bankers, engineers, marketing directors. The pattern is the same. The people who assessed themselves as B2 are often B1. Sometimes they're still B1 when they were certain they were B2.
Why? Because comprehension is not production. You can understand B2-level input and only be able to produce B1-level output. That gap is real, and it's massive.
The B1โB2 Boundary: Where It Matters
Here's where this becomes a career issue.
Most companies, when they say they need "advanced English," mean B2. B2 means you can participate in meetings without preparation. You can make presentations. You can handle negotiations. You can think fast.
B1 is different. B1 means you can survive in English. You can talk about your job if you've had time to prepare. You might struggle in meetings. You definitely struggle with unexpected questions.
If your company needs B2 and you're actually B1, you might not notice for a while. You can read the documents. You can prepare your talking points. But when your Dutch colleague asks an unexpected follow-up question in a meeting, or your boss asks your opinion on the spot, there's a chance you'll freeze or switch to your L1 or answer in a way that sounds less intelligent than you actually are.
That's the penalty of not knowing your actual level. You're not confident in what you can do, because you're not sure what that actually is.
Why Self-Assessment Fails in One Direction
There's something else worth noting.
Of the 12,000 students we've assessed, approximately 28% underestimate their level. They think they're B1 when they're actually B2. But that's rare.
The vast majority either overestimate or get it roughly right. And the overestimation tends to be significant. An overestimation of one full level (thinking you're B2 when you're B1) is common. An overestimation of two levels is rare but happens.
Why is overestimation so much more common than underestimation?
Because comprehension is easier than production, and we naturally assess ourselves based on what we find easier. We notice the books we read, the podcasts we follow, the meetings we understood. We don't notice these moments. Or we minimise them. The moments we couldn't contribute, the words we couldn't find, the conversation we sat through in silence.
This is human. Not a reflection of your intelligence or commitment. Just how self-assessment works.
The Only Way to Know
The only way to know your actual level is to be assessed in a real, timed, pressure situation where someone else is measuring your production ability. Not your confidence or comprehension.
That's what the assessment does. It takes 20 minutes. It measures what you can actually produce in English, not what you think you can produce or what you can understand.
After 20 minutes, you'll know exactly where you stand. Not a feeling. Not an estimate. Your actual CEFR level.
And then you'll know what you're actually working towards. If you're B1 and you want to reach B2, you'll know what that gap is. If you're B2 and you want to get stronger, you'll know what needs work.
Knowledge is the first step to change. And the assessment is how you get that knowledge.
The only way to know your actual level is to test it properly. Not your comprehension. Your production level. The assessment takes 20 minutes and you'll know exactly where you stand.
Language Analysis
Select a category above to highlight those words in the text.