Discussion about this post

User's avatar
Theodore Whitfield's avatar

The Koedinger paper is at best very difficult to understand and believe.

First, EVERYTHING is filtered through a big, complex statistical model, and all the graphs that you see are outputs of this complex model. So it's not clear if all the parallel lines that you see are genuinely reflective of the data, or just artifacts of the regression model. Although the sample size sounds impressive, the data was actually a combination of many different smaller datasets across a wide range of studies, ranging from K-5 up to university level, so it's not clear how to think about the study population. Also, if you read the details of the paper, it's clear that some students really did learn faster than others, although the authors don't mention this in their summary.

Another problem is that the "learning" was very simplistic -- it's basically just simple computer multiple-choice questions that students can take and retake. It's not surprising that most students were able to learn the correct answers after 8 attempts, but that hardly justifies the sweeping conclusions. If you're genuinely interested in this, I recommend that you take a look at the supplementary materials, which have examples of the sorts of problems that students were answering. It's very underwhelming, and again this weak data does not support the conclusions of the paper.

Here's a simple analogy. Most people can learn how to operate a modern cash register with a little training (although even in this case there will be some who just don't get it). But that doesn't mean that everyone learns at the same speed -- instead, it means that operating a modern cash register is so cognitively undemanding that the majority of people can pick it up without difficulty. You don't even have to know any math, because the machine automatically calculates everything! But it would be absurd to suggest that that indicates that everyone learns at the same speed.

I agree that effective scaffolding can help students learn, and that we always want to improve our methods. But it doesn't follow that if just got the scaffolding right then everyone would learn the material.

Expand full comment
David's avatar

Prior knowledge, skills and understanding reduce the constraints of working memory to focus on new learning, which when embedded is further released for more learning.

The more you know can do and understand, the more easily you will learn.

SO... WHY DO SO MANY SCHOOLS FOCUS THEIR MAJOR LEARNING EFFORTS ON THEIR FINAL YEAR?

When the evidence points to the greater effectiveness of prioritising the first and early years -

Another example of school data being more important than children?

Expand full comment
8 more comments...

No posts