Logic error: Assuming that early coding leads to top-coding skills

September 2, 2013 at 1:34 am 5 comments

So, you do a survey of top coders, and find that many of them started coding between 8 and 11 years old.  Does that imply that starting coding between 8 and 11 leads to being a top-coder?  No, because you don’t know how many other kids started coding between 8 and 11 and got totally turned off to programming and are now gardeners.  Yes, the data are consistent with the belief that coding early leads to top-coder status, but there’s not enough there to avoid fallacy.

The argument suggested by the post below  is like the one that we’re trying to make about the role of early computing experience in influencing under-represented minorities.  We found the vast majority of under-represented minorities in CS had early computing experience.  But we also found that it was significantly more under-represented minorities had that experience than majority students in CS.  That strengthens our case that the early computing experience is particularly important for under-represented minorities.  What we haven’t shown yet is that there is a causal relationship.  Is it the case that many under-represented minority students who got early computing experience did NOT go into CS classes?  Until we know that, we can’t make any strong claims.  (I think that the quote below is from the same Neil Fraser who went to Vietnam and came back with a lot of incorrect assumptions about high school CS in the US.)

The article linked below is about teaching kids to program before they learn to read, using ScratchJr.  The article is interesting, and it raises a question well-worth exploring.

Early exposure to programming seems to have helped some of the world’s top coders. Earlier this year, Google engineer Neil Fraser in Mountain View, California, polled over 100 of his co-workers about when they first picked up coding, and then compared that with their performance on a simple test of skills. He found that those who wrote their first code between the ages of roughly 8 and 11 were most likely to develop advanced coding skills.

“We didn’t see an effect before 3rd grade, but certainly earlier is good,” Fraser says.

via Kindergarten coders can program before they can read – 26 July 2013 – New Scientist.

About these ads

Entry filed under: Uncategorized. Tags: , , .

Call for Papers: Special Issue of CS Ed for Doctoral Research The best Bret Victor video yet: “We don’t know anything about computing.”

5 Comments Add your own

  • 1. Neil Brown  |  September 2, 2013 at 3:58 am

    I saw Neil Fraser talk about statistics including this one at the CAS conference. Here’s a blog post that may be covering the relevant question: https://neil.fraser.name/news/2012/07/01/ Things that I find suspicious (besides the fallacy that you point out):

    1. I believe there is a recall bias. No-one says second grade when asked; I suspect a lot of them round to first grade because it sounds better or neater.

    2. Not to mention: how many people who did begin coding at a young age know when, exactly? I started coding when I was young, outside school. My best guess now is age 10, but reasonably it could be anywhere between 7 and 12; I simply don’t know for sure.

    3. The question as he writes it in the post is ambiguous. Is it “at what age were you cognitively able to do this” or “at what age did you have the knowledge to do this”.

    Reply
    • 2. Mark Guzdial  |  September 2, 2013 at 8:44 am

      I hadn’t seen that blog post, Neil. Thanks for sending it. The use of self-reported ratios of programming knowledge as evidence that schools are flawed is wrong on multiple levels: Nobody can accurately describe the ratios of where there knowledge came from, and because these people didn’t value schools doesn’t mean that nobody got any value from school. Why is the press quoting him?

      Reply
  • 3. Jeff Rick  |  September 2, 2013 at 8:41 am

    I was thinking that it was an incorrect assumption for another reason: Since programming is usually not a required class, people who code early are typically ones that have interest early. Interest and competence usually go hand-in-hand, so the survey might just indicate that early interest is important. To me, the greatest promise of early exposure to coding is that it can stimulate an interest. Too many people have an affinity for coding and do not realize it until quite late. There are so many stereotypes about coders being white geeky unsocial unathletic guys that need to be overcome. In that sense, we should also be careful about what ideas we spread early. All of the notable introductory CS research projects (Media Computation, Alice, Scratch, Greenfoot, Leah Buechley’s work, etc.) do a really nice job of providing an inclusive and interesting model of what computation looks like.

    Reply
  • 4. gasstationwithoutpumps  |  September 2, 2013 at 1:14 pm

    I learned to program around 1969, mostly from a high school class, since that was the only way I could get access to a computer in those days.

    Nowadays, computer access is easy, so kids with interest and parental support are starting quite young (I’d guess around 5th or 6th grade—that seems to be the age group targeted by learn-to-program and robotics after-school clubs here). They generally have quite a head start by high school, and high schools generally only teach one course in programming (if that much), so it is hardly surprising that the current top programmers are mainly self-taught through the end of high school.

    I agree with Neil Fraser that waiting until high school to start teaching programming is later than desirable, just as I think that waiting until high school to teach foreign languages is one of the reasons that we’re so poor at learning languages other than English.

    I have no data or surveys to back up my opinions, mainly because it isn’t worth my time to find them, but I’m convinced enough of them that I started my son programming around 4th grade (with plenty of pre-programming activity before then—he was counting in binary on his fingers in kindergarten) and started him learning Spanish is kindergarten. My son is now a high school senior, proficient in Python, C, and Scratch; with reasonable fluency in Java, Scheme, and JavaScript. He is now working on projects that are at the complexity level of college senior design projects in computer science or computer engineering (he’s even designing his own PC boards with SMD components for embedded systems projects, and going through the full design process to try to get a product that is manufacturable in low volumes at a particular price point—he and another high school senior are planning a Kickstarter campaign to make and sell 100 of them—before going to college in a year).

    Starting early does make a difference, but there is always the question of cause and effect. Do kids become good programmers because they start early, or do they start early because they already have the mindset of good programmers?

    Reply
    • 5. Mark Guzdial  |  September 2, 2013 at 3:01 pm

      I like the way you phrased that last question, and it connects to Jeff’s comments. I’m also interested in the inverse of those questions. Do kids who start early become programmers, and if not, do they do anything with the programming skills that they learned? What is the impact on starting early on the kids attitudes about programming if they do not become programmers? Do we end up driving more away, or drawing more in?

      Reply

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Trackback this post  |  Subscribe to the comments via RSS Feed


Recent Posts

Feeds

September 2013
M T W T F S S
« Aug   Oct »
 1
2345678
9101112131415
16171819202122
23242526272829
30  

Blog Stats

  • 924,781 hits

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 2,958 other followers


Follow

Get every new post delivered to your Inbox.

Join 2,958 other followers

%d bloggers like this: