ICER 2015 Preview: First CSLearning4U Ebook Paper
August 5, 2015 at 7:35 am 3 comments
ICER 2015 (see website here) is August 9-13 in Omaha, Nebraska. The event starts for me and Barbara Ericson, Miranda Parker, and Briana Morrison on Saturday August 8. They’re all in the Doctoral Consortium, and I’m one of the co-chairs this year. (No, I’m not a discussant for any of my students.) The DC kickoff dinner is on Saturday, and the DC is on Sunday. My thanks to my co-chair Anthony Robins and to our discussants Tiffany Barnes, Steve Cooper, Beth Simon, Ben Shapiro, and Aman Yadav. A huge thanks to the SIGCSE Board who fund the DC each year.
We’ve got two papers in ICER this year, and I’ll preview each of them in separate blog posts. The papers are already available in the ACM digital library (see listing here), and I’ll put them on my Guzdial Papers page as soon as the Authorizer updates with them.
I’m very excited that the first CSLearning4U project paper is being presented by Barbara on Tuesday. (See our website here, the initial blog post when I announced the project here, and the announcement that the ebook is now available). Her paper, “Analysis of Interactive Features Designed to Enhance Learning in an Ebook,” presents the educational psychology principles on memory and learning that we’re building on, describes features of the ebooks that we’re building, and presents the first empirical description of how the Runestone ebooks that we’re studying (some that we built, some that others have built) are being used.
My favorite figure in the paper is this one:
This lists all the interactive practice elements of one chapter of a Runestone ebook along the horizontal axis (in the order in which they appear in the book left-to-right), and the number of users who used that element vertically. The drop-off from left-to-right is the classic non-completion rate that we see in MOOCs and other online education. Notice the light blue bars labelled “AC-E”? That’s editing code (in executable Active Code elements). Notice all the taller bars around those light blue bars? That’s everything else. What we see here is that fewer and fewer learners edit code, while we still see learners doing other kinds of learning practice, like Parsons Problems and multiple choice problems. Variety works to keep more users engaged for longer.
A big chunk of the paper is a detailed analysis of learners using Parsons Problems. Barbara did observational studies and log file analyses to gauge how difficult the Parsons problems were. The teachers solved them in one or two tries, but they had more programming experience. The undergraduate and high schools students had more difficulty — some took over 100 tries to solve a problem. Her analysis supports her argument that we need adaptive Parsons Problems, which is a challenge that she’s planning on tackling next.
Entry filed under: Uncategorized. Tags: CSLearning4U, ebooks, MOOCs.
1.
Tiffany Barnes | August 5, 2015 at 8:52 am
Interesting plot! We have added data-driven adaptation to our logic proofs tutor in several iterations, bringing the completion rate from 35% initially to 90% now. The adaptations are: next-step hints, adaptive problem difficulty selection, and worked examples. We’re editing a paper on this for IJAIED – Special Issue on AI-supported education in computer science.
2.
ICER 2015 Report: Blocks win–Programming Language Design == UI Design | Computing Education Blog | August 17, 2015 at 7:28 am
[…] Tech had even more going on at ICER and RESPECT than I mentioned in my earlier blog posts (like here and here). The GVU Center did a nice write up about all of us here. The biggest thrill at ICER […]
3.
Preview for WiPSCE 2015: Usability and usage of interactive features in an online ebook for CS teachers | Computing Education Blog | November 6, 2015 at 8:20 am
[…] just writing code. They are using a variety of different kinds of learning activities (see our ICER ebook paper) — and successfully learning and gaining confidence. Writing code is not the only way to […]