Repeatability as a Core Value in March CACM: For Software and Education

April 6, 2015 at 8:24 am Leave a comment

Repeatability presumes evidence (which can be repeated).  Computer scientists have not valued evidence and repeatability as much as we need to for rigor and scientific advancement — in education, too.  One of my favorite papers by Michael Caspersen is his Mental models and programming aptitude ITICSE 2007 paper where he and his colleagues attempt to replicate the results of the famous and controversial Dehnadi and Bornat paper (see here).  Michael and his colleagues are unable to replicate the result, and they propose a research method for understanding the differences.  That’s good science — attempting to replicate another’s result, and then developing the next steps to understand the differences.

Science advances faster when we can build on existing results, and when new ideas can easily be measured against the state of the art. This is exceedingly difficult in an environment that does not reward the production of reusable software artifacts. Our goal is to get to the point where any published idea that has been evaluated, measured, or benchmarked is accompanied by the artifact that embodies it. Just as formal results are increasingly expected to come with mechanized proofs, empirical results should come with code.

If a paper makes, or implies, claims that require software, those claims must be backed up.

via The Real Software Crisis: Repeatability as a Core Value | March 2015 | Communications of the ACM.

Entry filed under: Uncategorized. Tags: , , .

Let me tell you what I know about gender and CS: An undergrad teaches her faculty about diversity Media Computation for CS Principles

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Trackback this post  |  Subscribe to the comments via RSS Feed


Recent Posts

April 2015
M T W T F S S
« Mar   May »
 12345
6789101112
13141516171819
20212223242526
27282930  

Feeds

Blog Stats

  • 1,269,083 hits

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 4,568 other followers

CS Teaching Tips


%d bloggers like this: