OpenFiction [Blog]

What we talk about when we talk about automated assessment

Posted in mitx, MOOC, Open Educational Resources by scarsonmsm on July 23, 2012

If there is one single innovation driving the xMOOC* phenomenon, it’s the emergence of scalable automated assessments. The ability to provide feedback to thousands of students at once is a big part of what makes these courses scalable. A robust peer learning community is another aspect of this, but one for a later discussion. Anyway, to my non-technical self, there are three predominant flavors of these automated assessment:

• “Check yourself” kinds of quiz questions, often randomized in some way to try to control for cheating. These seem so far to be the assessments in the Udacity course I am taking.

• Simulations such as the circuitry sandbox used for 6.002x, which allow for open ended manipulation of variables. While these kinds of assessments are more sophisticated, the underlying technologies seem to be more one-off and to require more development effort than the “check yourself” tools.

• True adaptive learning environments along the lines of those used by Carnegie Mellon’s Open Learning Initiative. I know OLI is not usually discussed in the xMOOC conversation, but everything I understand about the program indicates they should be. These seem to be a whole nother level of complicated above simulations.

That’s my assessment of the assessments. Would love to hear others’ takes.

• So I am adopting Stephen Downes’ conventions, xMOOC for the Coursera/Udacity/MITx varient, and cMOOC for the original connectivist model.

4 Responses

Subscribe to comments with RSS.

  1. Brandon Muramatsu said, on July 23, 2012 at 9:49 am

    I’m more and more of the opinion that we should replace “emergence” with “expectation”.

    “the emergence of scalable automated assessments”

    • scarsonmsm said, on July 25, 2012 at 9:44 pm

      Having learned a little more about the assessment systems for many of the major MOOC players, I am inclined to agree.

  2. […] generally rely on lectures and frequent assessments. While MOOCs do encourage communities of students to participate and work with each other to learn […]

  3. What is MOOC | MOOCs4U.NET said, on October 24, 2013 at 10:33 am

    […] up^ Carson, Steve. “What we talk about when we talk about automated assessment” 23 July […]

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: