Wednesday, June 17, 2015

Openness needs a business model

Cover Open is not free. Openness needs a business model. Guess which one the neolibs have in mind.
"Laurillard is careful to separate education from access to resources, but she presents the relationship between the OER movement and web technology as largely unproblematic. I want to argue that the relationship is more layered and more complex, and that openness is an affordance of an assemblage and related to broad social conditions, national politics, economics and law."

Openness, technologies, business models and austerity. Learning, Media and Technology 15 Jun 2015 doi: 10.1080/17439884.2015.1051307
Open education emerged when the state had an active role in shaping and financing post-secondary education. In the twenty-first century, two pressures influence the way openness is conceived. The first is the compounding of neo-liberal economics with austerity following the financial crash of 2008. The second is the consolidation of networked and digital technologies at an institutional and infrastructural level, illustrated by massive open online courses (MOOCs). This article examines the place of open education in this emerging climate of economic constraint and technological possibilities. The article argues that openness is not a property or feature of a technology but that such properties can result in affordances. This understanding informs a review of openness in The Open University (UK), in relation to MOOCs and in the open educational resources movement. A relational view of affordance suggests that openness depends in significant ways on the character of broad social processes and that if they change then the affordances of technologies for openness change with them. The current marketisation of higher education, the reduction in public finances and continuing economic uncertainty lead to contradictory and conflicting pressures. Arguing in favour of education as a public good, the article criticises calls for a ‘business model’.

Monday, June 15, 2015

Common sense about feedback

Exam feedback

This paper takes a common sense approach to fixing "the feedback problem" - the stuff we all know is broken. Clue: It's not rocket science. Fixes needed include:
  • Aligning expectations (of staff & students, and between teams of markers)
  • Identifying all feedback available
  • Develop the student’s ability to self-assess
  • Draft-plus-rework - instead of the student simply producing a ‘finished’ product
  • Improve the linkage of assessment strategies across programmes and between modules/units
  • Ensure feedback is timely
  • Consider the role of marks – they obscure feedback
  • Reduce overemphasis on written feedback – oral can be more effective

All simple, logical and entirely correct. So here's the problem - we all know this, so why don't we do it? What is the structural problem that prevents the fix being implemented?

A scholarly approach to solving the feedback dilemma in practice. Assessment & Evaluation in Higher Education 14 Jun 2015 doi: 10.1080/02602938.2015.1052774
It is clear from the literature that feedback is potentially the most powerful and potent part of the assessment cycle when it comes to improving further student learning. However, for some time, there has been a growing amount of research evidence that much feedback practice does not fulfil this potential to influence future student learning because it fails in a host of different ways. This dilemma of the disjuncture between theory and practice has been increasingly highlighted by the UK National Student Survey results. This paper uses a model of the assessment process cycle to frame understandings drawn from the literature, and argues that the problem with much current practice resides largely in a failure to effectively engage students with feedback. The paper goes on to explore how best to effectively engage students with assessment feedback, with evidenced examples of feedback strategies that have successfully overcome this problem.

Friday, June 12, 2015

A fundamental misalignment: undergraduate science research projects

Darwin The Problem: An industrialized scale higher education system where "research projects" concentrate on the product rather than the process.

Proposed Solution:
"Our analysis suggests that even highly experienced academics involved in the provision of undergraduate research projects experience a range of contradictions around their assessment and evaluation. At the base of these contradictions lies the need for contextual judgement in the assessment of desired higher order, process-related learning outcomes and the misalignment between assessment and desired learning. It is perhaps not surprising, given the role of the journal article as the currency of scientific worth, that formal reports have been adopted as the dominant mode of assessment. However, the misalignment between this mode and the intended learning could be substantially avoided if assessment practices were to be redesigned. While we do not suggest abandoning formal reports, we do advocate the development of ways to make complex learning and higher order thinking visible as an additional and substantial component of assessment, and the concomitant development of appropriate grading criteria. In their study of unassessed, not-for-credit research experiences in science, Laursen et al. (2010) outlined a range of informal ‘markers for growth’ used by project supervisors in judging their students’ progress. They included cognitive, affective and behavioural markers: signs that students were engaging in or developing critical thinking, an understanding of the conceptual framework their project was part of, engagement in research, learning through problem-solving, dealing with risk and uncertainty, and developing independence. They have much in common with the intended learning outcomes described here. As well as confirming and expanding on the importance of these markers, our findings provide more concrete illustrations of the actions and thinking in which a student is expected to engage. We suggest that such (predictive) descriptions could form the basis for formal as well as informal judgements of student progress and achievement. In addition, their very richness and contextual specificity provides a valuable basis for students to form an understanding of how to progress and develop."

Unassessable or simply unassessed?

A fundamental misalignment: intended learning and assessment practices in undergraduate science research projects. (2015) Assessment & Evaluation in Higher Education doi: 10.1080/02602938.2015.1048505
Authentic experiences of research are seen as valuable elements of undergraduate science, providing motivation for students and linking the research and teaching activities of academics. But as such experiences are made available to increasing numbers of students as formal, graded parts of the curriculum, important questions are raised about their pedagogical function and the ways in which they are assessed. This article draws on interviews with academics involved in the provision of such experiences to ask: what do academics intend that their students learn, and do conventional approaches to project assessment relate clearly and effectively to these intended outcomes? We describe four categories of intended learning and suggest that conventional approaches to assessment are fundamentally misaligned with most of these outcomes. We argue that this is due to the focus of these approaches on the products, rather than the processes and experiences, of research, a focus that partly arises from a sense of discomfort with assessment based on context-dependent judgements informed by subconscious expertise. We further suggest that alternative approaches to assessment could build on academics’ own descriptions of the experiences and behaviours they value in students.

Thursday, June 04, 2015

Flipping lectures: a reflective diary

Jeremy Pritchard has shared his experience of flipped lectures in the form of a reflective diary via SpeakerDeck. (Anyone else used SpeakerDeck? Looks interesting - no audio narration option though?) I like this format more in many ways than the traditional academic paper for this sort of discussion and it's very helpful to have experience shared in this way. Well worth a read: