srhe

The Society for Research into Higher Education


1 Comment

Examining the Examiner: Investigating the assessment literacy of external examiners

By Dr Emma Medland

Quality assurance in higher education has become increasingly dominant worldwide, but has recently been subject to mounting criticism. Research has highlighted challenges to comparability of academic standards and regulatory frameworks. The external examining system is a form of professional self-regulation involving an independent peer reviewer from another HE institution, whose role is to provide quality assurance in relation to identified modules/programmes/qualifications etc. This system has been a distinctive feature of UK higher education for nearly 200 years and is considered best practice internationally, being evident in various forms across the world.

External examiners are perceived as a vital means of maintaining comparable standards across higher education and yet this comparability is being questioned. Despite high esteem for the external examiner system, growing criticisms have resulted in a cautious downgrading of the role. One critique focuses on developing standardised procedures that emphasise consistency and equivalency in an attempt to uphold standards, arguably to the neglect of an examination of the quality of the underlying practice. Bloxham and Price (2015) identify unchallenged assumptions underpinning the external examiner system and ask: ‘What confidence can we have that the average external examiner has the “assessment literacy” to be aware of the complex influences on their standards and judgement processes?’ (Bloxham and Price 2015: 206). This echoes an earlier point raised by Cuthbert (2003), who identifies the importance of both subject and assessment expertise in relation to the role.

The concept of assessment literacy is in its infancy in higher education, but is becoming accepted into the vernacular of the sector as more research emerges. In compulsory education the concept has been investigated since the 1990s; it is often dichotomised into assessment literacy or illiteracy and described as a concept frequently used but less well understood. Both sectors describe assessment literacy as a necessity or duty for educators and examiners alike, yet both sectors present evidence of, or assume, low levels of assessment literacy. As a result, it is argued that developing greater levels of assessment literacy across the HE sector could help reverse the deterioration of confidence in academic standards.

Numerous attempts have been made to delineate the concept of assessment literacy within HE, focusing for example on the rules, language, standards, and knowledge, skills and attributes surrounding assessment. However, assessment literacy has also been described as Continue reading

Vicky Gunn


Leave a comment

Learning Analytics, surveillance, and the future of understanding our students

By Vicky Gunn

There has been a flurry of activity around Learning Analytics in Scotland’s higher education sector this past year. Responding no doubt to the seemingly unlimited promises of being able to study our students, we are excitedly wondering just how best to use what the technology has to offer. At Edinburgh University, a professorial level post has been advertised; at my own institution we are pulling together the various people who run our student experience surveys (who have hitherto been distributed across the institution) into a central unit in Planning so that we can triangulate surveys, evaluations and other contextual data-sets; elsewhere systems which enable ‘early warning signals’ with regards to student drop-out have been implemented with gusto.

I am one of the worst of the learning analytics’ offenders.  My curiosity to observe and understand the patterns in activity, behaviour, and perception of the students is just too intellectually compelling. The possibility that we could crunch all of the data about our students into one big stew-pot and then extract answers to meaning-of-student-life questions is a temptation I find too hard to resist (especially when someone puts what is called a ‘dashboard’ in front of me and says, ‘look what happens if we interrogate the data this way’). Continue reading