SRHE Blog

The Society for Research into Higher Education


Leave a comment

When assessment goes local, who keeps what students bring back?

by Carlene Kyeremeh

A student sent me a photograph of a handwritten waybill. Dated November 2022, it records a unit price for printed sachet film. It also carries the names of a supplier and a customer and the given name of the person who issued it. The waybill appeared in a term paper on fiscal consolidation as evidence of a cost increase that no statistical series I have found records.

It is in my files. Not the department’s. Mine.

I describe the waybill here but do not reproduce it, identify those named, or give the figure it records. The students who wrote the paper agreed to this account. I have no record that the supplier, the customer or the person named agreed to the document’s retention or wider use, so I have minimised the identifying detail, including the price, which is the most commercially sensitive thing on the page.

I have argued elsewhere that the curriculum can help to thicken a thin documentary record. Ask each student to obtain one item of locally sourced evidence: an interview, a quoted price, a document from a firm or public office, and, over successive cohorts, a course can assemble material that no database previously held. This is no longer only my ambition. Programmes are already redesigning assessment in response to generative AI, and one attractive move is to require evidence a model cannot retrieve: a price obtained in a market, an interview conducted locally, a document held by a firm or public office. That redesign brings third-party material into course files at scale, often without a parallel decision about what should happen to it after assessment.

That is the promise. The waybill in my files is the problem that follows it.

What universities already know how to govern

Research ethics and commercial confidentiality are not routinely ignored in student work. Professionally oriented programmes have long had to decide what an organisation may disclose, who may see it and when it must be returned. For example, McMaster University’s course-based research guidance explicitly covers undergraduate, MBA and graduate courses. The University of Toronto provides both a course-based ethics route and a classroom confidentiality agreement for third-party proprietary information. In the UK, the University of Manchester’s ethics guidance asks researchers to establish first whether an activity is research training conducted as coursework, described as collecting and analysing a small amount of data to gain experience in method, or research proper. These arrangements show that collection, consent, confidentiality and use within a defined project can be governed. My argument is therefore not that universities lack such protections. It begins where a normal project would end.

The problem begins when the course ends

If material is returned, destroyed or retained only with the assessed work, its lifecycle has a clear end. But the design I am proposing depends on the evidence outliving the assignment. A document collected by one student in 2026 should be available to another cohort in 2028 or 2029, alongside prices, interviews and documents gathered in the intervening years. The course is not only assessing students. It is building a local source collection.

That changes the questions. What exactly does the university hold after the assessment period? Who is its custodian? How long may it be retained? May another cohort consult it? What fresh permission is needed if it is later used for research or publication? These procedures can help answer those questions, but not automatically. An agreement that properly confines information to one course may rule out the very reuse on which the proposed archive depends.

The evidence is not the assignment

The student’s analysis is coursework. The material used to produce it is not necessarily the same thing. A waybill may contain personal or commercially sensitive information. Interview notes are harder still: they are neither the source’s own record nor the student’s analysis, but one person’s written account of what another person said, made for an assignment and now held by a lecturer.

Where the activity is classified as teaching rather than research, this third-party material can still raise a lifecycle question: do institutional rules cover its custody, retention and reuse after the assessment for which it was collected? The Manchester distinction is instructive here. A course collection built to outlive its cohorts is not a small amount of data gathered to practise a method, but neither does it fit neatly within research as that definition intends. It is a lifecycle problem created by a particular curricular ambition.

The reuse is the point

Ghana’s Data Protection Act, 2012 (Act 843) requires personal data to be collected for a specific, explicitly defined and lawful purpose, limits retention and requires further processing to be compatible with the original purpose. Material obtained for one student’s term paper and later made available to another cohort may involve further processing. Nothing in the waybill I received establishes permission for it to become part of a standing course collection.

The Act contains provisions for historical, statistical and research uses where the relevant conditions are met. Those provisions offer a governed route, not a retrospective blank cheque. They do not turn a lecturer’s folder into an institutional archive. The underlying principle is not unique to Ghana: UK guidance likewise treats purpose, storage and research-related reuse as connected but distinct questions.

Ordinary assignment governance is adequate for ordinary assignments. The problem appears when coursework is asked to do something additional: to enlarge a locally available documentary record over time.

The archival value and the governance risk arise from the same feature. An archive that cannot be consulted next year is not an archive. A collection that can be consulted next year without the source having been told is not a defensible one.

A small institutional answer

The answer need not be a new bureaucracy. It could begin with a short institutional instrument that separates use in a student’s assessment from retention in a course source collection. Before collection begins, it should state the teaching purpose, what may be collected, who may later consult it, how long it will be kept, which unit is responsible and what choices the source has. Research use or publication should require a separate decision rather than being hidden inside the phrase ‘educational purposes’.

The remaining requirement is custody. What one lecturer can require, only an institution can keep. A named custodian, controlled access, a retention and disposal schedule, and a record of what the course has produced would convert a personal folder into an accountable institutional practice. Existing MBA, ethics and confidentiality processes provide models; the task is to extend their discipline to the intended afterlife of the evidence.

Proportionality matters. If the process becomes heavier than the assessment it supports, colleagues may stop asking students to gather local evidence. But a department unable to provide a clear collection notice, a retention rule and somebody accountable for what returns should not require the fieldwork. Otherwise, institutional risk is transferred to students and to the businesses that agree to speak with them.

Readers can test this in ten minutes. Take your own institution’s course-based ethics route or classroom confidentiality agreement and look for two things: whether either says anything about third-party material after the assessment period, and who is named as responsible for it. If neither appears, ask where else the institution governs the evidence after the assignment ends. If there is no answer, the arrangements may govern the assignment without governing its evidentiary afterlife.

Before we ask for more

The curriculum can enlarge the archive. The qualification is that the archival ambition creates an additional governance obligation. The question is not only whether the evidence was collected ethically and kept confidentially. It is whether its intended custody, retention and reuse were made explicit before collection began.

I have a waybill in my files and no good institutional answer to those questions. That is not an argument against asking students to go and find out. It is an argument for deciding what we will do with what comes back, before we ask them to go.

Dr Carlene Kyeremeh is Associate Professor and Vice President, University Advancement, Recruitment and Research at All Nations University, Koforidua, Ghana. Her research addresses curriculum decolonisation, higher education policy in Africa and the Caribbean, and the political economy of educational technology.This post develops a governance question raised in Issues 14 and 15 of The Decolonized Curriculum, her LinkedIn newsletter.


Leave a comment

Research ethics committees should rethink risk

by Jacqueline Stevenson, Tom Power and Alison Fox

There are good reasons why institutional human research ethics committees (RECs) or research ethics boards (REBs) are needed in higher education institutions – namely, to ensure research participants are treated in accordance with a set of agreed standards and principles. This includes, for example, avoiding harm, ensuring informed consent, clarifying how any data collected will be stored and used, and ensuring transparency in relation to gaining access to participants through gatekeepers. There is also an ethical imperative to ensure a certain level of quality so that research has the potential to be of benefit to individuals, and society.  

There has been growing concern over the last twenty years, however, that some RECs have become such powerful regulatory bodies that they have almost complete control over what institutional research is conducted, as well as how and where it is undertaken. The ways in which RECs approach the approval of research ethics can seem antithetical to many of the other prevailing discourses of higher education (in the UK in particular), such as the need to decolonise research, the commitment to enhancing equity and inclusion, the focus on the co-creation of knowledge, and the push for greater co-collaboration with external stakeholders. 

In 2004, Haggerty drew attention to the worrying trend of what he coined ‘ethics creep’, where ethics committees have been afforded significant levels of institutional power above and beyond that for which they were initially tasked – including bringing within their scope and oversight those forms of activity which were historically not considered research, such as on-campus surveys, or in-class student research. Moreover, concerns have been levelled at RECs for being secretive in the ways in which they work, inconsistent in their approach to applying their own guidelines, and prioritising a box-ticking approach over any exploration of more meaningful ethical considerations (see Allen, 2008 for an overview).  

A further concern for many educational researchers is that approaches to ethical review, initially developed in relation to biomedical sciences, have largely been positivist. Such approaches can be detrimental to more qualitative research – particularly research which is collaborative in nature, involves participatory methodologies, or is exploratory in approach – where methods may evolve over time (Guta, Nixon and Wilson, 2013). This, as we have written elsewhere, has implications for empowerment and equitable participation, and limits possibilities for challenging the power, dominance, and colonial practices of the global north (Fox and Busher, 2022) . 

Such concerns about the ways in which RECs operate are not, for us, purely hypothetical. We have each grappled with the complexities, vagaries, frustrations and ‘emotional vicissitudes’ (Monaghan, O’Dwyer and Gabe, 2013) of gaining ethical approval. We have done this as educational researchers, as members of RECs trying to influence our own ethics committees, and as supervisors supporting doctoral researchers, including those raising concerns at the SRHE’s professional development events about their struggles to gain ethical approval for planned projects. This is particularly problematic since the “de-risking” of research plans can stifle innovation, limiting possible contributions to existing knowledge and the development of new knowledges.  

The privileging of research ethics approvals for projects which are quasi-scientific in approach, rather than those that draw on innovative qualitative methodologies, can significantly limit our understanding of the ‘how’ and the ‘why’ and not just the ‘what’ of global concerns, such as educational disadvantage, poverty, climate change, or global health issues. 

It is eminently possible, however, for RECs to approve projects which are methodologically innovative, participatory in nature, collaborative in approach, and which involve external stakeholders – including from countries where approaches to research ethics may be thought of differently to how they are thought about in the global north. To do so, however, requires RECs to accept a significant level of trust in their academic researchers. Such trust is demonstrated by some RECs but is by no means universal.  

Despite these complexities we recently gained ethical approval for the 3MPower (Mobile Learning for the Empowerment of Marginalised Mathematics Educators) project at The Open University, UK, achieving an outcome which may not only offer hope to other researchers of what is possible, but which might also act as an exemplar to other research ethics committees of what can be achieved if they are prepared to put faith in their own researchers. 

The 3MPower project, funded by the EdTech hub, is a collaborative project generating evidence on technology use for Teacher Professional Development in Bangladesh, with a particular focus on children’s foundation numeracy skills in schools serving marginalised, low-income, rural communities. The project brings together researchers from the Open University and Dhaka University, Bangladesh, and involves a broad range of national stakeholders including government policymakers, policy implementers, teacher educators, rural education officers, and rural teachers. It also enables early career researchers working with PEER (Participatory Ethnographic Evaluation Research) researchers in Bangladesh to elicit the voices and experiences of marginalised teachers in rural communities.  

Inherent in the methodology are several approaches which are at odds with the normal requirements of RECs. 

First is the commitment of the project team to empower all those involved in the research, and to share power equitably between and across both researchers and other stakeholders. This has required institutional acceptance that the locus of control over the research activities cannot rest solely with The Open University and that research approaches need to reflect both the global north and the global south. 

Second is the commitment to trusting researchers in the field to behave with appropriate respect, integrity, and trustworthiness without the need for written information sheets to be provided to research participants or to have written consent elicited from them (these were considered both epistemologically or culturally inappropriate and thus a barrier to participation). 

Third, although the project’s broad methodological approach had been explicated in the ethics application, the methods being used are organic and constantly evolving dependent upon emerging findings from the field. For this reason, specifying detailed interview or survey questions was accepted as not possible before the research started.  

The REC was therefore required to trust its researchers to act with integrity. However, it is important to note that the researchers were also required to keep the REC updated about the developing research by submitting amendments to the REC application in response to iterations of the collaborative design. This allows ongoing dialogue between the research team and the REC – ensuring that the processes of ethical approval go beyond the ‘tick box’ activity critiqued above. 

In short, the REC agreed to the team delivering a research project underpinned by a set of principles which are at the heart of all good educational research! These include empowerment and power sharing; decolonising research by recognising and valuing the experiences, voices, and knowledges of others, especially those from the global south; and trusting in the skills and experiences of others, including those working in different countries and with different cultural beliefs. However, because the project team could not specify and submit all the artefacts normally required by a REC at the outset (consent forms, information sheets, survey tools, interview protocols), it is likely that the project would have not gained approval in many other HEIs – or certainly not in the form it has done.  

The 3MPower project team had several advantages. Not only did Tom, as the Principal Investigator, have extensive experience of working on similar projects but all of the research leadership team had prior research experience in Bangladesh. Moreover, as the then Deputy Chair of the Human Research Ethics Committee Alison had extensive understanding of qualitative, education-related research ethics, drawn not only from her institutional experiences but also from work reviewing and developing research ethics frameworks including with the British Educational Research Association (BERA). The project team therefore had a key advocate and a team of researchers who were already trusted.  

So, with support and through dialogue, ethical approval was granted, and the door was opened for ongoing support and mutual learning between the research team and REC about what is considered worthwhile and culturally appropriate research in Bangladesh. This is likely to be different for researchers in a less privileged position or where those involved in RECs have less experience (and this is often the case). Certainly, those PhD students who attend our SRHE professional development events tell a very different story.  

If we are to respond to society’s key challenges then it is time for RECs to become more risk-tolerant rather than risk-averse. This might involve re-evaluating risk through the eyes of gatekeepers and participants in the research context, giving greater weight to their voice during the ethics approval processes. RECs need to enable and not suppress innovation, and to both empower and trust higher education researchers and their research teams. This requires a rethinking of positionality, perspective, and philosophical beliefs about the way in which research can be conducted.  

Such rethinking of ethical practices can disrupt prior assumptions and contribute to learning about other ways of knowing and valuing within RECs. However, change needs to take place more broadly and more consistently across the sector. This needs to be done and done soon. The SRHE can, and should, be a key driver in pushing for change. 

Jacqueline Stevenson is a research associate on the 3MPower project at the Open University, visiting professor of Sociology of Education at the University of Leeds, and chair of the SRHE’s Research and Development Committee.

Tom Power is the Principal Investigator of the 3MPower project, a member of the Edtech Hub’s Building EdTech Evidence and Research (BETER) advisory group, and a Deputy Associate Dean for Knowledge Exchange at the Open University.

Alison Fox is Associate Head of School for Research and Knowledge Exchange for the School of Education, Childhood, Youth and Sport, Chair of The Open University Human Research Ethics Committee and a member of British Educational Research Association Council.


1 Comment

Do we want social science, or social science-fiction?

By Paul Temple

Because a lot of its research work involves schools and school-age children, research training at the Institute of Education tends to emphasise issues around confidentiality and anonymity in presenting research findings. Anonymity usually happens anyway in large-scale studies with hundreds or thousands of respondents – the National Student Survey, for example – because the point is to get a picture of what a category of people think, rather than the views of particular individuals. Those of us working on higher education research, however, are often in the position of asking relatively small numbers of informants about their professional views – that is, about the knowledge for which their employer is paying them, unrelated to their private lives. A university finance director could of course decline to be interviewed, but it’s hard to see why there should be a confidentiality problem about their explanation of the university’s resource allocation methodology.

When one of my PhD students was planning a study of the closure of the Ripon campus of York St John University, she assumed everything would have to be anonymised. But why?, I asked her. Yes, the closure was controversial, but that’s now history. Your study, I said, will have far more value if you contextualise it in the real-life settings of York and Ripon; just be sure that your respondents know that what they say will be on the record. But will they talk to me on that basis, she wondered: your problem, I said (correctly, as it turned out), will be getting them to shut up when you want to end the interview. Her thesis was fine, and the then YSJ VC seemed pleased that the institution was considered to be an interesting research subject.

The book by John Brennan et al, The University in its Place (2018), which provides four case studies of anonymised UK universities, took me back to these discussions. Brennan and his co-authors actually provide enough context to make it easy to work out the institutional identities: how many Scottish east coast cities have two universities, one of which (“Aspirational U”) obtained university status in 1994 and has about 5000 students? – no Googling, please. But it is the conceptual reason for anonymization that the authors put forward, aside from wanting “to respect the confidentiality of those to whom we talked” about the “sensitive” matter of university-regional relationships (p48), that I find fascinating. Anonymity was apparently necessary because “it is simply not possible to capture all the day-to-day complexity and uncertainty associated with higher education in practice and in place … [the study] necessarily involves selection, both intended and unintended … [so we cannot] present a complete and fully articulated representation either of particular institutions or places” (p48).

But making a selection is the basis not merely for all social science but for all research, of any kind. Show me a piece of research that isn’t the result of making a selection from the infinite variety of natural and social phenomena that initially confronted the researcher. Having then made a selection, no social scientific study will “capture all the day-to-day complexity” of an organisation, or of anything else. This is simply a logical impossibility, as there will always be more facts to be collected, more detail to be recorded, more details of details to be examined – as surely every PhD supervisor knows: “You’ve done enough, just write the thing up!”. What a researcher must do is focus on the chosen detail and (with an explanation) ignore the rest: you want the finance director to tell you about the resource allocation model, not about “the day-to-day complexity” of managing cash flow. In the cases of Brennan et al, no reasonable person would expect a study of university-regional relationships to include “a complete … representation” of, say, the catering arrangements in a particular institution, any more than an account of university catering would be expected to consider the university’s relations with regional public bodies.

I think that removing through anonymisation the context in which the research subject is embedded reduces the quality of understanding: it makes it harder for the reader to create their own view about what the research is saying – they have to go along with what the researchers say. Actually, anonymisation may mislead the reader if they guess wrong about the identity of the subject: “Funny, this doesn’t sound like Aberdeen!”.

It seems to me that Americans take a much more robust view about these matters than we do in Britain: maybe it’s a result of the First Amendment. George Keller’s ground-breaking book on university planning, Academic Strategy (1983), carried weight because he was describing successes and failures by named individuals in named universities. In the same tradition, Mark Kretovics (2020) doesn’t pull his punches, describing named leadership successes and failures (the failures are the best bits), down to the juicy details of expenses scandals. These accounts make you almost feel as if you’re in the room, not wondering if you’ve even got the right city.

Dr Paul Temple is Honorary Associate Professor in the Centre for Higher Education Studies, UCL Institute of Education.

References

Brennan, J., Cochrane, A., Lebeau, Y. and Williams, R. (2018). The University in its Place: Social and cultural perspectives on the regional role of universiites. Dordrecht: Springer.

Keller, G. (1983). Academic Strategy: The Management Revolution in American Higher Education. Baltimore, MD: The Johns Hopkins University Press. Kretovics, M. (2020). Understanding Power and Leadership in Higher Education: Tools for Institutional Change. New York: Routledge.