by William Locke
Higher education research has grown in recent decades. For example, the number of journal articles published on higher education has increased five-fold in the last twenty years (Seeber, 2023). More is known about higher education than ever before, but there does not seem to be a corresponding growth in higher education policymaking being influenced by this expanding evidence base (Schendel and Knobel, 2024). Indeed, higher education seems to be more or less in crisis – and even under attack – in democratic as well as authoritarian systems, and in rich as well as middle- and low-income countries. Here, I offer five interrelated challenges for policy research on higher education. No doubt, there is more to be said about each of these, and there are other challenges that could be added. Perhaps readers might like to make suggestions in the comments.
1. How to expand international connection and collaboration in an increasingly fragmented and divided world?
Schendel and Knobel (2024) argue for greater collaboration among higher education scholars in different countries and regions, and between researchers and policymakers. They also argue for the translation of knowledge from academic discourse to more accessible forms and between languages, especially to and from the lingua franca of English. They call for connections to be made between different evidence bases, contexts and ways of understanding. These collaborations and connections should not just be among scholars from countries in the ‘West’, but arise from the formation of equitable partnerships between researchers based in the Global South and North, and among those based in expanding and emerging systems. These would allow an exchange of non-Western perspectives and indigenous knowledges within the higher education research and policy communities and “a more global, multi-national, transnational or cosmopolitan optic” (Brooks, 2023, Brooks & Waters, 2022). Journal editors, for example, should be more sensitive to the location of researchers and the substantive focus of their research (Brooks, 2023).
2. How to place local and national research in regional and international contexts for a potentially global readership?
There is also evidence that higher education research has become more international in scope in recent years (Brooks, 2023; Daenekindt & Huisman, 2020; Kehm, 2015; Kwiek, 2021; Tight, 2021). However, it is important to distinguish between an increasing number of studies of the internationalisation of higher education – often limited to student mobility between nations – and an international or comparative perspective, which may focus on national, or even local, issues but place these within a broader context. Clearly, the collaboration of researchers from different countries and regions already mentioned can help this comparative and contextualised approach, provided there is a well-developed understanding of the differences between the objects of study as well as the similarities. Loosening the dominance of the English language in international higher education research networks will help to achieve this contextualised comparison.
3. How to encourage contributions from a wider range of disciplines and theoretical approaches?
Higher education is not just a topic of study for higher education researchers. As an ‘open access’ field (Harland, 2012), it is also a focus for disciplines such as sociology, economics, business studies, political science, psychology and even geography. As in other porous areas of the social sciences, this is to be welcomed as a way of incorporating new perspectives, concepts, theories and methodologies into the field. While this may have led to a certain lack of interaction and integration initially (Macfarlane, 2012; Tight, 2014), the trend towards interdisciplinary scholarship can bring these different perspectives together in creative ways. After all, it is likely that more holistic, multi-disciplinary and innovative approaches will be needed to understand and address current and future challenges, such as artificial intelligence, decolonising the curriculum, academic precarity and populist critiques of universities. Topic-based networks of scholars – where the focus of study rather than the discipline is prime – can encourage this. A major task, however, is to provide space for indigenous knowledges and new ways of knowing that may challenge traditional disciplinary hierarchies and ‘Western’ epistemologies.
4. How to focus on deeper, longer-term issues without losing immediate relevance for policymaking?
On the one hand, we might ask how evidence-based higher education research is? Some of what is submitted for publication is description, commentary, impressionistic interpretation and, even, polemic. We might also ask what form might an acceptable evidence base take? Policymakers tend to look for unambiguous findings that provide clear-cut guidance for decision-making – hard data of a quantitative rather than a qualitative kind. Yet, in education, meaningful quantitative studies are harder to accomplish than in some other areas of public policy. Systematic reviews of literature and randomised control trials do not work as well in education as in medicine, for example. Do we actively seek to build the evidence base? Or do we risk creating fragmented knowledge produced by a series of short-term, small-scale, barely connected projects, based on different and incompatible theoretical and conceptual foundations or employing methodologies that cannot be scaled up?
We should also acknowledge that higher education researchers are investigating their own world. They are interested parties in the object of their studies. Their research agendas are likely to be influenced by these ‘interests’. (Many readers will be familiar with doctoral students researching areas relating to their own experiences, for example, as students or higher education employees). Researchers are often on the receiving end of many of the policies and their impacts. As a result, too much research on higher education has been based on the assumption of a golden age which is being dismantled, rather than from a forward-looking perspective that seeks to meet broader, emerging societal needs.
So, we should recognise the limitations of this expanding higher education research. To date, much of it has been small scale, short-term and dependent on consultancy-style funding. It has had a fragmented and weak institutional base. It has tended to focus on the ‘public life’ of higher education, on strategic issues and their impact, rather than the ‘up close and personal’ issues that can be uncomfortable to investigate. Some of it is only just becoming “disinterested research on reasonably long timescales, with open agendas and based on reflective and critical intellectual values and practices” (Scott, 2000: 124).
On the other hand, how realistic (or idealised) are our conceptions of policymaking and implementation? It is rarely feasible simply to extrapolate the policy implications from a given set of findings, which may simply analyse a problem rather than propose a solution. “It is not a linear, rational-analytical process of examining all the evidence, ‘reading off’ the policy implications of this and then formulating well-designed interventions guaranteed to achieve the outcomes desired” (Locke, 2009: 124). If we are to understand policymaking, and the place of research evidence within it, we have to acknowledge “…the messy realities of influence, pressure, dogma, expediency, conflict, compromise, intransigence, resistance, error, opposition and pragmatism in the policy process” (Ball, 1990: 9). There are many other factors than research findings to take into account in the world of policymaking, not least politics and political expediency (for example, unifying the party, ideology, public opinion and budgets). “A better understanding of the policy-making process and the factors that facilitate or inhibit the take-up of research findings is needed, including the role of the commissioners of research and how findings are presented to, and understood by, policymakers” (Locke, 2009: 125).
We should also be thinking about the relations between research, policy and practice. After all, there are gaps between policy and practice: the infamous unintended consequences of policy implementation. However, there is also the danger of slipping into a utilitarian, ‘what works’ frame. The relations between research, policy and practice are empirical matters, themselves open to research and investigation. Studies of policymaking and implementation can enlighten us about the successes and failures of particular policies in specific contexts, and the factors that influence these. Perhaps we should be aiming for policymaking that is influenced and informed, rather than driven, by evidence?
5. How to explore the policy implications of research findings in ways that can be useful to policymakers?
The higher education research and policy communities are not always so separate. Research commissioned by policy bodies makes up quite a large proportion of funded higher education research. Most higher education researchers want their research to have impact, and policymakers (at least below ministerial level) want evidence on which to base their policymaking. There is some movement between these worlds, but there should be more and think tanks play a critical role in mediating between the worlds of research and policy. Finally, networked governance suggests we should be looking at audiences beyond government and parliament, to include wider public engagement with research findings, which is essential to democracies.
But how far should this constructive engagement go? It is naïve to think that educational research can solve problems on its own. The relationship between research and policy has been characterized as indirect and more about ‘sensitising’ policymakers to problems than solving them. Research might be seen more as a means of helping policymakers reconsider issues, think differently, reconceptualise what the problem is, and challenge old assumptions. This suggests a more serendipitous and loose relationship between research and policy. So, perhaps we need to be more modest in our aspirations for evidence-informed policy and practice and adopt a greater degree of realism about what can be achieved.
This is an abridged version of the editorial from the latest issue of Policy Reviews in Higher Education.
William Locke is a founding Joint Editor of the journal and a recovering academic. Recently retired, he is a former Director of the Centre for the Study of Higher Education (CSHE) at the University of Melbourne, Director of the Centre for Higher Education Studies (CHES) at the UCL Institute of Education and Deputy Director of the Centre for Global Higher Education (CGHE). He has also had senior policy roles at the Higher Education Funding Council for England (HEFCE) and Universities UK.
