srhe

The Society for Research into Higher Education


Leave a comment

Responsibilities and gatekeeping in using language certificates for HE admission

by Jana Berg, Michael Grüttner, Stefanie Schröder

With the exception of a few master’s degree programs, the German higher education system is dominated by monolingual organizations. Therefore, language certificates are a key element of access to German higher education for international students. Trust in language certificates is critical, both for international student applicants and for university staff as well. However, in admission practice, there might be a tension between professional responsibilities and a lack of trust in the validity of standardised language certificates.

From 2017 to 2021, we conducted the study “Refugees’ pathways to German higher education institutions (WeGe)” on study preparations for refugee students in German higher education at the German Centre for Higher Education Research and Science Studies (DZHW), which was funded by the Federal Ministry of Education and Research under grant number 16PX16015. Our interview partners included staff of HE institutions as well as preparatory colleges that have to decide about admission to study preparation courses for international students. Those courses often include language instruction, but an at least intermediate level of German proficiency is usually mandatory for enrolment.

Our interview partners demonstrated a strong sense of responsibility. On the one hand, to fulfil their perceived role in the context of quality assurance by selecting capable and motivated students. And on the other hand, to prevent students from wasting their time with futile endeavours. This responsibility was embedded in their role, but also reflected in their perception of tasks and priorities. At the same time, we found notable insecurities regarding the quantitative evaluation of language skills. Standardised language certificates, even though formally recognized on an institutional level, were commonly perceived as no representation of actual language proficiency. Interview partners referred to their practical experience that language skills of applicants with the same language certification varied widely.

This insecurity between institutional quality conventions and formal access criteria raises problems for the perceived responsibility to ensure a maximum chance of success for students. We illustrate this with qualitative interview material from one case that emphasised the perceived lack of reliable documentation of skills by standardised language certificates. The interviewee strongly identified with the role of keeping up quality conventions. However, he perceived a strict formal protocol based on paperwork as insufficient, as his professional experience had shown that language certificates do not always match his expectations in an applicant’s language proficiency. He emphasised: “I don’t really care about documents, the skills have to back them up”. His strategy to deal with this lack of trust was his personal, informal language test: “Whenever it is possible, if the people are present, I do an assessment test. It is 100 tasks with 40 minutes, like a snapshot. It is supposed to show what people can access spontaneously”. Theoretically speaking, a tension arises between two quality conventions, a first concerned with an evaluation that takes into account the local circumstances and personal responsibility for the individual purpose of the international student applicants, and a second concerned with an evaluation that treats every international student applicant as equal and self-reliant (Imdorf & Leemann, 2023). As a compromise between these two quality conventions, university staff invent localised, self-designed short language tests to address this tension.

After high dropout numbers and bad experiences with a lack of language proficiency in the past, our case study participant reported that his now more selective and rigorous procedure had improved the course results of participants. However, it was still very much based on his individual perception of potential participants, as one exception he had made emphasises: “A prime example is a woman from Sudan, South Sudan, with two small children. […] she got up at four in the morning to study before the children were awake. […] And I don’t know why, I looked her in the eye, and she wanted to. And went through with it, mercilessly. So really, as a prime example. And is now studying electrical engineering.”

This case emphasises how professional insecurities can cause the development of professional strategies that devalue institutionalised procedures and increase the relevance of subjective impressions. However, it is not an issue only related to this case, even though this interviewee was especially explicit in addressing his insecurities and his coping strategies. Our findings imply that this divergence between perceived professional responsibilities and institutional conventions on the one side, and the quality and reliability of even internationally recognized certificates on the other side, is causing a lack of direction. This void is met with strategies of additional support, individual assessment criteria, and sometimes a stronger emphasis on personal perceptions of applicants. This has implications not only for HE professionals, but also for accessibility and equity in higher education. When practitioners perceive documents as unreliable and adapt their selection measures accordingly, application procedures become unreliable and less than transparent to applicants. However, all HE application procedures should transparently respond to one question: what counts?

On a practical level, we recommend addressing such insecurities with HE practitioners, by offering practical training and creating opportunities for exchange and supervisions. Additionally, a closer look at the perceived insufficiencies of language certificates could and should also be used to further develop standardised language tests, best in a dialogue between test providers, teaching professionals and course participants. Further research in the area of study preparation on conditions conducive to the acquisition of German language skills at the university level could also usefully contribute to improvement.

Dr Jana Berg is a postdoctoral researcher at the German Center for Higher Education Research and Science Studies (DZHW). She holds a Dr. in Sociology from the Leibniz University of Hanover. Her main research is on widening participation, the governance of HE internationalization, and climate science communication.

Dr Michael Grüttner received his Dr in sociology from Leibniz Universität Hannover, Germany. He conducts research at the DZHW with a focus on social inclusion, migration, lifelong learning, and higher education.

Stefanie Schröder, MA, is the coordinator for continuing higher education at the Hochschulallianz Ruhr at Bochum University of Applied Sciences. Previously, she worked as a researcher at the DZHW. Her research focuses on educational inequalities, alternative access to higher education, and anti-discrimination data.


Leave a comment

Guiding principles for supporting BTEC students

by Chris Bayes

At an SRHE ‘Student Access and Experience Network’ online conference on 19 November 2020, I and colleagues who lead the National Education Opportunities Network (NEON) Working Group on ‘Supporting BTEC students’ were privileged to speak about the development of our Group. We also introduced colleagues to the Guiding Principles publication we have recently produced in partnership with Pearson, the UK’s largest awarding body, whose vocational qualifications include Edexcel NVQ and BTEC from entry level to Higher National Diplomas. This blog provides an overview of the development of the Group, our publication and our proposed next steps to support BTEC learners’ progression into higher education.

The beginnings of the Group: NEON, why BTEC learners, and how we developed Guiding Principles

Our Group is one of a number of Working Groups co-ordinated by NEON. NEON is a professional organisation supporting those involved in widening access to higher education. Its Working Groups are led by members and bring colleagues from the widening participation (WP) sector together to take forward a specific agenda or area of practice.

The ‘Supporting BTEC Students’ Working Group was formed in 2018, following a successful initial conference hosted that summer by Brunel University. The conference sought to explore issues around the progression, retention and success of students accessing HE via the BTEC pathway. At our first meeting in September 2018, we invited guest speakers from Association of Colleges, Pearson and UCAS, who gave contrasting views on the post-16 qualifications landscape in England and the role of the BTEC qualification within this. The meeting itself was extremely well attended with around 70 colleagues present. As a NEON Executive member, I was particularly pleased to see the number of teacher colleagues taking part in this meeting – our membership has historically consisted of WP practitioners based in institutions and those working on the UniConnect collaborative outreach programme.  This showed that we were covering an issue which was hugely topical across the sector.

The last decade has seen an increase in the number of learners progressing to higher education having studied a BTEC qualification. One in four students currently gaining access to HE have taken a BTEC National, about 100,000 students. There is a clear correlation between students studying BTEC qualifications and socio-economic status; research undertaken in 2016 by the Social Market Foundation showed 47% of students entering higher education from the most disadvantaged areas (Q1) are BTEC holders.

As a Group, we wanted to work to support the access, progression and success of BTEC students.  Over the course of the past two years, we have refined our focus to developing our Guiding Principles publication, written for colleagues working with BTEC students at each stage of the student lifecycle.

Our Guiding Principles

Following our first meeting, we developed some terms of reference for the Group. Our initial thinking was to develop resources to support teachers and advisors for student progression and to capture the scope of activity taking place to support BTEC learners at each point of the student lifecycle. We are still compiling this information and so if you have an example of practice you would like to share, please let us know!

As the group evolved, we decided to focus on our meetings as opportunities to share practice with invited guest speakers and have used this knowledge to shape our Guiding Principles.  Abstracts of each of these principles are provided below.

  • Championing fair higher education admissions practices for BTEC learners – Dr Alex Blower (University of Portsmouth)

One of the guiding tenets of the NEON Supporting BTEC Students Working Group is to champion fair admissions practices by universities. The group contends that BTEC students, who are often first in their family to attend university, should not have to dig for information about course entry requirements or face additional barriers. It argues that BTEC qualifications should feature as prominently as A levels in prospectuses, and websites, as they are the second most common qualification used for university entrance in the UK. The Group campaigns to make entry requirements/eligibility criteria clear and accessible to BTEC students at all UK HE providers, including Russell Group institutions and those with higher entry tariffs. BTEC learners should be able to establish their eligibility for an undergraduate degree quickly and easily, without the need for them to make further enquiries. If BTEC qualifications aren’t accepted due to course content, the group argues that this should be clearly indicated. The group believes that uniformity and transparency in admissions practices across the sector is a prerequisite to equitable access to Higher Education for BTEC students.

  • Conducting meaningful outreach activity with BTEC learners in schools and colleges – Rebecca Foster (University of East Anglia)

One of the biggest barriers to vocational students entering HE is that pre-entry activity run by Recruitment and Outreach professionals is targeted towards A level students, rather than being focused on their needs. The pre-entry guiding principle champions the need for staff working with students’ pre-entry to be inclusive of vocational learners. This is especially important as learners studying vocational qualifications are often from the most underrepresented backgrounds. Therefore an inclusive approach is paramount, especially from a widening participation perspective. Through raising awareness of the important but sometimes nuanced differences between BTEC and A level learners such as curriculum, learning style, learner identity and learning environment, important changes in promotional language, bespoke events and CPD for college staff can be put in place. The group hopes this will culminate in more vocational learners being aware of HE as an opportunity to them and for practitioners to be equipped to provide appropriate advice and guidance to support their progression.

  • Supporting the transition and student success of BTEC students in higher education – Rebecca Sykes (University of Leeds)

Research shows that BTEC students entering university are more likely to be from a widening participation background, have lower progression and retention rates, be at different starting points in terms of academic preparedness and understanding assessment expectations in HE, and that a sense of belonging is one of the biggest challenges facing this cohort. Our third guiding principle, focusing on transition, attainment and retention, uses the core principles of identify, evaluate, share and embed, to create an environment where BTEC students succeed during their studies and beyond. Valuable, informative and engaging conversations in the group meetings and across conference sessions, has allowed open discussions about the barriers facing this cohort of students, enabling us to recognise how practitioners can be instrumental in their own institutions to help overcome these challenges.

  • Understanding the needs of BTEC students through engagement with research – Chris Bayes (Lancaster University)

There is a lack of effective knowledge exchange between policy makers, practitioners and researchers active in the field of widening participation.  With reference to the progression, retention and success of students accessing university via a BTEC pathway, we have identified gaps in terms of knowledge transfer between practitioners and teachers working with applicants prior to university, and academics working with these students when they are at university. Some traditional universities have been guilty of reinforcing a deficit model perception of BTEC students. For many degree programmes, BTEC students’ prior learning has better prepared them for the progression into HE. By supporting the development of reflective practitioners across the sector, our Working Group is ensuring that staff are able to support today’s increasingly diverse student population, regardless of their prior academic background.

Further information

PDF copies of our Guiding Principles publication can be found via the NEON website – https://www.educationopportunities.co.uk/resources/research/. To find out more about Working Group, please visit https://www.educationopportunities.co.uk/programmes/working-groups/supporting-btec-students/ or join our LinkedIn Group – https://www.linkedin.com/groups/8805592/

The Department of Education is undertaking a consultation exercise to review post-16 qualifications at level 3 in England. The consultation proposes a new system for Level 3 qualifications that creates a dual route based on A Levels and T Levels. This proposed new landscape does not therefore see a separate role for BTEC qualifications, which at present offer learners a route into either higher education or employment. If you care about safeguarding the future of the BTEC, you can access this consultation via the following link: https://consult.education.gov.uk/post-16-qualifications-review-team/review-of-post-16-qualifications-at-level-3/. The deadline for this consultation is 15th January.  We will be working with Pearson to deliver a practice-sharing event showcasing case study examples of how the BTEC qualification supports learners at each stage of the student lifecycle.  Should you wish to be involved in this, please get in touch via c.bayes@lancaster.ac.uk .

SRHE member Chris Bayes has worked in the field of Widening Participation (WP) since 2007, holding practitioner and managerial roles in WP teams at a number of universities and previously leading a number of collaborative partnerships in NW England.  Chris is a research-active practitioner and his research paper ‘Blurred Boundaries – Encouraging greater dialogue between Student Recruitment & Widening Participation’ appeared in the Forum for Access & Continuing Education (FACE)’s 2019 Conference publication. Chris has been an Executive Board member of the National Education Opportunities Network (NEON) since 2015 and has acted as Chair of NEON’s ‘Supporting BTEC students’ Working Group since this was established in 2018.


Leave a comment

Admissions tutors’ perspectives on widening access to selective STEM degrees

by Eliel Cohen, Camille Kandiko Howson and Julianne Viola

This blog follows a project supported by the UKRI Strategic Priorities Fund, involving interviews with admissions tutors and staff in department-based admissions decisions in STEM fields at Imperial College London, and the Universities of Oxford and Cambridge, the three most selective higher education institutions in England. A project report for the full study is available here

Admissions decisions at more selective universities are often made ‘locally’, that is by disciplinary-based academics who will likely be directly involved in teaching students. Given such autonomy, we join Steven Jones, Dave Hall and Joanna Bragg in foregrounding localised admissions practices as key sites of study for understanding widening participation practices and outcomes. In March and April 2020 we conducted eight interviews with individuals holding admissions tutor (or similar) roles in STEM courses at three elite English universities (the Universities of Oxford and Cambridge and Imperial College London).

This post summarises key findings, emphasising that admissions tutors’ perceptions, priorities and practices are often disjointed and disconnected from wider institutional and national policies, grounded in a conservative ethos which slows down the widening of access to selective STEM degrees.

There is fairness and there is ‘fairness’

Fairness was a key theme in our interviews, with all but one participant using the word ‘fair’ or ‘fairness’ explicitly when discussing the key principles of admissions. However, ‘fairness’ tended to have two main meanings which not only differed from but could actively contradict each other. Marginson discusses these contrasting notions of fairness in access to higher education in terms of the competing philosophical traditions to which they relate, drawing on the likes of John Rawls and Amartya Sen. Our findings more closely match the more procedure-focused tradition that Marginson identifies as ‘equity as fairness’, as opposed to the more outcomes focused tradition of ‘equity as inclusion’.

The first and dominant view referred to equal treatment of applicants. This procedural meaning of fairness is not an end in itself but more a means towards ensuring that other admissions priorities were achieved consistently and transparently. First among these was identifying and admitting those applicants with the greatest ‘potential’. We found strong evidence of what has elsewhere been referred to as the potential-based perspective amongst our participants, who consistently used words like ‘high-potential’, ‘high-ability’, or simply ‘the best’ to describe the kinds of students they prioritised and targeted in admissions.

This notion of fairness as a characteristic of procedures which will unproblematically reveal the ‘best’ applicants not only differs from, but can undermine the secondary notion of fairness, one grounded in social justice – in other words, fairness in terms of greater equality of outcomes regardless of one’s background. Some of our participants exhibited at least implicit awareness that there was a potential contradiction between these two notions of fairness, since it is often difficult to see the potential in applicants from less advantaged backgrounds.

On the whole, participants did not see widening participation as a top priority, feeling that there were limits to the extent to which they should be using their role and finite resources to address social inequalities.

Disconnect between admissions policy and practice

The widening participation agenda of the past two decades, and especially the more recent focus on contextualised admissions, implies a shift in admissions practices. Perhaps most obviously it suggests an approach which no longer simply prioritises and privileges those students with easily demonstrable ‘potential’ but rather assesses all applicants’ attainments and abilities in light of the very different contexts in which they have been brought up and educated.

However, what became clear in our interviews was that admissions tutors’ actions and decisions are rarely grounded in the widening participation goals announced by governing bodies and institutional Access and Participation Plans (APP). Rather, in most cases they fell back on what seemed appropriate to their own local context. This resulted in practices which, although sometimes innovative and effective, were disjointed and disconnected from broader widening participation policies and sometimes even counter to them.

For example, some participants said that they might prioritise applicants based on their gender, nationality (but not ethnicity) or age in order to improve the perceived ‘balance’ in their localised cohort, despite no official policies asking them to do so. Other participants felt that any consideration of gender (and protected characteristics more generally) was inappropriate and potentially unlawful.

While we are sympathetic about an interest in a balanced cohort, our findings highlight that admissions decisions are sometimes made on the basis of localised and idiosyncratic perceptions and priorities rather than institutional or national policy. It is not clear, for example, whether a marginal offer would be more likely made to an applicant whose background contributed to perceived ‘cohort balance’ or to an applicant from a widening participation background.

Risk-aversion and the need for data and evaluation

Although all participants expressed support for widening participation in general, they were generally risk-averse in terms of how far they felt widening participation should go. For example, most of our participants were actively or even strongly against lowering grade offers for widening participation students. This view was justified in various ways, for example in terms of concerns about the need to maintain standards of the students and the curriculum, the perceived ‘extra support’ that students admitted on such a basis may require, and the concern that such students would be more likely to perform poorly or drop out. These views were despite an absence of evidence that students admitted on a contextual basis performed worse than other students. This risk-aversion or conservative ethos seems to be a common response to localised admissions decision making.

However, some of our participants acknowledged that one thing preventing them from being able to overcome this risk-aversion was a lack of data monitoring the performance of widening participation students, ideally broken down to the level of students admitted partially on the basis of widening participation and contextual information. Anecdotally, we have reason to believe that this would show that more could be done to widen access, including the increase of lower contextualised offers, without it affecting standards. If nothing else, these data could support evaluation of outcomes of specific admissions practices.

Admissions in England in 2020 were severely disrupted by the Covid-19 pandemic. Whatever new models or workarounds may emerge in the future, evidence suggests that there will continue to be a role for relatively autonomous admissions tutors in selective institutions. Our findings suggest that the sector needs to reflect on how to account for the institutionally situated perceptions and behaviours of admissions tutors if it is going to continue its widening access objectives in the future.

SRHE member Dr Eliel Cohen is a sociologist of education and a research associate at Imperial College London. His forthcoming book with Routledge investigates whether universities in the twenty-first century are thriving or just surviving through an analysis of academic boundaries and boundary-crossing activities.  

SRHE member Dr Camille Kandiko HowsonisAssociate Professor of Education in the Centre for Higher Education Research & Scholarship (CHERS) at Imperial College London. She is an international expert in higher education research with a focus on student engagement; student outcomes and learning gain; quality, performance and accountability; and gender and prestige in academic work.

Dr Julianne Viola is a social scientist specialising in young people’s civic identity development, efficacy, and engagement with their communities. Her book, Young People’s Civic Identity in the Digital Age (Palgrave 2020) focuses on experiences of young people living in the USA at a unique time in the nation’s history, and calls for the reinvigoration of civic education for the digital age. Julianne earned her doctorate at the University of Oxford and is currently a postdoctoral researcher at Imperial College London.

MarciaDevlin


Leave a comment

Making admissions better in Australia

By Marcia Devlin

In Australia, the federal government has been focused on improving the transparency of higher education admissions. I’ve been concerned and written about this matter for some years, particularly the confusion in prospective students and their families around exclusive admissions criteria being used as a proxy for quality.

The government-appointed Higher Education Standards Panel (HESP) were asked to consider and report on how the admissions policies and processes of higher education providers could be made clearer, easier to access and more useful, to inform the choices and decisions of prospective students and their families.

In the context of an increased variety of pathways through which a prospective student can apply or be accepted into higher education in Australia, the HESP found that prospective students, their families and others, including schools, are finding it increasingly difficult to understand the full range of study options and opportunities available, and to understand how they can best take advantage of these options to meet their education and career objectives.

The HESP made 14 recommendations Continue reading

Ian Mc Nay


Leave a comment

Applications to UK universities: digging beyond the headlines…

By Ian McNay

‘Record numbers apply to enter higher education’ was the good news reported at the end of the first application period in January by most papers – I have not seen one to query this, but I have not checked them all. The March figures are now out, almost unreported, and confirm what was true in January: applications are up on last year, by just over 2 per cent. The increase for the UK is lower than that, at about 1.6 per cent.

That is good, but the claim of a record depends what you count and compare with. The secondary headline was that this record showed that high fee levels had had no impact, implying that the record applied where fees had been raised. Not true. Continue reading


Leave a comment

News values

Ian Mc Nay

Ian McNay

My interest [obsession?] with the way the press report HE issues has had several items to feed it recently. I had a spat, unpublished, with John Morgan of Times Higher Education over an article on 27 March on student number allocations by HEFCE headlined ‘No bonanza for those who left places unfilled’. The story opened with the assertion that ‘the big post-92s suffer’, having  proved [sic] ‘less popular’, and the third paragraph lists four of them.

Then comes the table giving percentage reductions, where those with the biggest reductions are not post-92s, but Leeds, Bath and Surrey. The article comes to them in the fourth column, with a claim that their reduction was probably ‘strategic’. As a researcher, I looked for evidence of the different reasons behind reductions. There was none, since ‘figures were issued on a “no approach” embargo’ where no questions could be asked of institution staff. So, opinion, based on speculation, based on stereotypical bias, is presented as news reportage.

The reporting of research demonstrating the [not new] findings that state school entrants outperform those from private schools with the same entry qualifications, mentioned the recommendation to consider adjusting offers, and produced the usual protective outcry on the web page. Nobody reported the evidence from UCAS stats that grades are adjusted by Russell Group universities, where applicants from privileged backgrounds are more likely to get an offer than those with similar qualifications from less advantaged backgrounds.

Finally in this rant is the question: ‘what is newsworthy?’ In recent weeks, the Centre for Leadership and Enterprise at Greenwich has offered commissioned programmes for staff in the Nigerian Ministry of Education, including the permanent secretary, covering issues of policy on teacher development and deployment, vocational provision, standards, and school governance; and for senior staff from Ukraine – both sides of the country and the language divide – on leadership as a new Higher Education Law is developed.

I thought these together were newsworthy: a small centre working with staff from countries with challenging contexts and offering good news to balance the bad. I was wrong apparently. Judged by the University as not worth a press release or even a mention in the University’s daily coverage on its web pages.

There is, apparently, a ‘London effect’: had we been in Lincoln, or Teesside, or even at the university’s Medway campus, it would have been worth trying to get something in to the local press. London journalists are more blasé and world-weary, it appears, so nothing appeared. But at least you now know about it. I am due in Kyiv in October; if I get taken hostage, will that count as news?

SRHE Fellow Ian McNay is emeritus professor at the University of Greenwich.


2 Comments

Ethnicity trumps school background as a predictor of admission to elite UK universities

By Kurien Parel and Vikki Boliver 

Last year an article in the Guardian newspaper described significant disparities in the success rates of white and non-white applicants to the University of Oxford, even among students who received top grades at A-level.  The article, by Kurien Parel and James Ball, reported that, in 2010-11, offer rates were around 1.5 times higher for white applicants than for ethnic minority applicants with the same grades, and up to twice as high in relation to Oxford’s two most oversubscribed subjects, Medicine, and Economics and Management. This pattern was found to hold even for students with 3+ A* grades at A-level.

Of course, A-level performance is not the only criterion for admission to Oxford or other Russell Group universities. Indeed, admissions decisions are often made before A-level results are known, on the basis of predicted A-level grades, prior grades achieved at AS-level and GCSE, references, personal statements, and other criteria. Moreover, certain degree subjects have certain A-level subject prerequisites.

Nevertheless, the figures reported in the Guardian appear to contradict claims made on behalf of Oxford University that ethnic differences in offer rates are due to ethnic disparities in academic attainment at schools as reflected in A-level grades coupled with the fact ethnic minorities apply disproportionately to more competitive subjects such as Medicine.

Some have speculated that ethnic minority applicants to Oxford have lower offer rates because they are more likely to have attended non-selective state schools. Such schools are thought to be less adept at helping applicants prepare for university-administered tests and admissions interviews than state grammar schools and private fee-paying schools.

Expand below to read the full article [office src=”https://onedrive.live.com/embed?cid=7995236C4982A000&resid=7995236C4982A000%21107&authkey=AC-mkjMzal6mUDI&em=2&wdStartOn=1″%5D

MarciaDevlin


Leave a comment

Using students’ admissions rank should be highly qualified

By Marcia Devlin

The Australian Tertiary Admissions Rank or ATAR, a numerical, relative ranking derived from senior high school performance, is a source of angst for many Australian school leavers hoping to become university students. Many assume, understandably but incorrectly, that the higher the ATAR needed to get into a course of study, the ‘better’ the quality of the course. There is no independent evidence to support this assumption.

However, there is evidence that just under half of the university places offered in Australia this year were made to students who do not have an ATAR. Almost fifty percent of new university students in Australia are mature age, international, vocationally qualified or will have come to university through a myriad of alternative entry schemes. None of these students have the magic number that automatically makes the course ‘better’ quality. It makes one begin to wonder about the point of the ATAR. Continue reading