Tag: Works

In 2021 AdvanceHE published our literature review which set out to demonstrate significant impact in access, retention, attainment and progression from 2016–21.

Our aim was to help institutional decision making and improve student success outcomes. This literature has helped to develop intervention strategies in Access and Participation Plans. But the HE world has changed since review and publication.

Recent sector data for England showed that 43 per cent of higher education providers sampled by the Office for Students (OfS) were forecasting a deficit for 2024–25 and concluded that:

Many institutions have ongoing cost reduction programmes to help underpin their financial sustainability. Some are reducing the number of courses they offer, while others are selling assets that are no longer needed.

All the while, institutions are, quite rightly, under pressure to maintain and enhance student success.

The findings of our 2021 review represent a time, not so long ago, when interventions could be designed and tested without the theorising and evaluation now prescribed by OfS. We presented a suite of options to encourage innovation and experimentation. Decision making now feels somewhat different. Many institutions will be asking “what works now, as we find ourselves in a period of financial challenge and uncertainty?”

Mattering still matters

The overarching theme of “mattering” (France and Finney 2009, among others) was apparent in the interventions we analysed in the 2021 review. At its simplest, this is interventions or approaches which demonstrate to students that their university cares about them; that they matter. This can be manifest in the interactions they have with staff, with systems and processes, with each other; with the approaches to teaching that are adopted; with the messages (implicit and explicit) that the institution communicates.

Arguably, a core aspect of mattering is “free” in terms of hard cash – us showing students that we care about them, their experience, and their progress, for staff to have a friendly approach, a regular check in, and meaningful and genuine dialogue with students. Such interactions may well carry an emotional cost however, and how staff are feeling – whether they feel that they matter to the institution – could impact on morale and potentially make this more difficult. We should also be mindful of the gendered labour that can be evident when teaching academics are encouraged to pick up more “pastoral” care of students; in research-intensive institutions, this may be more apparent when a greater proportion of female staff are employed on teaching focused contracts.

In our original review we found that there were clear relationships between each student outcome area – access, retention, attainment and progression – and some interventions had impact on more than one outcome. Here are five of our examples, within the overarching theme of mattering, which remind the sector of this impact evidence whilst illustrating developments in thinking and implementation.

Five impactful practices

Interventions which provide financial aid or assistance to students pre and post entry were evidenced as impactful in the 2016-2021 literature. We remember the necessity of providing financial aid for students during Covid, with the government even providing additional funding for students in need. In the current financial climate, the provision of extra funding may feel like a dream for many institutions. Cost reduction pressures may mean that reducing sizable student support budgets are an easy short-term win to balance the books.

In fact late last year, Jim Dickinson predicted just this as the first wave APPs referenced a likely decline in financial support. As evaluative data has shown, hardship funding is used by students to fund the cost of living. When money is tight, an alternative approach is to apply targeted aid where there is evidence of known disadvantage. Historically the sector has not been great at targeting, but it has become a necessity. Preventing student withdrawal has never been more important.

We also noted that early interventions delivered pre-entry and during transition and induction were particularly effective. The sector has positioned early and foundational experiences of students as crucial for many years. When discussions about cost effectiveness look to models of student support, targeting investment in the early years of study, rather than universally applied, could have the highest impact. Continuation metrics (year one to year two retention) again drive this thinking, with discrete interventions being the simplest to evaluate but perhaps the most costly to resource. Billy Wong’s new evidence exploring an online transition module and associated continuation impact is a pertinent example of upfront design costs (creation), low delivery costs (online), and good impact (continuation).

Another potentially low cost intervention is the design of early “low stakes” assessment opportunities that give students the chance to have early successes and early helpful feedback which, if well designed, can support students feeling that they matter. These types of assessments can support student resilience and increase the likelihood of them continuing their studies, as well as providing the institution with timely learner analytics regarding who may be in need of extra support (a key flag for potential at-risk students being non-completion of assessments). This itself is a cost saving measure as it enables the prioritisation of intervention and resource where the need is likely to be greatest.

Pedagogically driven interventions were shown in our review to have an impact across student outcome areas. This included the purposeful design of the student’s curriculum to impact on student learning, attainment, and future progression. Many institutions are embarking on large scale curriculum change with an efficiency (and student experience/outcomes) lens. Thinking long term enough to avoid future change, yet attending to short term needs is a constant battle, as is retaining conversations of values and pedagogy.

How we teach is perhaps one of the most powerful and “cost-free” mechanisms available, given many students may prioritise what time they can spend on campus towards attending taught sessions. An extremely common concern expressed by new (and not so new) lecturers and GTAs when encouraged to interact with students in their teaching is “But what if I get asked a question that I don’t know the answer to?” Without development and support, this fear (along with an understandable assumption that their role is to “transmit” knowledge) often results in a retreat to didactic, content heavy approaches, a safe space for the expert in the room.

But participative sessions that embed inclusive teaching, relational and compassionate pedagogies, that create a sense of community in the classroom where contributions are valued and encouraged, where students get to know each other and us – all such approaches can show students that they matter and support their experience and their success.

We also found that interventions which provided personal support and guidance for students impacted positively on student outcomes. One to one support can be impactful but costly. Adaptations in delivery or approach, for example, small group rather than individual sessions and models of peer support are worth exploring in a resource sensitive environment. Embedding personal and academic support within course delivery and operating an effective referral system for students when needed, is another way to get the most out of existing resources.

Finally, the effective use of learner analytics was a common theme in our review of impact. Certainly, the proactive use of data to support the identification of student need/risk makes good moral and financial sense. However, large scale investment might be necessary to realise longer term financial gains. This might be an extension of existing infrastructure or as Peck, McCarthy and Shaw recently suggested, HE institutions might turn to AI to play a major role in recognising students who are vulnerable or in distress.

Confronting the hidden costs

These financial dilemmas may feel uncomfortable; someone ultimately gains less (loses out?) in a targeted approach to enhancing student success. Equality of opportunity and outcome gaps alongside financial transparency should be at the forefront of difficult decisions (use equality legislation on positive action to underpin targeting decisions as needed). Evaluation, and learning from the findings, become even more important in the context of scarce resources. While quick decisions to realise financial savings may seem attractive, a critical eye on the what works evidence base is essential to have long term impact.

Beyond our AHE review, TASO has a useful evidence toolkit which notes cost alongside assumed impact and the strength of the evidence. As an example, the provision of information, advice and guidance and work experience are cited as low cost (one star), with high-ish impact (two stars). This evidence base only references specific evidence types (namely causal/type three evidence). The series of evidence-based frameworks (such as Student Success, Employability, Inclusive Practice) from AdvanceHE are alternative reference points.

The caveat to all of the above is that new approaches carry a staff development cost. In fact, all of the “low cost” interventions and approaches cited need investment in the development and support of academic staff. We are often supported by brilliant teams of learning designers and educational developers, but they cannot do all this heavy lifting on their own given the scale of the task ahead. As significant challenges like AI ask us to fundamentally rethink our purpose as educators in higher education, perhaps staff development is what we should be investing in now more than ever?