Tag: lag

  • Data lag and ambition aggregation means APPs are fundamentally flawed

    Data lag and ambition aggregation means APPs are fundamentally flawed

    In her letter to the sector last November, Secretary of State Bridget Phillipson said that she expects universities to play a stronger role in expanding access and improving outcomes for disadvantaged students.

    Her letter noted that the gap in outcomes from higher education between disadvantaged students and others is unacceptably large and is widening, with participation from disadvantaged students in decline for the first time in two decades.

    She’s referring to the Free School Meals (FSM) eligible HE progression rate – 29 percent in 2022–23, down for the first time in the series.

    Of course in 2023–24, or this year, the numbers for FSM and any number of other factors could be much worse – but on the current schedule, we won’t be seeing an update to OfS’ access and participation data dashboard until “summer or autumn 2025”, and even then only for 2023–24.

    If you’re prepared to brave the long loading times – which for me generate a similar level of frustration to that I used to experience watching Eurovision national finals 20 years ago – you can drill down into that dashboard by provider.

    It’s a mixed picture, with a lot of splits to choose from. But what the data doesn’t tell us is how providers are doing when compared to their signed off targets in their (mainly 2020–21 to 2024–25) access and participation plans.

    The last time OfS published any monitoring data was for the 2020–21 academic year – almost three years ago, in September 2022.

    That means that we can’t see how well providers are doing against their targets, and nor do we have any sense of any action that OfS may (or may not) have taken to tackle underperformance.

    So I decided to have a go. I restricted my analysis to the Russell Group, and extracted all of the targets from the 2020–21 to 2024–25 plans that were measurable via the dashboard.

    I then compared the 2022–23 performance with the relevant milestone, and with the original baseline. Where the target was unclear on what type of student was in scope, I assumed FT, first degree students.

    The results are pretty worrying.

    Baseline 2022-23 Milestone 2022-23 Actual Behind milestone? Behind baseline?
    PROG Disabled Percentage difference in progression to employment and further study between disabled and non-disabled. 3.00 2.00 0.10 N N
    PROG Ethnicity Percentage difference in graduate employability between white and black students 7.9 4.70 -2.50 N N
    CONT Disabled Percentage difference in non-continuation rates non-disabled and students with mental health conditions 7.00 5.50 1.80 N N
    CONT Disabled Percentage difference in continuation rates between disabled students and non-disabled students. 6.4 3 1.3 N N
    CONT Low Participation Neighbourhood (LPN) Percentage difference in non-continuation rates between POLAR4 quintile 5 and quintile 1 students. 5 3.5 2.3 N N
    CONT Low Participation Neighbourhood (LPN) Percentage difference in non-continuation rates between POLAR4 quintile 5 and quintile 1 students. 4 2.5 3.40 Y N
    CONT Low Participation Neighbourhood (LPN) Close the gap in non-continuation between POLAR 4 Q1 and Q5 undergraduate students from 3.8% in 2016/2017 to 1.5% in 2024/25 3.8 3 6.4 Y Y
    CONT Low Participation Neighbourhood (LPN) POLAR4 Q1 non-continuation gap v Q5 (relates to KPM3) 4 3.25 6.1 Y Y
    CONT Low Participation Neighbourhood (LPN) Percentage difference in non-continuation rates between POLAR4 quintile 5 and quintile 1 students 2.40 1.00 6.90 Y Y
    CONT Low Participation Neighbourhood (LPN) Percentage difference in continuation rates between the most (POLAR Q5) and least (POLAR Q1) representative groups. 2.4 1.5 3.1 Y Y
    CONT Mature Percentage point difference in non-continuation rates between young (under 21) and mature (21 and over) students. 10 9 6.8 N N
    CONT Mature Percentage difference in continuation rates of mature first degree entrants when compared to young students. 10.2 7 -0.4 N N
    CONT Mature Significantly raise the percentage of our intake from mature students 5.90 7.00 4.10 N Y
    CONT Mature Percentage difference in non-continuation rates mature and non-mature students 9.00 6.00 7.40 Y N
    CONT Mature Percentage difference in non-continuation rates between mature (aged 21+) and young (aged 8.00 5.00 5.10 Y N
    CONT MATURE Close the gap in non-continuation between young and mature full-time, first degree students from 7.8% in 2016/2017 to 4.4% in 2024/2025. 7.8 6.8 10.2 Y Y
    CONT Mature Mature v Young non-continuation gap 9 8.5 10.1 Y Y
    CONT Mature Close the gap in continuation rates between young and mature students (by 1pp each year) by 2024/25. 5 3 6.1 Y Y
    CONT Mature Percentage difference in non-continuation rates between mature and young students 5.30 3.80 5.80 Y Y
    ATTAIN Disabled Percentage difference in degree attainment (1st and 2:1) between disabled students and other students 2.60 1.72 0.9 N N
    ATTAIN Disabled Disabled students attainment gap v non-disabled 3 1.5 1.2 N N
    ATTAIN Disabled To significantly reduce the difference in degree attainment (1st and 2:1) between disabled students and students with no known disability 4.4 2 0.30 N N
    ATTAIN Disabled Percentage point difference in good degree attainment (1st and 2:1) between disabled and not known to be disabled students. 6 5 -2.2 N N
    ATTAIN Disabled To remove the absolute gap in degree outcomes for students with a disability (OfS KPM5). 4.0 2.0 -0.60 N N
    ATTAIN Disabled Percentage difference in degree attainment (1st and 2:1) between disabled and non-disabled students 3.90 2.00 3.60 Y N
    ATTAIN Disabled Percentage difference in degree attainment (1st and 2:1) between students with registered mental health disabilities and non-disabled students 5.80 3.00 4.7 Y N
    ATTAIN Disabled Percentage difference in degree attainment (1st and 2:1) between disabled students and non-disabled students 4.2 2.3 3.6 Y N
    ATTAIN Ethnicity Black students attainment gap v White (relates to KPM4) 20 15.5 11.2 N N
    ATTAIN Ethnicity By 2025, reduce the attainment gap between Asian and white students 8.4 5.2 4.80 N N
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between black and white students (5 year rolling average). 12 8.6 4.60 N N
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between white and asian students. 19 17 14.4 N N
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between white and black students. 14.00 11.00 9.90 N N
    ATTAIN Ethnicity To close the gap between Black and White student continuation rates (reducing the gap by 4 percentage points, from 8% to 4%, by 2024/2025). 8 5.6 5.5 N N
    ATTAIN Ethnicity To close the gap between BME and White student attainment (reducing the gap by 3 percentage points from 11% to 8% by 2024/25). 17 13.1 11.6 N N
    ATTAIN Ethnicity Close the unexplained gap between proportion of BAME and white full-time, first degree students attaining a 2:1 or above from 12.7% in 2017/2018 to 5.5% in 2024/2025. 12.7 10.3 10.8 Y N
    ATTAIN Ethnicity Significantly increase the percentage of our intake from Black students 2.30 3.80 2.90 Y N
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between white and black students 15.70 9.815 11.6 Y N
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between white and Asian students 12.5 8.375 11.4 Y N
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between black and white students. 20 15 19.00 Y N
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between white and BME students. 5.20 2.00 4.60 Y N
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between white and black students. 13.8 6 12.9 Y N
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between BAME and White students. 7.00 4.00 7.50 Y Y
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between white and black students 4.50 3.00 31.00 Y Y
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between white and BAME students 9.50 6.00 11.60 Y Y
    ATTAIN Ethnicity By 2025, reduce the attainment gap between black and white students 8.7 5.9 10.70 Y Y
    ATTAIN Ethnicity To significantly reduce the difference in degree attainment (1st and 2:1) between white and black students 11.6 10 20.00 Y Y
    ATTAIN Ethnicity To significantly reduce the difference in degree attainment (1st and 2:1) between white and Asian students 10.6 10 14.50 Y Y
    ATTAIN Ethnicity Percentage point difference in good degree attainment (1st and 2:1) between white and black students. 18 14 22.1 Y Y
    ATTAIN Ethnicity Percentage difference in degree attainment (1st and 2:1) between white and black students. 17 15 22.9 Y Y
    ATTAIN Ethnicity Halve the gap in attainment that are visible between black and white students (OfS KPM4). 10.0 7.0 15.80 Y Y
    ATTAIN Ethnicity To close the gap between Black and White student attainment (by raising the attainment of Black students) reducing the gap by 8.5 percentage points from 17% to 8.5% by 2024/25 11 9.5 24 Y Y
    ATTAIN Low Participation Neighbourhood (LPN) Percentage difference in degree attainment (1st and 2:1) between POLAR4 quintile 5 and quintile 1 students 9.10 4.645 8.7 Y N
    ATTAIN MATURE Close the unexplained gap between proportion of mature and young full-time, first degree students attaining a 2:1 or above from 12.1% in 2017/2018 to 6.8% in 2024/2025. 12.1 8.8 12.6 Y Y
    ATTAIN Socio-economic Percentage difference in degree attainment (1st and 2:1) between students from most and least deprived areas (based on IMD) 10.20 6.00 12.30 Y Y
    ATTAIN Socio-economic To significantly reduce the difference in degree attainment (1st and 2:1) between the most and least advantaged as measured by IMD. 10.4 8.8 15.60 Y Y
    ATTAIN Socio-economic Reduce the gaps in attainment that are visible between IMD Q1 and Q5 (OfS KPM3). 10.0 7.0 13.70 Y Y
    ACCESS Disabled By 2025, increase the proportion of students with a declared disability enrolling from the baseline of 9% to 13% 9 11 15.70 N N
    ACCESS Ethnicity Significantly increase the percentage of our intake from Asian students 6.90 8.50 9.70 N N
    ACCESS Ethnicity Percentage of BAME entrants 10.10 12.50 12.70 N N
    ACCESS Ethnicity Increase percentage proportion of students identifying as black entering to at least match or exceed sector average (11%). 9.5 10.5 11.7 N N
    ACCESS Ethnicity To increase the proportion of Black, young, full-time undergraduate entrants by 1.2 percentage points, from 2.4% to 3.6% by 2024/25. 2.4 2.8 2.1 Y Y
    ACCESS Low Participation Neighbourhood (LPN) Ratio in entry rates for POLAR4 quintile 5: quintile 1 students 7.4:1 6:1 4.5 N N
    ACCESS Low Participation Neighbourhood (LPN) Reduce the ratio in entry rates for POLAR4 quintile 5: quintile 1 students 3.9:1 3.4:1 3.4:1 N N
    ACCESS Low Participation Neighbourhood (LPN) By 2025, reduce the gap in access between those from the highest and lowest POLAR4 quintiles enrolling from the baseline of 49% to 41% 49 45 41.00 N N
    ACCESS Low Participation Neighbourhood (LPN) Ratio of students from POLAR Q1 compared to POLAR Q5. 01:14 01:11 8.5 N N
    ACCESS Low Participation Neighbourhood (LPN) Close the gap in access between Q1 and Q5 students from a ratio of 5.5 in 2017/2018 to 3.5 by 2024/2025. 5.5 3.64 4.2 Y N
    ACCESS Low Participation Neighbourhood (LPN) Reduce ratio in entry rates for POLAR4 quintile 5: quintile 1 students 12:1 8:1 8.5 Y N
    ACCESS Low Participation Neighbourhood (LPN) To reduce the gap in participation and ratio in entry rates for POLAR 4 Quintile 5: Quintile 1 students Ratio Q5:Q1 of 5.2:1 500 students from POLAR 4 Q1 4.5 or 500 Y N
    ACCESS Low Participation Neighbourhood (LPN) LPN determined by POLAR 4 data. Looking specifically at increasing the intake for LPN Quintile 1 students, and thereby reduce the ratio of Q5 to Q1. (Target articulated as both a percentage and number). 8.0%, 391 10%, 490 8.6, 400 Y N
    ACCESS Low Participation Neighbourhood (LPN) Ratio in entry rates for POLAR4 quintile 5: quintile 1 students. 7.4:1 5.5:1 6.9 Y N
    ACCESS Low Participation Neighbourhood (LPN) Ratio in entry rates for POLAR4 quintile 5: quintile 1 students. All undergraduates. 6.2:1 5.1:1 6.3 Y Y
    ACCESS Low Participation Neighbourhood (LPN) Ratio in entry rates for POLAR4 quintile 5: quintile 1 students. 4.2:1 3.5:1 4.3 Y Y
    ACCESS Low Participation Neighbourhood (LPN) Ratio in entry rates for POLAR4 quintile 5: quintile 1 students. Reduce gap to 3.0 to 1.0 by 2024-25 (OfS KPM2). 5:2 to 1 4 5.2 Y Y
    ACCESS Low Participation Neighbourhood (LPN) To increase the proportion of young, full-time undergraduate entrants from POLAR4 Q1 by 2.5 percentage points, from 7.8% to 10.3%, by 2024/25. 7.8 8.9 10.3 Y Y
    ACCESS Low Participation Neighbourhood (LPN) To increase the proportion of young, full-time undergraduate entrants from POLAR4 Q2 by 2.5 percentage points, from 12.4% to 14.9%, by 2024/25. 12.4 13.9 15.4 Y Y
    ACCESS Mature Percentage of mature entrants 5.80 7.20 3.70 Y Y
    ACCESS Mature Percentage of mature students as part of the overall cohort. 9.2 11.0 6.70 Y Y
    ACCESS Multiple Increase the proportion of BME students from Q1 and Q2 backgrounds 5.2 8 7.6 N Y
    ACCESS Socio-economic Eliminate the IMD Q5:Q1 access gap by 2024/25. 5 2 -4.5 N N
    ACCESS Socio-economic By 2025, reduce the gap in access between those from the highest and lowest IMD quintiles from the baseline of 16.4% to 10.4% 16.4 13.5 7.00 N N
    ACCESS Socio-economic Percentage point difference in access rates between IMD quintile 1 and 2 and quintile 3, 4 and 5 students. 51.8 43.8 53.4 Y Y

    Milestones and baselines

    If we start with access, of the 25 targets that can be analysed, 14 behind milestone – and 10 show a worse performance than the baseline.

    On continuation, 11 of the 17 are behind milestone, and 9 are behind the baseline. And on attainment, 25 of the 38 are behind milestone, and 14 behind baseline.

    Notwithstanding that some of the other targets might have been smashed, and that in all cases the performance may well have improved since then, that looks like pretty poor performance to me.

    It’s the sort of thing that we might have expected to result in fines, or at least specific conditions of registration being imposed.

    But as far as we know, nothing beyond enhanced monitoring has been applied – and even then, we don’t know who has been under enhanced monitoring.

    And the results are a problem. When OfS launched this batch of plans, it noted that young people from the most advantaged areas of England were over six times as likely to attend one of the most selective universities – including Oxford, Cambridge and other members of the Russell Group – as those from the most disadvantaged areas, and that that gap had hardly changed despite a significant expansion in the number of university places available.

    At the rates of progress forecast under those plans, the ratio was supposed to be less than 4:1 by 2025. It was still at 5.44 in the Russell Group in 2022–23.

    It was supposed to mean around 6,500 extra students from the most disadvantaged areas attending those universities each year from 2024-25 onwards. The Russell Group isn’t the whole of “high tariff” – but it had only increased its total of POLAR1 students by 1350 by 2022/23.

    OfS also said that nationally, the gap between the proportion of white and black students who are awarded a 1st or 2:1 degree would drop from 22 to 11.2 percentage points by this year. As we’ve noted before on the site, the apparent narrowing during Covid was more of a statistical trick than anything else. It was up at 22.4 in 2022–23.

    And the gap in dropout rates between students from the most and least represented groups was supposed to fall from 4.6 to 2.9 percentage points – it was up at 5.3pp in 2022–23.

    The aggregation of ambition into press-releasable targets appears to have suffered from a similar fate to the equivalent exercise over financial sustainability.

    What a wonderful thing

    Of course, much has happened since January 2020. To the extent to which there were challenges over the student life cycle, they were likely exacerbated by the pandemic and a subsequent cost of living crisis.

    But when you’re approving four year plans, changes in the external risk environment ought to mean that it revises what it now calls an Equality of Opportunity Risk Register to reflect that – and either allows providers to revise targets down, or requires more action/investment to meet the targets agreed.

    Neither of those things seem to have happened.

    It’s also the case that OfS has radically changed how it regulates in this area. Back then, the director for fair access and participation was Chris Millward. It’s now John Blake. And the guidance, nature of the plans expected and monitoring regimes have all been revamped.

    But when we’re dealing with long-term plans, a changing of the guard does run the risk that the expectations and targets agreed under any old regime get sidelined and forgotten about – letting poor performers off the hook.

    It certainly feels like that’s the case. And while John Blake is widely respected, it’s hard to believe that he’ll still be the director for fair access and participation by the end of the latest round of plans – 2029.

    Hindsight is a wonderful thing, of course, but notwithstanding the external environment changes, few anticipated that any of the gaps, percentages or ratios would worsen for any of the targets set back in 2019.

    That matters because of that OfS aggregation issue. It’s not just that some providers can drag down the performance of the sector as a whole. It’s that no provider was set the target of not getting any worse on the myriad of measures that it didn’t pick for its plan.

    For all we know, while a certain number of providers might have set and agreed a target, say, on POLAR1 access or IMD attainment, performance could have worsened in all of those that didn’t – and that poses a major problem for the regulator and the design of the thing.

    It remains the case that we’re lacking clarity on the way in which the explosion of franchised, urban area business provision has impacted the stats of both the providers that have lit that blue touch paper, and the sector’s scores overall. For me, improvements in access via that method look like cheating – and declines in continuation, completion or progression ought to mean serious questions over funding policy within the Department for Education.

    We don’t really know – but need to know – the impact of other providers’ behaviour on an individual provider’s external environment. If, for example, high tariff universities scoop up more disadvantaged students (without necessarily actually narrowing the gap), that could end up widening the gap elsewhere too. There’s only so many moles to whack when you’re looking at access.

    We still can’t see A&P performance by subject area – which has always been an issue when we think about access to the professions, but is an even bigger issue now that whole subject areas are being culled in the face of financial problems.

    And the size and shape question lingers too. UCAS figures at the close of clearing suggested that high tariff providers were set to balance the books by expanding in ways they claimed were impossible when the “mutant algorithm” hit in 2020.

    Much of continuation, completion and progression appears to be about the overall mix of students at a provider – something that’s made much more challenging in medium and lower tariff providers if high-tariff ones lower theirs.

    In the forthcoming skills white paper, we should expect exhortations from ministers that the sector improves its performance on access and participation. It will have choices on provider type, subject area, the types of disadvantage to focus on, and the mix of measures between things inside its control in the external environment, and things within providers’ control (or at least influence) that OfS should expect.

    Whatever it chooses, on the evidence available, it will have real problems judging either its own performance, its regulator’s, groups of providers or even individuals’. If you think the sector still has some distance to go on fairness, that just won’t do.

    Source link

  • Faculty salaries grow but still lag pre-pandemic era

    Faculty salaries grow but still lag pre-pandemic era

    This audio is auto-generated. Please let us know if you have feedback.

    Full-time faculty salaries rose for the second year in a row, even after adjusting for inflation, according to preliminary compensation data from the American Association of University Professors. 

    Fall 2024 salaries rose an average of 3.8% year over year, though inflation brought that growth down to an increase of 0.9%, according to the study.

    Even with two years of gains, faculty compensation has not fully recovered from the pandemic period, which brought a 7.5% effective drop in salaries from 2019 to 2022, AAUP said.

    Faculty’s inflation-adjusted salaries are still climbing out of their pandemic dip

    Year over year growth in nominal and real salaries from academic years 2017-18 to 2024-25.

    During an era of constrained budgets for many institutions — with job and program cuts making headlines — institutions are under a countervailing pressure to invest in their people and infrastructure after years of belt-tightening. Some colleges have given employees raises even as they make budget cuts in other areas.

    Preliminary data from AAUP’s latest faculty study shows salaries making some headway even in an era of slashed budgets. Fall’s salary increases for full-time faculty followed an inflation-adjusted 0.4% increase in 2023. 

    Those of course are averages, and figures varied across rank and job types. Associate professors’ salaries, for example, typically grew at a faster clip in the 2024-25 academic year than professors or assistant professors while lecturers’ salaries rose faster than all of those positions, with growth over 6% at the doctoral and master’s level institutions, according to AAUP’s study. 

    The survey also found continued gender disparities for professor compensation, with men earning nearly $26,000 more than women at doctoral institutions and about $8,000 more at master’s institutions. 

    College and university presidents typically made around four times or more than the average faculty member across most institution types, according to the study. 

    Part-time faculty made an average of $4,093 per class section in the 2023-24 academic year. But their compensation “varied widely” depending on where they worked, AAUP said.

    At private nonprofits, a part-time faculty member could make an average of $1,950 per section teaching at associate-granting institutions compared to $6,481 at bachelor’s-degree colleges. 

    Maximum payments could run into the tens of thousands of dollars across institution types. Meanwhile, some part-time faculty could earn as little as $700 per section teaching at a public university. 

    Just over one-third of colleges, 34.4%, made retirement plan contributions for at least some part-time faculty, and fewer than one-third, 32.5%, contributed to insurance premiums for at least some part-timers.

    The AAUP analysis is based on surveys of more than 800 U.S. institutions, with data on roughly 370,000 full-time and 90,000 part-time faculty members

    CUPA-HR also found annual salary growth across much of the sector in the 2024-25 academic year. 

    After factoring in inflation of 2.7%, salaries went up 1.2% for administrators, 1% for professional staff, 1.1% for general staff and 0.5% for nontenure-track faculty, according to CUPA-HR. Real salaries for tenure-track faculty fell 0.1%.

    As with AAUP, CUPA-HR noted that higher education salaries still fell short of pre-pandemic levels despite growth. The largest gaps are in salaries for tenure-track faculty — paid 10.2% less than in the pre-pandemic era after adjusting for inflation — and non-tenure-track teaching faculty, who are paid 7.6% less.

    Source link