SDN Mesma Group Strategic Associate, David Lockhart Hawkins, recently published a series of LinkedIn posts on the latest Qualification Achievement Rates (QAR), retention rates and pass rates for 2018-19 to 2023-24.
We have collated the key highlights and data points for you in this article.
Before we get started, please note…
- Achievement rates are based on the Hybrid End Year, which often causes confusion. The Hybrid End Year is the later of the Achievement Year, Expected End Year, Actual End Year or Reporting Year of a programme. These rates are based on combined frameworks and standards across all provision of all ages.
- Pass rates are based on the individual aims that were successfully completed in the relevant year (the Hybrid End Year). They are calculated as the number of learning aims achieved divided by the number successfully completed.
- Retention rates are based on the individual aims that were successfully completed in the relevant year (the Hybrid End Year). They are calculated as the number of learning aims completed divided by the number of leavers.
The data should be used internally for comparison and note that QAR and retention are notoriously slow-moving measures due to the hybrid year calculation.
QAR by standard – Some headline notes on 23/24
“The overall achievement rates for apprenticeships for 23/24 are up 10% overall from 54.6% to 60.5%. Some 5000 more apprentices are included in this year’s population from last year’s, with 288,700 in the measurable data.
It takes a long time for QAR to mean something due to the hybrid year calculation method. The learners included in these rates had been on programme for more than 42 days and had the latter of their planned end date, actual end date or achievement date between August 1st 2023 and July 31st 2024 or were simply last reported in that year.
Also, many apprenticeship withdrawals are for reasons outside of a provider’s control, for example, departure from the sector, or to another employer that works with someone else or are just difficult working environments. Certain sectors naturally see more of a transient workforce. So use the data to benchmark your performance against your peers for sure, but ensure you understand its place.
So, use the data to benchmark your performance against your peers for sure, but ensure you understand its place.
- 477 standards in scope for 23/24, compared to 517 in 22/23, showing a decline in the range of standards delivered.
- Standard overall QAR improved from 54.3% to 60.5%, a significant increase.
- Level 2 standards improved from 53.9% to 59.8%
- Level 3 standards improved from 54.7% to 60.1%
- Higher level (4+) standards improved from 54.0% to 61.4%
- Volume of apprentices on programmes that were at or above the 60% threshold, indicating on-track for accountability framework purposes, was 52.05% of the population, up from 26.4% in the standards data set (assumes programmes with fewer than 10 were on track).
- 295 standards, up from 185, were above the 60% accountability threshold for QAR; 182 were below the threshold.
- Team leader remained the largest apprenticeship cohort with 12570 in cohort (2.18% of the overall population), however only three of the top ten largest programmes was above the 60% threshold (Business Administrator – 68.6%), Senior Leader 65% and Installation and Maintenance Electrician 62.5%. 12 of the top 20 in size were above 60%, 8 below it, with Adult Care Worker and Lead Adult Care worker showing annual improvement, but both still being below 50% at 46.1% and 44.8% respectively.”
David has created a summary document showing all of the apprenticeship standard Qualification Achievement Rates (QAR), Retention rates and pass rates for 2018-19 to 2023-24.”
Follow this link to view the full post and attached spreadsheet.
Large cohort rankings
“Out of the 2023-24 Apprenticeship success data, I broke down the ranking of providers with greater than 500 apprentices in their cohort to look at their overall performance in comparison to the smaller provider market. In our annual analysis we use size of cohort, the volume of apprentices in that year’s QAR population for ranking. In those with more than 500 apprentices Just over 60% exceeded the national achievement rate average of 60.5% (up from 54.6% last year which for a second successive year is a significant improvement), though only five of them would rate in the top 100 providers by QAR ranking.
Of providers with large cohort populations, 63.2% would be viewed as on track in the accountability framework measurements, 24.1% as needing improvement and 12.8% in at-risk categories. This is fairly consistent with providers of all size provision where nationally 57% of providers are in the on track category, though 9% of providers nationally have insufficient data showing in the national rates to place them.”
Follow this link to view the full post and the large provider rankings spreadsheet.
Small/Medium cohort rankings
“I broke down the ranking of providers with 40-499 apprentices in their cohort, what I’d call Small-Medium providers to look at their overall performance comparison.
Overall 1,111 providers have measurable data, 133 with over 500 in cohort, 737 with 40-499. This medium sized cohort provision is the majority of the sector and includes some large organisations with smaller provision.
Of the mediums, 449 (60%) were above the national achievement rate average, near identical to last year’s 59.7%, compared to 60% for large provision. 49 of them would rate in the top 100 provider ranking in QAR.
What is also noticeable is the average size of cohort amongst the better performers, commonly being under 100, not uncommon for employer providers or university cohorts. Naturally the overall rates are a mix of provision, levels and sectors so do take that into consideration. A broader range of provision is likely to have pockets of good performance and worse performance. Of providers with medium cohort populations, 61.1% would be viewed as on track in the accountability framework measurements factionally lower than large providers, 25.4% as needs improvement and 13.6% in at risk categories.”
Follow this link to view the full post and the medium provider rankings spreadsheet.
Micro cohort rankings
In our final look at the 2024-25 Apprenticeship performance data please see below our rankings of what we class as micro sized provision providers (under 40 apprentices in cohort). That’s 353 providers down from 313 last year though only 224 have measurable data.
Calculations are based on hybrid year and so there may be many factors positively or negatively affecting these results going back several years. Many sectors have lower rates of achievement than others and any volume in those will naturally distort an overall rate.
74.5% (167 out of 224) are on track in AAF metrics if you exclude those with insufficient data. 15.6% needs improvement (identical to small to medium provision) and 9.8% at risk (a little higher than small to medium provision).
A real mix of type of provider including strong performing employer providers, Colleges, Universities and ITPs.
20 providers have a 100% QAR from their provision. Congratulations to all.
Follow this link to view the full post and the micro-provider rankings spreadsheet.
Overall rankings
Across the three provider types (large 500+ cohort, sm = 40-499, micro = <40) the larger providers have the higher probability of provision being at or above AAF minimum levels though of course individual standard performance will show variations. But interestingly this is a significant improvement from last year, reducing at risk and needs improvement and increasing on track by 16.2 percentage points. Small to medium cohort sized also improved here significantly. The improvement wasn’t as big for the micro provision.
On track
Large 80.1% (last year 63.9% = Significant improvement)
SM 75.7% (last year 62% = significant improvement)
Micro 74.5% (last year 68.8%)
Needs Improvement
Large 16.9% (last year 24.8%)
SM 15.6% (last year 24%)
Micro 15.6% (last year 15.3%)
At risk
Large 2.9% (last year 11.3% = significant improvement)
SM 8.6% (last year 14%)
Micro 9.8% (last year 15.7%)
Follow this link to view the full post and the overall rankings spreadsheet.
For the full posts and to view the associated spreadsheets, visit David’s LinkedIn page.
If you would like more analysis of your position against your peers by standard or by age level David is available to perform this analysis for you. Contact as at info@lockharthawkins.com for more information.
Further support
Webinar – Strategic planning and the Apprenticeship Accountability Framework
This session is also available as a recording. Please contact us if you would like to arrange this for your team.
Providers are measured and monitored by their performance against the indicators of the Apprenticeship Accountability Framework. Understanding the measures and the data used is essential for any leader and manager in the sector. In April 2024 the Department for Education updated the indicators for the framework and these will have significant impact on providers and their planning.
So, how do we work with the data effectively and how do we benchmark performance? What do we do with it and how do we plan and implement appropriate actions to improve?
This 2-hour deep-dive session with David, will help you improve your understanding, get effective ways of planning and effective implementation of strategy in this area to lay a strong foundation for the coming years.
This session covers:
- Understanding the Apprenticeship Training Provider Accountability Framework, the indicators and risks
- How the framework works with quality inspection
- Data, Strategy and setting effective targets
- Interventions and working with action plans
Visit the events page for more information and to book your place.