Select Committee on Public Accounts Minutes of Evidence


Supplementary memorandum submitted by the National Audit Office

Q22 (Mr Richard Bacon): Institutions' continuation rates and benchmarks (Figure 29) ranked by continuation rate in 2004-05
Institution Continuation rate 2004-05 (%)Benchmark 2004-05 (%) Change in continuation rate (2001-02 to 2004-05) (% points)
St George's Hospital Medical School98.8 95.01.3
University of Oxford98.6 97.3-0.1
Royal Veterinary College98.5 97.0-0.2
University of Warwick97.8 96.31.0
University of Bristol97.3 96.50.3
University of Durham96.9 96.4-1.1
University of Nottingham96.8 96.1-1.3
University of Sheffield96.7 95.3-0.3
University of York96.7 96.01.0
University of Bath96.6 95.7-1.1
University of Exeter96.6 94.2-0.7
University of Newcastle upon Tyne96.2 95.01.3
University of East Anglia96.0 93.65.0
Conservatoire for Dance and Drama295.8 89.88.7
Loughborough University95.6 93.6-0.4
University of Manchester295.6 94.81.1
School of Pharmacy95.6 94.1-1.9
Harper Adams University College95.4 90.911.7
Imperial College London95.4 96.7-0.9
King's College London95.3 94.70.9
Royal Northern College of Music95.3 88.25.3
Lancaster University95.0 94.4-0.3
University College London95.0 95.1-0.4
University of Liverpool94.9 94.32.4
Wimbledon College of Art94.9 92.13.7
University of Southampton94.7 94.2-0.1
Central School of Speech and Drama94.6 91.4-1.4
London School of Economics and Political Science 94.596.5-0.3
University of Chichester94.4 90.06.5
St Mary's University College (Twickenham) 94.489.83.6
Royal Holloway, University of London94.3 93.9-1.5
University of Reading94.2 94.01.0
Keele University94.1 93.1-2.8
University of Birmingham94.0 94.9-0.1
Royal Academy of Music94.0 93.75.3
University of Leeds93.7 94.7-1.4
University of Leicester93.7 94.21.1
Norwich School of Art & Design93.7 89.21.6
Arts Institute at Bournemouth93.6 89.82.7
Royal College of Music93.6 88.0-3.0
University of Surrey93.6 92.40.6
University College Falmouth93.5 90.81.4
Aston University93.1 93.0-1.6
Courtauld Institute of Art93.0 96.4Not applicable
Nottingham Trent University93.0 91.7-0.1
University of Kent92.9 91.30.5
Trinity Laban92.988.1 4.5
Brunel University92.7 90.9-0.6
University of Gloucestershire92.6 89.34.7
University of Winchester92.6 90.7-0.7
Bishop Grosseteste University College, Lincoln 92.492.5-1.4
University of Brighton92.4 90.61.6
Queen Mary, University of London92.4 93.11.1
Royal Agricultural College92.3 91.4-2.6
Sheffield Hallam University92.3 90.51.1
Oxford Brookes University92.1 91.21.3
Ravensbourne College of Design and Communication 92.189.66.1
University of Hull92.0 92.7-0.1
University of Plymouth91.7 88.3-1.1
University of Portsmouth91.7 89.31.4
University of Sussex91.6 92.90.9
Bath Spa University91.4 90.60.9
Leeds Metropolitan University91.3 89.10.4
Kingston University91.2 89.30.6
University of the Arts London91.1 91.8-1.5
University of Hertfordshire91.1 89.30.8
Bournemouth University91.0 90.3-0.4
Canterbury Christ Church University91.0 90.00.9
University of Lincoln91.0 90.34.4
Newman College of Higher Education90.9 89.3-3.0
University College for the Creative Arts2 90.990.70.5
Cumbria Institute of the Arts90.8 89.90.8
University of Teesside90.8 88.11.1
Dartington College of Arts90.7 90.33.0
York St John University90.7 90.90.9
De Montfort University90.6 90.00.2
Trinity & All Saints90.6 90.4-1.8
Birmingham College of Food, Tourism and Creative Studies 90.588.4Not applicable
University of Central England in Birmingham 90.088.9-1.2
School of Oriental and African Studies 90.092.15.2
University of the West of England, Bristol 90.090.51.1
University of Northumbria at Newcastle 89.990.2-1.7
University of Bradford89.8 89.70.8
Southampton Solent University89.7 88.10.9
Buckinghamshire Chilterns University College 89.688.00.2
Rose Bruford College89.5 90.9-5.8
University of Greenwich89.4 87.63.0
Goldsmiths College, University of London 89.390.3-2.6
Edge Hill University89.2 89.42.8
University of Essex89.1 91.9-0.7
College of St Mark & St John89.1 89.0-2.9
City University, London88.8 89.8-2.5
St Martin's College88.8 90.5-3.4
University of Salford88.8 89.0-0.8
Middlesex University88.7 86.93.9
University of Huddersfield88.5 89.20.5
Staffordshire University88.5 88.8-0.5
University of Westminster88.5 88.81.6
University of Central Lancashire87.9 88.11.4
University of Derby87.8 86.90.1
University of Worcester87.8 88.72.8
Liverpool John Moores University87.7 89.6-0.1
Manchester Metropolitan University87.6 89.6-0.6
Coventry University87.3 89.0-3.0
Anglia Ruskin University87.1 87.9-3.8
London South Bank University87.0 85.50.0
University of Northampton87.0 89.0-1.8
University of Wolverhampton86.4 88.00.5
Writtle College86.488.3 -2.5
University of Bedfordshire86.2 86.8-2.0
Roehampton University86.2 89.41.7
Liverpool Hope University85.7 88.70.7
University of Sunderland85.5 88.70.2
Thames Valley University85.3 84.51.0
University of East London85.2 85.40.0
London Metropolitan University84.5 86.22.1
University of London83.3 93.8-13.4
University of Chester81.7 90.1-8.4
University of Bolton81.6 86.33.4

Note 1:  University of Cambridge is not included because its introduction of a new student record system prevented its submission to HESA of suitable data, and so its indicators for 2004-05 were not published.

Note 2:  In calculating changes in continuation rates for institutions that merged between 2001-02 and 2004-05, we calculated an average of their 2001-02 continuation rates weighted by their student numbers.

Source:  National Audit Office analysis of Funding Council and Higher Education Statistics Agency performance indicator data.

Questions 127-129 (Mr Ian Davidson): Comparison of home nations' performance on retention, adjusted for differences in students and education systems; and any identifiable differences in good practices or discrepancies between England, Scotland, Wales and Northern Ireland

  1.  The NAO Report included a figure (Figure 9) that showed that for full-time students starting in 2004-05, those in English higher education institutions were more likely to continue into a second year and to complete their studies than those studying in Scotland, Wales and Northern Ireland. These figures are calculated by the Higher Education Statistics Agency, based on student-level data supplied by all publicly funded higher education institutions in the United Kingdom.

  2.  The Higher Education Statistics Agency also calculates a continuation benchmark for each institution, which is the average continuation rate of the sector, adjusted for the entry qualifications, age and subjects of study of an institution's students. The NAO has calculated a continuation benchmark for each of the home nations by weighting (by the number of entrants) the benchmark of the nation's institutions to create an average. The results are shown in the fourth column of Figure 1. However, it is important to note that the benchmarks were designed to adjust for differences between institutions rather than nations, and there are other factors not included in the benchmark that cause differences between nations. In particular, prior qualifications are an important factor and Scottish students entering Scottish universities usually have Scottish Highers rather than A levels. In calculating institutions' benchmarks, it is assumed that the two qualifications are equivalent but the assumption is not empirically based and so there may be differences in attainment levels between students that are treated as having reached an equivalent level.

  3.   Figure 1 shows that in 2004-05 English institutions, on average, performed slightly above their benchmark for continuation, while those of the other home nations, on average, achieved continuation rates that were slightly below their benchmark. As noted above in paragraph 2, these results should be treated with caution. It should also be noted that the scale of higher education varies greatly by nation, and that the fact that the large majority of United Kingdom institutions are English means that the results for England are likely to be close to the results for the United Kingdom. In addition, because the benchmark is an average for the UK as a whole, the fact that the English figure is slightly above its benchmark means that at least one of the other nations must have a value below its benchmark to compensate.

Figure 1

THE RETENTION OF FULL-TIME, FIRST-DEGREE STUDENTS STARTING COURSES, 2004-05

Percentage of students continuing to a second ear of study Percentage of students expected to complete their course Continuation benchmark (percentage)
England91.678.1 91.3
Scotland89.373.8 91.5
Wales89.777.1 90.4
Northern Ireland89.7 77.990.9
United Kingdom91.277.6 91.2

Source:   National Audit Office analysis of Higher Education Statistics Agency's performance indicators

  4.  The benchmark does not adjust for many of the differences between home nations in the characteristics of education systems and types of students. For example, arrangements for student funding differ between nations, which may create different incentives and disincentives for certain types of students. While it is not possible to make statistical adjustments for funding arrangements, this note now explores the possible impact of differences in three areas:

    —  background of students;

    —  students' age of entry to higher education; and

    —  length of degree courses.

STUDENTS FROM LOW-PARTICIPATION BACKGROUNDS

  5.  The institutional benchmarks adjust for entry qualification of students, but not their background (although the two are linked). The Higher Education Statistics Agency publishes data on the percentages of young entrants to full-time, first-degree courses who come from low participation neighbourhoods and their continuation rates.

  6.   Figure 2 shows that the percentage of students from low participation areas varies between the home nations, with Scottish institutions achieving the highest values. As with the overall analysis in Figure 1, on average, institutions in England have the highest continuation rates. Continuation rates for other types of widening participation students may vary.

Figure 2

THE RETENTION OF YOUNG ENTRANTS FROM LOW-PARTICIPATION NEIGHBOURHOODS, 2004-05
Percentage of young entrantswho come from low participation neighbourhoods (%) Percentage of these students continuing to a second year of study (%)
England13.190.6
Scotland18.685.9
Wales16.888.2
Northern Ireland9.5 83.9
United Kingdom13.789.7

Source:  National Audit Office analysis of Higher Education Statistics Agency student data

AGE OF ENTRY TO HIGHER EDUCATION

  7.  The Higher Education Statistics Agency's institutional benchmarks take account of age only insofar as categorising students as over or under 21 years. As young students in Scotland tend to start a year earlier than those in England, we examined whether this difference could be linked with higher continuation rates in England compared with Scotland. Based on data for all full-time undergraduate students in English higher education institutions starting in 2004-05, we examined whether younger age on entry may increase or decrease the likelihood of leaving early in England. We found that the 17 year olds who started their course in England in 2004-05 were less likely to continue than were 18 year olds. However, the results should be treated with caution because we were not able to adjust for any other factors, such as the prior attainment of students, and similar analysis in Scotland has yielded different results.

LENGTH OF UNDERGRADUATE DEGREE COURSE

  8.  The Higher Education Statistics Agency's institution continuation benchmarks do not take account of the differing lengths of degree courses. For example, undergraduate honours degree courses in Scotland commonly last four years, compared with three years in England. Based on course length data for all full-time undergraduate students in English higher education institutions starting in 2004-05, we examined whether the length of a degree course affects the likelihood of leaving early. We found that the continuation rate for three-year courses was slightly lower than that of four-year courses. However, the results should be treated with caution because we were not able to adjust for any other factors, such as subject studied, and similar analysis in Scotland might yield different results. Also, the length of degree course may change as student aims change over the duration of their course.

GOOD PRACTICE IN RETAINING STUDENTS

  9.  The National Audit Office identified much good practice that could be applied equally to all countries of the United Kingdom. Figure 3 summarises the good practice actions we found can improve retention. As part of its follow-up work, the NAO is contributing to the sharing of this good practice through conferences and workshops.

Figure 3

ACTIONS TO IMPROVE RETENTION
DescriptionActions
Using management information to understand retention Most institutions collate and disseminate internal information on withdrawal rates at course and faculty level. Others also use student level information, for example on attendance, to identify students at risk of withdrawal. A minority of institutions conduct periodic exercises to contact early leavers to help establish the real reasons why they left, particularly where some common issue affecting retention is indicated.
Building strategic commitment to retention It is important for institutions to have a clear strategic commitment to retaining students that all staff understand and buy into, so that they can see how commitment to high levels of retention should affect the way they work.
All the institutions we visited were undertaking some activities to improve retention, but not all were based on a clear strategy for the whole organisation. Even at institutions where the strategy was clear, senior managers acknowledged that some parts of their institution were demonstrating much greater commitment than others.
Securing commitment from studentsStudents need to commit to attending lectures and carrying out independent study. Universities can communicate this clearly to students, for example through a student charter, and follow up cases where commitment seems not to have been secured.
Providing support through academic staff and practice Properly resourced tutoring systems help individual students to identify the extra support and facilities they can use to improve their chances of success. Institutions often offer pre-entry courses and learning support opportunities, but many find it difficult to get students to take up services that would help them to "stay the course" and succeed. This can be because students and academic staff may regard the services as being there to fill a "deficit" in a student's ability, but institutions can increase take-up by promoting these services as positive options to take to improve the prospects of a good degree.


Broadening options for learningSome institutions, and in particular those with higher numbers of non-traditional students, are being flexible in allowing students to choose learning options to fit their personal circumstances, for example through comprehensive modular systems.
Providing specialist supportAll institutions provide specialist support services, such as welfare. They are increasingly organised as a `one stop shop', and student unions usually have an important role in their provision.
Financial support, through bursaries and hardship funds, is available to assist students from disadvantaged backgrounds or in financial difficulty. Some institutions are more proactive in promoting financial support than others.


Source:   National Audit Office







 
previous page contents

House of Commons home page Parliament home page House of Lords home page search page enquiries index

© Parliamentary copyright 2008
Prepared 19 February 2008