Research evidence
43. Evidence submitted by supporters of phonics as
a teaching methodology appears to demonstrate that schools which
adopt pure phonics programmes achieve significant improvements
in results. In oral evidence, Sue Lloyd cited the achievements
of a West Country school using her programme:
"94% are achieving level four at the Key Stage
2 SATS [i.e. the expected level for their age], compared with
77% in England, and this is a large primary school with a low
entry assessment. This is a poor social area, a very large school.
Look at the level five: 65% achieved level five in this school
[i.e. above the level expected for their age] and only 26% in
the rest of England. Boys? 33.3% of boys achieved level five
in writing compared with 11% in the rest of the schools and it
goes on like this as well [
] the boys can do just as well
as the girls. No significant difference between children with
summer birthdays and no children with English as an additional
language on the SEN register."[42]
This study also showed that the school achieved just
6% reaching only level three or below, compared to 15% nationally
and 0% reaching level two or below, compared to 7% nationally.[43]
44. In some cases where phonics was used 'first and
fast', almost 100% of pupils achieved Key Stage test results of
the level expected of their age or better and some schools also
showed a reduction in the percentage of children identified as
having special educational needs. This includes a number of schools
serving communities with a high level of deprivation, such as
the Kobi Nazrul School in Tower Hamlets, where Ruth Miskin was
headteacher. This school achieved results in the top 5% in England,
despite taking a significant proportion of children with English
as an additional language.[44]
45. When we asked Dr Kevan Collins, Director of the
Primary National Strategy, whether he could produce similar results
from schools following the NLS programme, he responded:
"In looking at primary schools' results in the
Key Stage 1 tests, it is important to bear in mind that published
figures take account of all pupils in year 2: including those
with special educational needs; those only recently arrived in
the country, and who may have little or no English on arrival;
and those who are unable to take the tests. Nonetheless, in 1,962
primary schools every pupil achieved at least level 2 for their
Key Stage 1 reading in 2004. In another 1,622 primaries, between
95% and 100% of children did so. In these schools, that will typically
mean a single child not reaching the expected level. So, in over
20% of all primary schools in England, all or almost all KS1 pupils
are reading at at least level 2 by age 7. And these are schools
which will be using the support provided by the National Primary
Strategy - properly adapted and supplemented for local needs and
practices - including the Strategy's central, but not exclusive,
role for synthetic phonics."[45]
46. We discussed the best way of comparing the NLS
with other programmes, such as phonics, with Dr Morag Stuart,
Reader in Psychology at the Institute of Education, University
of London. She told us that her research indicated positive benefits
for children who received a dedicated synthetic phonics programme,
but warned that individual studies had significant limitations.
She advised us that a larger comparative study was necessary to
confirm her preliminary findings:
"Structured phonics teaching: proof that it
works. There is the proof from the [United States] national reading
panel's survey of the literature which suggests that structured
phonics teaching works better than no phonics teaching or less
structured phonics teaching.[46]
It is very difficult in the real world to do the kind of research
that you would like to be done. It is terribly difficult to match
children so that they are comparable on all possible things. We
did try to do that in the study that I conducted. We had 50 children
taught for a term using Jolly Phonics which is a very nice programme
for five-year-olds and it is fun. We had 50-odd children who were
not taught [with that programme]. We pre-tested them on a range
of measures of language and phonological skills and letter-sound
knowledge and various things that we did not expect to change
as a result of the teaching and other things that we did expect
to change as a result of the differential teaching. We managed
to match our groups on almost everything and where we were unable
to match groups, we took account of that in the statistical analysis
we did. So it is not impossible to do that sort of research,
but it is difficult. What our research showed was that the Jolly
Phonics teaching was definitely much, much more successful in
making children fluent readers of words than the non-phonics teaching.
However, that is not the sort of comparison that you are asking
for, which is comparing the phonics as taught in the NLS with
different phonics teaching programmes. I do not know of any research
that has done that."[47]
Dr Stuart later added: "We have some inkling
of what works: we do not know the fine details of how best to
do things. We have not had proper comparative studies looking
carefully at the best way to do things and the best way to do
things for different sorts of children, because children differ."[48]
47. We accept Dr Stuart's conclusion that there has
not so far been any decisive research evidence determining the
value of dedicated synthetic phonics programmes directly compared
to the mixture of phonics and other strategies in the NLS. This
is not necessarily an argument for the preservation of the NLS:
many witnesses argued that the 'searchlights' model itself is
not backed up by robust research evidence. Dr Stuart commented,
"The model of reading which is presented to teachers [in
the NLS] which is this black hole of four things [i.e. four 'searchlights']
operating and disappearing into a text is completely and utterly
misleading and bears no relation to any research on reading that
I know of."[49]
48. In response to this critique, Dr Collins told
us of the research background to the NLS:
"There are two kinds that we draw on. We draw
on a body of historical research, and as the literacy strategy
and the numeracy strategy were drawn together they were well founded
on the core research. I would say that in terms of the literacy
strategy, we were very fortunate it was a seminal piece of research
done in the late 90s in the United States through Marilyn Jaeger
Adams which basically did a full review of all literacy research
and informed our work as well as the key research in England drawing
on the work in Australia, New Zealand and this country. As well
as that historical body of research, which we draw on deeply,
we also in an ongoing way continually reflect on learning as it
occurs, and a key area of that has been the developing research
around phonics, which has been a piece of literacy learning, a
core element, which we have continually updated and developed
and, as we move through our support for schools, we keep drawing
on it and evolving and developing our resources, our materials
and support based on the research. So it draws on a historical
base and continues to respond to evolving research that is happening
every day."[50]
We do not consider that this answer provides conclusive
evidence of the National Literacy Strategy's basis in sound research.
49. The Committee was extremely interested to see
the recent publication of a seven year longitudinal study, The
Effects of Synthetic Phonics Teaching on Reading and Spelling
Attainment.[51] This
study, carried out in Clackmannanshire, Scotland by Professor
Rhona Johnston and Dr Joyce Watson, looked at 300 children in
the first year of the Scottish primary school system. It compared
three different teaching methods: synthetic phonics; analytic
phonics; and an analytic phonics method that included systematic
phonemic awareness teaching. At the end of the programme, those
children who had been taught by synthetic phonics were found to
be 7 months ahead of the other two groups in reading. The other
two groups were then given the synthetic phonics programme as
well and the progress of all the children was followed for 7 years.
At the end of this period, all the children were tested and found
to be achieving significantly higher levels in word reading and
spelling that would be expected of their chronological age. Unusually,
boys were found to be outperforming girls.
50. The Clackmannanshire study is of interest as
it appears to show long-lasting benefits from early synthetic
phonics training. However, it does raise a number of additional
issues. The study showed that although reading comprehension was
still significantly above chronological age at the end of the
seventh year at school (3.5 months ahead), the advantage was smaller
than it had been at the end of the second year at school (7 months
ahead).[52] It would
be useful to return to these children again in future to see whether
the gains in word recognition and spelling continue to persist.
The children involved in the study displayed a higher than average
level of socio-economic disadvantage, but the study was not able
to control for this, to determine which programme was most effective
for those with the greatest level of disadvantage. As all children
eventually took the synthetic phonics programme, there was no
direct comparison of a dedicated phonics programmes with a programme
like the NLS 'searchlights' model, which mixes phonics with other
approaches. Nevertheless, the Clackmannanshire study is an important
addition to the research picture, which increasingly points to
synthetic phonics as a vital part of early reading education.
51. We took evidence from one of the authors of the
Clackmannanshire study, Professor Rhona Johnston. We asked Professor
Johnston whether she thought research should be undertaken comparing
a group of children who were being taught by the National Literacy
Strategy programme with a similar group, matched very closely,
who were being taught by synthetic phonics. She replied:
"Yes, I think that absolutely needs to be done
to establish what the facts are. I should stress that my research
has been paid for entirely by the Scottish Government. It actually
voted £18 million in 1997 to look at early intervention and
that money was given to the regions. We were invited by Clackmannanshire
to do the study, but that money was only given out if they did
pre-tests and post-tests of an experimental and a control group
using standardised tests. This is what I think should happen in
England."[53]
52. In view of the evidence from the Clackmannanshire
study, as well as evidence from other schools where synthetic
phonics programmes have been introduced, we recommend that the
Government should undertake an immediate review of the National
Literacy Strategy. This should determine whether the current prescriptions
and recommendations are the best available methodology for the
teaching of reading in primary schools. We therefore strongly
urge the DfES to commission a large-scale comparative study, comparing
the National Literacy Strategy with 'phonics fast and first' approaches.
This study should establish:
- The relative effectiveness
of approaches to teaching reading, such as synthetic phonics,
analytic phonics and the methods recommended in the National Literacy
Strategy;
- The effect of mixing phonics instruction with
other methods of teaching, compared to 'phonics fast, first and
only';
- How long any gains afforded by a particular
programme are sustained;
- The effect of teaching texts which go beyond
a child's existing knowledge of phonics compared to that of limiting
instructional texts to those within a child's current decoding
abilities;
- The effectiveness of different approaches
with particular groups of children, including boys/girls, those
with special educational needs and those with a high level of
socio-economic disadvantage.
The Study should:
- Measure and compare attainment
by means of standardised testing and not Key Stage test results;
- Measure attainment in all the components of
literacy (word recognition, reading comprehension, narrative awareness,
etc.);
- Use control groups to take account of factors
which may have a bearing on reading outcomes, for example: teacher
knowledge and ability; socio-economic background; gender.
13