Monitoring and Data Collection
248. Following recommendations from DOC (1), ATRA
introduced a trial initial training exit survey, with a view to
creating a harmonised tri-Services survey.[367]
The survey is administered by training staff, but run and analysed
by MORI.[368] All trainees
have the opportunity to fill in the survey when they leave training,
even if they are leaving before completing the course.[369]
There have been individual surveys in the past which were described
to us as 'snapshots' that could not be used to make comparisons.[370]
249. The Surrey Police Final Report stated that they
had found little evidence in their investigations of the Army
collecting data in a systematic way to assist in measuring performance
and identifying successes and failures.[371]
Chief Superintendent Denholm told us that:
What we found was missing fundamentally was a
cyclical approach, if you like, to policy development and implementation.
There was evidence of identifying issues and review, but there
was very little evidence of substantive action being taken in
relation to that. Then another report would come along, another
issue would be raised, another review would come in, but again
that final element of this cyclical approach was missing throughout
the vast majority of the areas of work that we identified.[372]
Colonel Eccles agreed that in the past the Army's
"data capture hitherto has been less than perfect".[373]
250. Rear Admiral Goodall explained that instructor's
performance was monitored within the training establishment by
commanding officers and by the training organisations. In addition,
he told us, staff from DCTS:
will have a standards and monitoring role and
go out and have a look at the application of this, not least to
feed back good practice into the training and, secondly, for the
standards we require for accreditation we will need to have review
processes which ensure that the accrediting authorities are satisfied
that the skills and competencies people are developing are appropriate
for that accreditation.[374]
251. We are pleased to note the initiatives flowing
from the new staff of DCTS. We are nonetheless concerned by the
extent of the responsibilities apparently being allocated to a
small number of people. It is difficult to see how a central MoD
staff, already charged with training policy formulation, joint
Services co-ordination and ensuring speedy circulation of best
practice can devote enough time to visit training units with sufficient
frequency and time allocation to perform a credible "standards
and monitoring role". We look forward to seeing how DCTS
staff will interact with existing single Services staffs responsible
for establishing and maintaining instructor standards.
252. We have found patchy data collection to be
a problem throughout this inquiry. MoD should produce a comprehensive
list of issues for which data is lacking and prioritise the need
for data collection in relation to each item.
197