LESSONS FOR LARGER EQUIPMENT PROJECTS
107. The four projects we selected to examine have
generally performed well, particularly against their cost and
performance targets. The MoD told us that smaller-size projects
are not managed differently to larger projects and that the principles
of Smart Acquisition are applied in the same way. However, the
smaller-size projects tend to be shorter in duration "so
they do tend to be fresher and, therefore, more immediately affected
by changes in... [DPA] policies".[135]
108. We were interested in identifying why the smaller-size
projects we selected were experiencing different outcomes compared
to larger projects. For example the smaller-size projects we selected
had experienced cost underruns, yet larger projects often experienced
cost overruns. Dr Watson considered that "the shorter projects
do tend to be slightly more successful, but we do not have that
kind of separation".[136]
Mr Lyle added that "the larger and more complex projects
are larger and more complex".[137]
This is self-evident, but it is unclear why the level of complexity
could not be built into the estimates for cost and time. The MoD
told us:
There are a variety of reasons why smaller projects
could be deemed more successful than some of the larger projects,
particularly from an in year cost variation position. Smaller
projects, that is, the Category C projects between £20m-£100m
may involve less risk, be less technically demanding, be of shorter
duration, have less integration issues, are unlikely to involve
collaboration and have fewer stakeholders....By contrast the level
of technical difficulty is often greater in the larger projects
because there is a much greater element of development to meet
more demanding performance criteria. The Department has recognised
that the degree of complexity in a project is an important factor
in assessing how it should be managed. We are working closely
with the Australian DMO [Defence Materiel Organisation] defining
project complexity and pulling together a skills competence framework
that will improve the Department's ability to manage large, complex
projects.[138]
109. The MoD told us that "Learning From Experience"
is required for all projects, regardless of their size and the
lessons from all size projects are shared. The DPA is also working
with the NAO to implement the NAO's Gold Standard for effective
project control in order to standardise good practice in controlling
all projects. The NAO Gold Standard defines the drivers for successful
project delivery which are applicable to projects of all sizes.
In the Defence Industrial Strategy (DIS), the MoD recognised the
benefit of adopting more flexible and agile approaches to procurement.
The MoD's written evidence states that "a particular facet
of small projects is the ability for the project stakeholders,
including the front-line users to work as a small, effective team
in delivering the project. DIS recognised the importance of better
team behaviours and relationship management as part of the core
business of all our acquisition". The MoD is seeking to ensure
that these and other initiatives shape the project management
and control processes in the new Defence Equipment & Support
organisation, which is to be formed following the merger of the
DPA and the DLO (see paragraphs 21-38).[139]
110. There
are lessons to be learned from the successful management of smaller-size
equipment projects which can usefully be applied to larger equipment
projects, and we look to the MoD to ensure that such lessons are
promulgated. We are pleased to hear that the MoD is working with
the Australian Defence Materiel Organisation and the National
Audit Office to identify better ways of defining project complexity
and better ways of controlling projects. It is vital that what
is learned is fully embedded in the new Defence Equipment &
Support organisation, which will be formed following the merger
of the Defence Procurement Agency and the Defence Logistics Organisation.
101