Challenges in implementing digital change

This is a House of Commons Committee report, with recommendations to government. The Government has two months to respond.

Thirtieth Report of Session 2021–22

Author: Committee of Public Accounts

Related inquiry: Challenges in implementing digital change

Date Published: 10 December 2021

Download and Share

Contents

Introduction

Digital transformation is business change bringing together data, processes, people and technology in new ways to fundamentally change how departments and other organisations serve and provide value to citizens. Responsibility for improving government’s performance rests at the centre with the Central Digital and Data Office (CDDO) and the Government Digital Service (GDS), which are both part of the Cabinet Office. The CDDO, created in 2021, leads the digital, data and technology function of government and is responsible for strategy, standards, and capability development. The GDS has refocused its role on building products and services that help provide a simple, joined-up and personalised experience of government to the public. However, individual departments are responsible for the day-to-day delivery of their own programmes.

Conclusions and recommendations

1. Too many senior government leaders are not equipped with the knowledge and know-how required for making good decisions and to drive digital business change. Most senior leaders are generalists and do not have an operational services or technical background in digital or data. This has contributed to the unrealistic scope of several programmes and the lack of longer-lasting results based on redesigning and transforming public services. Senior leaders need to grasp the potential for technology and data to transform the business of government, and the need to think strategically about opportunities in the future. The centre of government recognises this and told us all 5,500 members of the senior civil service need to have digital and data skills. To this end government has recently started building this capability through, for example, running a data masterclass and updating talent schemes. Although helpful, the centre of government needs to do more to ensure all senior decision-makers have confidence in digital business models, their enabling technologies, and data, and how to apply them to transform government.

Recommendation: The Cabinet Office should develop a robust and certifiable digital business change education process aimed at ministers, Departmental boards and senior civil servants and should make certification a pre-requisite for taking on key roles. The Department should provide an update to the Committee on progress in six months.

2. There is no clear plan to replace or modernise legacy systems and data that are critical to service provision but are often old, unsupportable, vulnerable and a constraint on transformation. Legacy systems, some of which date back to the 1970s, are widespread across government, which relies on them for important services such as managing the UK’s borders and paying the State Pension. Many of these systems are stable and performing acceptably at reasonable cost, but others are high-risk, unreliable, contain security vulnerabilities, or frustrate business transformation. Despite this, departments have a limited understanding of their legacy estate and the centre of government does not have an ongoing process for assessing and understanding what cross-government legacy risk looks like. The Central Digital and Data Office (CDDO) is now testing how it can gather information on departmental legacy systems. The CDDO hopes to prioritise where departments most need to take remedial action using a risk-based model and to roll this out more widely at the start of 2022. This is encouraging and we look forward to seeing the centre and departments take concrete action to begin to address high-risk legacy systems next year.

Recommendation: At the start of 2022 the CDDO should work with departments to map legacy systems across government to document what is there, why it exists and how critical it is. By the end of 2022 the CDDO should use this to produce a pipeline of legacy systems they have prioritised with milestones for action. This pipeline should be shared with the Committee.

3. Departments have failed to understand the difference between improving what currently exists and real digital transformation, meaning that they have missed opportunities to move to modern, efficient ways of working. The Cabinet Office concedes that too often operations and services fail to recognise the fundamental inefficiencies of legacy systems and their data; and instead build new systems on top of these using the old data. Programmes have not sufficiently considered the potential and longer-lasting benefits for the citizen of redesigning and transforming public services around new business processes, data, and emerging technologies. Government has developed several new systems in response to specific needs arising from EU exit, but these were all developed to meet a narrow purpose by fixed deadlines. We recognise the delivery of initiatives such as GOV.UK Notify and Pay, but we note these are relatively straightforward commodity services that are widely available commercially. We are not convinced these demonstrate government’s ability to secure the deeper levels of transformation needed to achieve a more fundamental redesign of business services for the digital age. Cultivating better systems analysis, data analysis and design skills would help government gain a greater understanding of where to focus its efforts.

Recommendation: The Cabinet Office and departments should introduce a structured way of deciding whether the changes they are making represent incremental improvements to existing systems, or a more transformational redesign of business processes. The Cabinet Office and departments should reflect this in the depth and rigour of the initial scoping and design of programmes.

4. Digital programmes often fail to have their own single programme office to support the programme director to align all aspects throughout the lifetime of the programme, including integration of legacy and future systems. Although the Cabinet Office has started to try to strengthen central oversight of digital programmes, government’s digital functions are relatively immature when compared with the long-standing control exercised by HM Treasury over financial management. The breadth and complexity of government presents a significant challenge to putting in place common approaches and ensuring programmes do what they are supposed to do in the right way. Departments find it difficult to manage integration and connections between different systems, especially legacy systems, both within and outside programmes. Departments need a strong, internal programme office for each major programme. These programme offices need a depth of digital expertise beyond what might be provided by a non-specialist programme board, backed up by a strong function at the departmental level and at centre of government (e.g., a centre of excellence) to ensure this happens. A recent report commissioned by the Cabinet Office found there has been too much reliance on contractors or external consultants for core design or architectural decisions, which need a long-term and holistic view across government. The Cabinet Office told us that it has already accepted and is implementing the report’s recommendations. These include a strong, expert central team with real ‘teeth’ to take ownership of digital, data and technology standards including technology choices, privacy, security, and interoperability.

Recommendation: The Cabinet Office should develop guidance on how to approach legacy integration, and mandate rigorous and professional design, data and infrastructure controls and practices, with appropriate accountabilities.

5. Departments have failed to develop a modern professional approach to IT operations needed to support business change and transformation and have created an over-reliance on outsourcing. Departmental IT functions are often not structured or funded in a way that allows them to run and update their core systems and support business transformation. This is not helped by the current problem of alignment between Spending Review allocations and annual funding and the need to deliver outcomes over long periods in major multi-billion-pound programmes, which have led to under-investment in resolving legacy system issues and in maintaining systems’ ongoing fitness for purpose. Government accepts the less successful programmes were typically excessively outsourced by departments who had a thinly resourced internal client function. This led to a dependence on external consultants who may have considerable expertise in some areas but who have little or noknowledge of the existing systems. Government also concedes that in the past it selected technology too early in programmes and incorporated it into supplier contracts, before fully understanding the business problem to be solved. This has inhibited flexibility and the ability to change direction when needed. Government has been slow to pivot or stop programmes when it has become clear they are not working, as typified by GOV.UK Verify.

Recommendation: The Central Digital and Data Office should set out what departments need to put in place to improve the maturity of departments’ approach to IT operations and change including:

  • what the Intelligent Client Function should do;
  • what influence Digital specialist leaders should have;
  • who should be accountable and responsible for contracting; and
  • the assurance mechanisms at the beginning and throughout the lifecycle.

6. There is a large gap between the demand for and supply of the digital specialists that government needs, and it is hard to get the right balance of in-house and outsourced skills. Government has been excessively reliant on outsourcing and has failed to retain sufficient in-house capability. The Central Digital and Data Office now has responsibility for government’s capability building strategy, but recognises government does not yet have the depth of experience needed to deliver across the full breadth of its digital portfolio. The demand for digital skills is increasing, not just in the public sector but also in the private sector and there are shortages in key areas such as architects and people who can lead delivery. We are concerned that despite its intent government is yet to make meaningful progress in overcoming long-standing challenges. It wishes to bring more digital activity in-house but faces a difficult external recruitment market. Specialists in scarce supply earn significantly more money in the private sector than the government is willing to pay, so it can be hard for the civil service to attract and retain them at appropriate levels.

Recommendation: The Central Digital and Data Office should write to us, within 6 months, setting out how it intends to measure progress against its capability strategy, and annually thereafter to report what progress it has made against those metrics.

1 Leadership and capability

1. On the basis of a report by the Comptroller and Auditor General, we took evidence from the Cabinet Office and HM Revenue & Customs (HMRC) on the challenges in implementing digital change in government.1

2. Digital transformation is business change bringing together data, processes, people and technology in new ways to fundamentally change how departments and other organisations serve and provide value to citizens. Citizens and taxpayers expect the government to deliver the kind of high-quality digital services that are a normal feature of modern life. As a result, current and future public services are dominated by digital change. Technology is now almost always a feature of large-scale government business change programmes.2

3. Responsibility for improving government’s performance rests at the centre with the Central Digital and Data Office (CDDO) and the Government Digital Service (GDS), which are both part of the Cabinet Office. The CDDO, created in 2021, leads the digital, data and technology function of government and is responsible for strategy, standards and capability development. The GDS has refocused its role on building products and services that help provide a simple, joined-up and personalised experience of government to the public. However, individual departments are responsible for the day-to-day delivery of their own programmes.3

Leadership capability

4. The National Audit Office reported that only small proportion of permanent secretaries and other senior officials have first-hand experience of digital change and as a result many lack sufficient understanding of the technical and delivery risks for which they are responsible.4 Senior management fail to understand the delivery complexities of the scope they set for large-scale digital programmes before initiating them.5 We questioned the Cabinet Office on how many people in government have the necessary skills to successfully lead large-scale digital programmes.6 The Cabinet Office recognised there is a lack of the more experienced digital, data and technology skills in government, in part because of a wider shortage of delivery leadership skills.7

5. The Cabinet Office agreed it needs to develop these skills and capabilities and told us that eventually all 5,500 of the civil service leadership community will need to be digitally competent.8 The senior leadership of the civil service also recognises it needs to develop these capabilities and skills. The Cabinet Office has offered current permanent secretaries a data masterclass, created a permanent secretary-level digital and data board, and made digital transformation a core theme of the programme to develop the permanent secretaries of tomorrow.9

6. The Cabinet Office accepts it needs to do more to increase capability at the senior, experienced level.10 Piecemeal training on narrow technical aspects, such as coding masterclasses or teach-ins, will not solve the problem. Instead, high-quality, business school-style education can build confidence in digital business models and how to use such models to transform government.11 Many of these initiatives are recent, for instance the Cabinet Office created a permanent secretary-level digital and data sub-board of the civil service board in April this year and it has met on two occasions so far.12 The Cabinet Office estimated there is digital expertise on around half of executive teams, which leaves government more reliant on external suppliers and recruitment from the private sector than it would like.13

Legacy systems

7. Many of the systems government use are not really geared up to modern technology and some date back to the 1970s.14 The Cabinet Office told us that government is a difficult environment for digital projects, partly because these previous systems and old data, known as ‘legacy’, can stand in the way of progress.15 Government relies on legacy systems for many important services.16 For example legacy systems are used by the Home Office to manage the UK border and by police forces to access criminal records and share intelligence.17 This means government is often building on top of existing systems with complex operational dependencies.18 This makes it challenging to move off legacy systems to modern replacements.19

8. The risks associated with legacy systems include that they can be difficult and expensive to support, lack operational resilience for key government services, and be vulnerable to cyber-attack. This exposes government to what is likely to be an uncertain but high level of financial risk from potential operational and cyber-related incidents. Legacy systems need a significant level of resource to make more regular, incremental updates over time.20 Given there are so many legacy systems in government, we asked how long it will be before it becomes necessary to start replacing them.21 The Cabinet Office responded that it wants to focus on those systems that are high-risk, or which present an impediment to business transformation.22 This requires departments to have a plan for how to manage their legacy estate, including sufficient funding for maintenance.23

9. Departments typically do not have a good understanding of their IT estate, legacy systems are often poorly understood because of their age, and replacing these systems carries risk.24 We asked the Cabinet Office if anyone has a clear picture as to what major legacy systems exist across government. The Cabinet Office told us that it has recently started to try and build-up this overall picture and that departments are getting more detailed in their understanding. However, it acknowledged there is not yet a clear on-going process for assessing and understanding cross-government legacy risk. The Cabinet Office is piloting a simple, risk-based model with three departments that it hopes will provide this dynamic view of legacy IT across government and enable conversations about funding with HM Treasury. This process is due be rolled out more widely in 2022.25

Missed opportunities for transformation

10. The Cabinet Office concedes that too often operations and services fail to recognise the fundamental inefficiencies of legacy systems and the data they contain.26 The National Audit Office reported that government has been trying to improve its digital performance for the past 25 years27 but has not been successful in achieving the intended results and departments have continued to build on top of legacy systems and data.28 Programmes have concentrated on automating existing way of working without focusing sufficiently on trying to redesign public services around new business processes and use of data and technology in new ways.29

11. Government has developed several systems to meet new requirements, such as for checking and processing applications under the EU Settlement Scheme. However, the deadline for EU Exit and Government decisions on the timetable for withdrawing the rights previously exercised by EU nationals meant that these systems all had to be in place by a fixed deadline. Government designed and built these systems to meet own their specific, narrow purposes so they could deliver them on time.30 This represents another missed opportunity to think further ahead about how these systems and their associated data flows could be more widely joined-up across government.

12. The Cabinet Office pointed to the role that central platforms such as GOV.UK Pay and Notify have played, for example sending alerts and test results to citizens during the COVID-19 pandemic.31 But the functions they perform are relatively straightforward commodity services that are already easily available and used extensively in the private sector. We are not convinced these examples demonstrate government’s ability to secure the deeper levels of transformation and business change needed to achieve a more fundamental redesign of services for the digital age.32 Cultivating better systems analysis, data analysis and design skills would help government gain a greater understanding of where to focus its efforts.33

2 Co-ordination, skills and outsourcing

Strong and accountable co-ordination across government

13. Government has not properly structured and resourced technology departments against good standards. This makes it difficult to manage the integration and connections between different systems, especially legacy systems, both within and outside programmes.34 This lack of resource and structure means that digital programmes do not have a strong technical design function and programme office for each major programme. Departments need to staff these programme offices with people who have sufficiently deep digital expertise, and the centre should support them with a strong central team. This can help ensure departmental programmes deliver what is in the best interests of government as a whole.35

14. Government’s central digital functions are relatively immature. Government only created the Central Digital and Data Office this year and set up the other central functions within the last decade. The Cabinet Office told us that they have started to strengthen central oversight of digital programmes, but we do not yet see a similar degree of oversight and control as established institutions such as HM Treasury exercise over the way departments manage their finances.36 Government operations are broad and complex, and departments are responsible for their own digital programmes, operating in a federated manner. This presents a significant challenge to putting in place common approaches.37

15. According to a recent report, government has had to rely on external contractors and consultants to make critical decisions on core design and architecture choices, which need a long-term and holistic view across government.38 The report recommends government creates a strong, expert central team with real ‘teeth’ to take ownership of digital, data and technology standards including technology choices, privacy, security, and interoperability. The Cabinet Office told us that it accepts the recommendations of this report and has already implemented four of them with the others being in progress.39

Approach to suppliers and technology

16. Funding for departmental technology functions is often not allocated in a way that enables them to both run and update their core systems and support business transformation. This Committee has seen in other digital programmes that the current spending review processes, which set separate capital and revenue allocations in short, fixed cycles, have contributed to an under-investment in resolving legacy system issues and ensuring systems remain fit for purpose.40

17. Government accepts that it is important to have deep digital, data and technology expertise preserved within departments. Government has excessively outsourced programmes and has very thinly resourced the internal client function capability within departments. That has been a problem and has led to a dependence on external experts, without sufficient internal expertise.41

18. Departments have made technology choices too early in the life of digital programmes before they have fully understood the business problem the programme is seeking to address.42 Departments have then over specified supplier contracts to a degree of detail which does not match the department’s knowledge and this has resulted in a loss of flexibility.43 Consequently, departments have struggled to change the direction of programmes in response to later events.44 Departments have also been slow to stop programmes when it has become clear they are not working. An example is GOV.UK Verify, which after years of development still does not work for around half of the people trying to use it.45 The Cabinet Office acknowledges government can learn from the private sector how to do this better. This will require a change in culture and a willingness not to regard such changes in direction as failures, when they are a response to additional information emerging over time.46

Skills and outsourcing

19. Ten years ago, government had little in-house digital capability and outsourced most technology programmes.47 The Cabinet Office blamed the failure of many programmes in the past on too much outsourcing of poorly understood services, and insufficient resourcing of the intelligent client function within departments.48 For example, NHS England did not believe it had the skills in-house to transform primary care services, but also did not know enough about those services to be able to set the supplier achievable performance standards. The supplier underestimated the scale of the task, and patient safety was potentially put at risk.49 The National Law Enforcement Data Service programme needed to manage multiple supplier contracts but did not take enough ownership of technical development work, and had limited ability to integrate the work and the way the suppliers needed to work together.50 Working with large suppliers is an important way to access the experienced delivery expertise which the Cabinet Office accepts it still does not have enough of.51

20. The Cabinet Office accepted that government still has a capability problem and is not as sophisticated as it needs to be.52 There are not yet enough people with the depth of experience needed to deliver across the breadth of the governments digital portfolio.53 Government is trying to build its internal skills and capabilities at a time when the external recruitment market is challenging.54 The Cabinet Office agreed that the supply of digital skills is not enough to match the demand in the public and private sectors. This leads to shortages of key skills, such as digital architects and software developers.55 Government also faces challenges in building capability beyond those faced by the private sector. Government digital and technology leaders surveyed by the National Audit Office identified the amount departments can pay specialists and civil service recruitment processes as the biggest barriers to recruitment and retention.56

Formal minutes

Monday 6 December 2021

Members present:

Dame Meg Hillier, in the Chair

Sir Geoffrey Clifton-Brown

Mr Mark Francois

Peter Grant

Antony Higginbotham

Craig Mackinlay

Nick Smith

Challenges in implementing digital change

Draft Report (Challenges in implementing digital change), proposed by the Chair, brought up and read.

Ordered, That the draft Report be read a second time, paragraph by paragraph.

Paragraphs 1 to 20 read and agreed to.

Summary agreed to.

Introduction agreed to.

Conclusions and recommendations agreed to.

Resolved, That the Report be the Thirtieth of the Committee to the House.

Ordered, That the Chair make the Report to the House.

Ordered, That embargoed copies of the Report be made available, in accordance with the provisions of Standing Order No. 134.

Adjournment

Adjourned till Wednesday 8 December at 1:30pm


Witnesses

The following witnesses gave evidence. Transcripts can be viewed on the inquiry publications page of the Committee’s website.

Thursday 23 September 2021

Alex Chisholm, Permanent Secretary, Cabinet Office; Joanna Davinson, Executive Director, Central Digital and Data Office; Tom Read, Chief Executive Officer, Government Digital Service; Angela MacDonald, Second Permanent Secretary and Deputy Chief Executive, HMRCQ1–77


Published written evidence

The following written evidence was received and can be viewed on the inquiry publications page of the Committee’s website.

CDC numbers are generated by the evidence processing system and so may not be complete.

1 Professor Mark Thompson (Professor of Digital Economy, University of Exeter Business School); Dr Jerry Fishenden (Government Adviser, Freelance); and Assistant Professor Will Venters (Assistant Prfessor in Information Systems, London School of Economics) (CDC0001)

2 NHS Providers (CDC0003)

3 Pelory Limited (CDC0002)


List of Reports from the Committee during the current Parliament

All publications from the Committee are available on the publications page of the Committee’s website.

Session 2021–22

Number

Title

Reference

1st

Low emission cars

HC 186

2nd

BBC strategic financial management

HC 187

3rd

COVID-19: Support for children’s education

HC 240

4th

COVID-19: Local government finance

HC 239

5th

COVID-19: Government Support for Charities

HC 250

6th

Public Sector Pensions

HC 289

7th

Adult Social Care Markets

HC 252

8th

COVID 19: Culture Recovery Fund

HC 340

9th

Fraud and Error

HC 253

10th

Overview of the English rail system

HC 170

11th

Local auditor reporting on local government in England

HC 171

12th

COVID 19: Cost Tracker Update

HC 173

13th

Initial lessons from the government’s response to the COVID-19 pandemic

HC 175

14th

Windrush Compensation Scheme

HC 174

15th

DWP Employment support

HC 177

16th

Principles of effective regulation

HC 176

17th

High Speed 2: Progress at Summer 2021

HC 329

18th

Government’s delivery through arm’s-length bodies

HC 181

19th

Protecting consumers from unsafe products

HC 180

20th

Optimising the defence estate

HC 179

21st

School Funding

HC 183

22nd

Improving the performance of major defence equipment contracts

HC 185

23rd

Test and Trace update

HC 182

24th

Crossrail: A progress update

HC 184

25th

The Department for Work and Pensions’ Accounts 2020–21 – Fraud and error in the benefits system

HC 633

26th

Lessons from Greensill Capital: accreditation to business support schemes

HC 169

27th

Green Homes Grant Voucher Scheme

HC 635

28th

Efficiency in government

HC 636

29th

The National Law Enforcement Data Programme

HC 638

1st Special Report

Fifth Annual Report of the Chair of the Committee of Public Accounts

HC 222

Session 2019–21

Number

Title

Reference

1st

Support for children with special educational needs and disabilities

HC 85

2nd

Defence Nuclear Infrastructure

HC 86

3rd

High Speed 2: Spring 2020 Update

HC 84

4th

EU Exit: Get ready for Brexit Campaign

HC 131

5th

University technical colleges

HC 87

6th

Excess votes 2018–19

HC 243

7th

Gambling regulation: problem gambling and protecting vulnerable people

HC 134

8th

NHS capital expenditure and financial management

HC 344

9th

Water supply and demand management

HC 378

10th

Defence capability and the Equipment Plan

HC 247

11th

Local authority investment in commercial property

HC 312

12th

Management of tax reliefs

HC 379

13th

Whole of Government Response to COVID-19

HC 404

14th

Readying the NHS and social care for the COVID-19 peak

HC 405

15th

Improving the prison estate

HC 244

16th

Progress in remediating dangerous cladding

HC 406

17th

Immigration enforcement

HC 407

18th

NHS nursing workforce

HC 408

19th

Restoration and renewal of the Palace of Westminster

HC 549

20th

Tackling the tax gap

HC 650

21st

Government support for UK exporters

HC 679

22nd

Digital transformation in the NHS

HC 680

23rd

Delivering carrier strike

HC 684

24th

Selecting towns for the Towns Fund

HC 651

25th

Asylum accommodation and support transformation programme

HC 683

26th

Department of Work and Pensions Accounts 2019–20

HC 681

27th

Covid-19: Supply of ventilators

HC 685

28th

The Nuclear Decommissioning Authority’s management of the Magnox contract

HC 653

29th

Whitehall preparations for EU Exit

HC 682

30th

The production and distribution of cash

HC 654

31st

Starter Homes

HC 88

32nd

Specialist Skills in the civil service

HC 686

33rd

Covid-19: Bounce Back Loan Scheme

HC 687

34th

Covid-19: Support for jobs

HC 920

35th

Improving Broadband

HC 688

36th

HMRC performance 2019–20

HC 690

37th

Whole of Government Accounts 2018–19

HC 655

38th

Managing colleges’ financial sustainability

HC 692

39th

Lessons from major projects and programmes

HC 694

40th

Achieving government’s long-term environmental goals

HC 927

41st

COVID 19: the free school meals voucher scheme

HC 689

42nd

COVID-19: Government procurement and supply of Personal Protective Equipment

HC 928

43rd

COVID-19: Planning for a vaccine Part 1

HC 930

44th

Excess Votes 2019–20

HC 1205

45th

Managing flood risk

HC 931

46th

Achieving Net Zero

HC 935

47th

COVID-19: Test, track and trace (part 1)

HC 932

48th

Digital Services at the Border

HC 936

49th

COVID-19: housing people sleeping rough

HC 934

50th

Defence Equipment Plan 2020–2030

HC 693

51st

Managing the expiry of PFI contracts

HC 1114

52nd

Key challenges facing the Ministry of Justice

HC 1190

53rd

Covid 19: supporting the vulnerable during lockdown

HC 938

54th

Improving single living accommodation for service personnel

HC 940

55th

Environmental tax measures

HC 937

56th

Industrial Strategy Challenge Fund

HC 941


Footnotes

1 C&AG’s Report, The challenges in implementing digital change, Session 2021–22, HC 575, 21 July 2021

2 C&AG’s Report, para 1

3 C&AG’s Report, para 1.7 and figure 4

4 C&AG’s Report, para 1.8

5 Q 15

6 Q 7

7 Q 7

8 Q 5

9 Qq 5, 11, 17

10 Q 7

11 Dr Jerry Fishenden, Professor Mark Thompson and Assistant Professor Will Venters submission page 2

12 Qq 13–14

13 Qq 27, 7

14 Chair opening statement

15 Q 1

16 C&AG’s Report, para 2.15

17 Committee of Public Accounts, Digital Services at the Border, Forty-Eighth Report of Session 2019–21, HC 936, 12 March 2021; Committee of Public Accounts, e-Borders and successor programmes, Twenty-seventh Report of Session 2015–16, HC 643, 4 March 2016; Committee of Public Accounts, The National Law Enforcement Data Programme, Twenty-Ninth Report of Session 2021–22, HC 638, 8 December 2021

18 Q 1

19 C&AG’s Report, para 2.17

20 C&AG’s Report, paras 2.25–2.16

21 Q 39

22 Q 40

23 C&AG’s Report, para 8h

24 C&AG’s Report, para 2.18

25 Q 39

26 C&AG’s Report, paras 2.15–2.21

27 C&AG’s Report, Figure 3

28 Q 18; Cabinet Office, Organising for Digital Delivery, published 22 July 2021, p. 2. Available at https://www.gov.uk/government/publications/organising-for-digital-delivery

29 Qq 22, 67

30 Qq 7, 36–37

31 Q 68

32 Q 4

33 Dr Jerry Fishenden, Professor Mark Thompson and Assistant Professor Will Venters submission page 4

34 Qq 52–53

35 Qq 2, 70–71

36 Qq 2–3, 11–12

37 Q 70

38 Cabinet Office, Organising for Digital Delivery, published 22 July 2021, p. 9. Available at https://www.gov.uk/government/publications/organising-for-digital-delivery

39 Q 59; Cabinet Office, Organising for Digital Delivery, published 22 July 2021, pp. 5–6. Available at https://www.gov.uk/government/publications/organising-for-digital-delivery

40 Qq 39, 41, 43; Cabinet Office, Organising for Digital Delivery, published 22 July 2021, p. 7. Available at https://www.gov.uk/government/publications/organising-for-digital-delivery

41 Qq 12, 73

42 Q 4, 73

43 Qq 4, 46, 63

44 Q 4

45 Q 48

46 Qq 43–44, 62, 65–66, 73

47 Q 7

48 Q 12

49 Committee of Public Accounts, Supporting Primary Care Services: NHS England’s contract with Capita, Fifty-Seventh Report of Session 2017–19, HC 698, 25 July 2018; C&AG’s Report, figure 8

50 C&AG’s Report, The National Law Enforcement Data Programme, Session 2021–22, HC 663, 10 September 2021, Para 2.15

51 C&AG’s Report, The challenges in implementing digital change, Session 2021–22, HC 575, 21 July 2021, para 2.11

52 Qq 21, 73

53 Q 73

54 C&AG’s Report, para 3.4

55 Q 7

56 C&AG’s Report, figure 13