Public Accounts Committee - Minutes of EvidenceHC 295

Back to Report

Oral Evidence

Taken before the Committee of Public Accounts

on Monday 17 June 2013

Members present:

Mr Richard Bacon (Chair)

Guto Bebb

Jackie Doyle-Price

Chris Heaton-Harris

Fiona Mactaggart

Nick Smith

Ian Swales

Justin Tomlinson


In the absence of the Chair, Mr Bacon was called to the Chair.


Amyas Morse, Comptroller and Auditor General, David Moon, Director, National Audit Office, Ashley McDougall, Director, Parliamentary Relations, NAO, Marius Gallaher, Alternate Treasury Officer of Accounts, HM Treasury, were in attendance.


Access to clinical trial information and the stockpiling of Tamiflu (HC 125)

Examination of Witnesses

Witnesses: Dr Ben Goldacre, Wellcome Research Fellow in Epidemiology, and Dr Fiona Godlee, Editor in Chief, British Medical Journal, gave evidence.

Q1 Chair: Good afternoon, and welcome to this session of the Public Accounts Committee in which we are taking evidence on the National Audit Office Report on Access to clinical trial information and the stockpiling of Tamiflu. We will be joined later by officials from the Department of Health, the Medicines and Healthcare products Regulatory Agency and the National Institute for Health and Care Excellence, but first we have a pre-hearing with Dr Ben Goldacre, author of Bad Pharma and other books, and Fiona Godlee, the editor-in-chief of the British Medical Journal. You are both very welcome.

Dr Goldacre, may I start with you? To what extent are the concerns about access to clinical trial data for Tamiflu, however important they may be, just an example of concerns about access to clinical trial data more generally?

Dr Goldacre: Tamiflu is just one small microcosm. One of the things that is very striking about Tamiflu is that, at no stage, did Roche break the law, and I think that is because the law is broken. Our best available estimate right now, from an National Institute for Health Research review in 2010 summarising the results of dozens of studies that have been done on missing data, is that half all the trials that have been conducted and completed for the medicines we use today have not gone on to be published and, worse than that, that trials with positive results are about twice as likely to be published as trials with negative results. So this is a deeply ingrained cultural blind spot for medicine, but it is one we have known about since 1986.

Q2 Chair: That was going to be my next question: if this is such a big problem, how long have we known about it? You say 1986.

Dr Goldacre: It was first well documented quantitatively by Simes in 1986. He did a study of all the trials in one field of cancer and found that an enormous proportion of those had not been published and made available to doctors, patients and researchers. In 1986 he called for there to be a comprehensive public trials registry-a list of all the trials that have been conducted and completed-in the hope that that could be used as an audit tool. He also called for all trial results to be published. Twenty-seven years later, we have still not realised those ideals.

Q3 Chair: What I do not understand is this. I am not a scientist, and I was not trained as a scientist, but the scientific method entails gathering all the available data, subjecting it to as much criticism as possible and then, in the words of Karl Popper, proceeding by conjectures and refutations-by testing propositions and hypotheses and finding out whether they stand up to criticism and scrutiny. Why would there be any interest in departing from the scientific method in this way and from having the information widely available for criticism?

Dr Goldacre: I very strongly agree, and I am amazed and surprised that it has never been fixed by my own profession or by industry or policy makers. There are these very odd views around. People will say, for example, "It’s okay because regulators see all this information," but we see from Tamiflu that different regulators and different organisations around the world have come to different overall conclusions about the benefits of Tamiflu in terms of, for example, hospitalisation or the rate of complications with influenza infection. We can see that there are discrepancies in what different organisations see that have had access to more information, although we do not know whether they have had access to complete information, so we know that regulators and so on are not perfect, and we would not expect them to be.

Q4 Chair: That, surely, is the central issue. It is not that regulators are pernicious-plainly they are there to protect the public. The issue is that they are staffed by human beings, so why would one expect them to be more or less likely to see things or miss things than anybody else?

Dr Goldacre: I very strongly agree. It is a central principle of science, as you say. The Royal Society’s motto is "Nullius in verba"-

Q5 Chair: Sorry, we do not do a lot of Latin in this Committee. Can you say that slowly?

Dr Goldacre: On the word of no one-nullius in verba. That is because, in science, we do not trust what you say because you have a white coat or have letters after your name but because you are clear and open about the methods of your experiment and about the results, and because you explain why you think they support your hypothesis.

Q6 Chair: And so that those views can be subject to criticism or even attack.

Dr Goldacre: Yes, to critical appraisal. Thinking perhaps unkindly, one could argue that regulators around the world, and even health technology appraisal bodies, may not have wished for their overall summary decisions to be open to public scrutiny by other doctors and researchers. I hope that is not true, and I strongly suspect, actually, that this is just a very peculiar cultural blind spot. It is obvious that if you delete half the data points from within one study to make the line go where you think it ought to in a 15-year-old’s GCSE science experiment, people would recognise that that was research misconduct. For some reason, we do not recognise intuitively in medicine that when you withhold the results of whole studies from the public record, that produces biased overall apparent benefits of treatments, even though we know that the very next thing that happens after you publish one study is that it is added together with all the others to get the overall summary.

Q7 Chair: I have one more question and then I want to bring in Mr Swales. You mentioned regulators and health appraisers having this blind spot. Earlier you said your own profession-the medical profession and doctors-has a lot to answer for. Could you just expand on that?

Dr Goldacre: We set up a campaign at in January to try to address this problem. It was striking to me that there has never really been a concerted public campaign by senior academic and medical professional bodies. We have now got the support of 50,000 individuals, more than 100 patient groups and most of the medical and academic professional bodies in the UK, but some were slow to sign up, and a couple still have not.

I cannot understand why anybody in any medical and academic professional body would not recognise that doctors, researchers, patients, payers and policy makers need to ensure that we have all the evidence openly available so people can make informed decisions about which treatment is best. We are not asking for private patient information to be put in the public domain, and we are not asking for anything that could be reasonably said to affect anybody’s commercial IP. It is very simply a matter of making sure we have all the evidence to make informed decisions and that all that information is in the public domain, to the extent that professionals can openly scrutinise it and challenge each other’s interpretations, as we would see anywhere in science.

Chair: Mr Swales.

Q8 Ian Swales: Could I build on this a little? We are talking about science and the needs of patients. What we have not talked about yet is commerce. We have not talked about commercial confidentiality and we have not talked about money. Will you say a bit more about what other motivations you think might be in play around this issue? Given the way you describe it, why are we where we are? I suspect there may be some other reasons. Will you say what your view is on those two issues-finance and commercial confidentiality?

Dr Goldacre: First, it is important to recognise that it is not only the industry who have conflicts of interest. We know that trial results are routinely withheld in academia as well when there are no commercial interests-perhaps a surgeon has a particular interest in their particular surgical method being the best-so people can have conflicts of interest that are not financial.

I suppose it is reasonable to say that companies do not want to proactively disseminate unflattering information about their products. That goes without saying. Sometimes companies try to argue that there is commercially confidential information in, for example, clinical study reports. To be absolutely clear, we are not asking for information about how a drug is manufactured. We are asking only for the information that sheds light on how well it works in patients so we can make an informed decision not just about whether it works, but about which is best and about the relative benefits. Patients are disadvantaged if they get the lesser of two available drugs in one class.

I personally do not believe that it is ever acceptable, if we are thinking proportionately, to say a company should be allowed to withhold unflattering information about their drug on the grounds that it is commercially confidential in order to maintain sales. I do not believe that any patients would say that, and I think you would struggle to find medical and academic professionals who would say that. But although you would struggle to find anybody who says that clearly and publicly, you do find people muttering about commercial confidentiality in ways that then become very difficult to pin down.

Q9 Ian Swales: Do you have any evidence that, for either Tamiflu or any other drug, unflattering-as you call it-information has been withheld, either from the public or from regulators, which might have affected the decision about whether to grant a licence for a particular drug?

Dr Goldacre: To be absolutely clear, I am more interested in what doctors, researchers and the public see than in what regulators see, because we know that regulators see more, although they may not necessarily see everything. I feel uncomfortable talking too much about individual products because this is such a huge, systemic problem. The best currently available evidence is the NIHR review of 2010, which summarises the results of dozens of studies on this topic. We know that right across the board, in all fields of medicine, trial results are routinely withheld and trials with positive results are more commonly published. It would be unreasonable to pull out anyone because it is a systemic problem.

Q10 Ian Swales: It is. Equally, it is a human issue, isn’t it? There is a system there, but there are motivations. I am trying to explore why it is like this. Dr Godlee, do you have anything to add on why you think information would be routinely withheld?

Fiona Godlee: I think that we do have increasingly clear evidence that both the medical journal system and the pharmaceutical manufacturing and drug development system are causes of the current situation, historically over a period of time. We have a situation where research has been put to use for marketing purposes, rather than for science, and we have evidence for that, as Ben says, across the board. I could pull out individual cases of drugs or manufacturers where that has happened, and you probably have in front of you evidence of that sort. But if you want us to give details, I can certainly do that.

Medical journals rely on funding from reprint revenue from randomised control trials or clinical trials that have been published, which the pharmaceutical industry buy to use to market their drugs. We know that the pharmaceutical industry-and who can blame them?-are there to create value for their shareholders, and from their trials they publish more positive results than negative results. Again and again, we have evidence of unpublished results that, when combined with the published results, make the drugs suddenly look not only no longer effective but harmful.

Q11 Ian Swales: Can I just finish this point? You are making quite a serious allegation. In the last couple of minutes, you have twice said that you have evidence.

Fiona Godlee: This is published in the public domain. The British Medical Journal and other journals have published very clear summaries of systematic reviews of data on individual drugs or classes of drugs where, when you add together the published and unpublished evidence, you get a very different picture of the quality and effectiveness of those drugs.

Q12 Ian Swales: And you strongly believe that this is for commercial reasons? That was the point of my original question: it is not to do with scientific secrecy.

Fiona Godlee: I can see no scientific reason for hiding data. These are trials that have been done on members of the public. The drugs are being bought with taxpayers’ money. This is information that doctors need in order to provide safe and effective treatment for their patients. Withholding those data is a form of misconduct, and we have to see it in that light.

Q13 Chair: Dr Godlee, on that subject, may I raise the letter that you wrote to the National Institute for Health and Clinical Excellence on reboxetine, Pfizer’s drug? You said: "As a vocal fan of NICE since its inception, I am sorry to see you outshone by another organisation that has shown the necessary muscle when confronted with drug manufacturers who withhold clinical trial data." You went on to talk about IQWIG, which is the German equivalent of NICE. You said that when IQWIG "realised that it was not being given the full story on Pfizer’s drug reboxetine, it told the company that it would only approve the drug for reimbursement if all the data were provided. Pfizer delivered up the data, nearly three quarters of which had never been published. Analysis of the full dataset showed the drug to be ineffective and possibly harmful. Although this was a bad outcome for the company, I think you will agree that it was an important victory for public health." That is an extraordinarily serious charge in relation to the German equivalent of NICE, which makes decisions on whether something is value for money and whether the German taxpayer should be funding it. You are saying that NICE does not have or does not use that muscle. Is it a case of NICE not having that power or not using that power?

Fiona Godlee: It does not have that power and perhaps to some extent-I do not know-it may not use what it does have with enough force. Certainly IQWIG, which is the German equivalent of NICE, has statutory rights to obtain information. In this case, Pfizer, the manufacturer of reboxetine, was declining to provide the full clinical trial data, and IQWIG was aware that there were other trials and asked for them. As is recorded in my letter, about three quarters of the information had never been published. When the data were combined, this drug, which was being used by people with depression, was found to be not only ineffective but harmful. That is an example of another regulatory system.

One has to emphasise the enormous effort that IQWIG had to go through. IQWIG’s staff were put under enormous pressure by the pharmaceutical industry in Germany. Even though that is a triumph for the public interest and patient safety, it was still done at enormous cost.

I want to segue into the huge, ridiculous Alice in Wonderland situation we have at the moment, where academics and regulators are doing a piece of investigative work for information that should be in the public domain.

Q14 Chair: Indeed, but what I fail to understand is that we were told by the NAO that, although NICE does not appear to have access in the way that IQWIG in Germany does, the MHRA does have access and pharmaceutical companies have a legal obligation to give the MHRA all the data.

Fiona Godlee: If I may just turn to Tamiflu, because I have the specific figures on that, as I understand it from the Cochrane Collaboration-I should give them full credit for this, because Tom Jefferson and his team at the Cochrane Collaboration have done an amazing job to uncover this, along with Deborah Cohen at the BMJ. They have discovered that there are about 123 trials of Tamiflu, not all of which are therapeutic trials; Roche is aware of 74 completed trials. Of those, I have been told that the European Medicines Agency received 15 incomplete accounts of trials and NICE received four incomplete accounts of trials. That is the sequence of events. The EMA is able to demand additional information, but NICE is not. NICE is reliant on the EMA. It can go back to the drug company, but it cannot demand it.

Q15 Chair: What I don’t understand is, the EMA and the MHRA, as licensing authorities, are pretty much in the same position, are they not? The EMA is the European one and the MHRA is the UK one, but they are performing the same function of licensing, and they are both, are they not, entitled to all the information?

Fiona Godlee: They are entitled to it. They haven’t asked for it.

Q16 Chair: They don’t ask for it?

Fiona Godlee: They don’t ask.

Q17 Chair: So they, as licence providers, once they have been through their processes, are not making decisions on the basis of an entire data set, but on part of the data set. Why?

Fiona Godlee: I would ask the same question: why? That is the question the Committee has to address. Why do the public, why do those making clinical decisions for patients on their behalf, not have full access to all the information? That is a piece of detective work. It is madness; it has to change.

Q18 Chris Heaton-Harris: Does the FDA have better information?

Fiona Godlee: The FDA probably have the same rights to the information. The FDA is staffed up with more internal investigative, statistical expertise than the EMA, and therefore they attempt to do a lot more of the analysis themselves. There are differences, but in terms of the amount of information they have, I think they have access to the same. They can get all the information if they ask for it, but I think they are overburdened and, as Ben has said, we can’t expect the regulator always to get it right.

Q19 Chair: One of the things the Report says, in paragraph 7, comparing the FDA and the European agencies, is "The main difference is that the FDA asks for patient-level data upon which it may conduct its own analysis. The European agencies would require more analytical capacity to be able to do this." That is to say, not more analytical capacity to ask for the data, but more analytical capacity to do something with it. Are you saying that, because they don’t have the analytical capacity that the FDA has to do something with it, they think, "Well, there’s no point in asking for it," so they don’t get it in the first place?

Fiona Godlee: You will have to ask the EMA about why they don’t ask. I think they don’t ask because they think they have it all. They are relying on the drug companies to provide them with information, and the drug industry provides them with what they do, and they are busy, under-resourced and stretched, so they say, "That’s great; thanks for this," and they tend to take the manufacturers’ word for it. It is only when slightly obsessive and very scientifically determined people, like the Cochrane Collaboration and others, actually go in and look under the bonnet, and begin to see that there are not only 15 trials of Tamiflu but 123 trials of Tamiflu, of which 74 are entirely Roche-funded, Roche-controlled-Roche has the data-that you begin to see the madness of this situation: that we are getting a very partial, incomplete, misleading picture of the effectiveness of many drugs.

Q20 Chair: I should have said at the beginning that Roche had originally made clear their willingness-indeed, keenness-to attend this Committee, but they pulled out on Friday. I don’t know why, so people will have to draw their own conclusions.

Looking at your letter to NICE, you say, "Now that serious doubts have been raised about the evidence behind claims" for Tamiflu’s "effectiveness and safety"-which is a serious claim-"I am asking you to withdraw approval" for Tamiflu "until NICE has received and reviewed the full clinical trial data". What is the current situation? What response have you had from NICE to that request?

Fiona Godlee: We got a very good, prompt and thorough response from Michael Rawlins, in response to that letter, which we also published. He said that he would do a further review within NICE, to see what was needed, and at the moment we have not yet received that; so he has spoken, I think it is fair to say, and also we have had a response from the researchers who did the review for NICE. NICE relies on external academic groups to do the systematic reviews for them, in some cases, and the team that did that have responded. They are convinced that they have seen all that they need to see, and that therefore NICE’s review was adequate. I think I and others are less convinced of that.

Q21 Chair: If I were to summarise the opinion, or opinions, on Tamiflu and its effectiveness, would I be roughly accurate if I were to say there is a very broad consensus that Tamiflu is effective in reducing flu-like symptoms; there is a quite broad consensus-but not as broad-that it has some effectiveness in prevention of illness, or prophylaxis, although that consensus became smaller once the Cochrane group withdrew; and there is still less consensus, or probably, it is fair to say, no consensus, on the extent to which Tamiflu helps with preventing complications such as pneumonia and things that lead to death?

Fiona Godlee: That is a very good summary. I think most people would agree with that. To add a bit of a gloss, as far as I am aware, Tamiflu has only ever been compared with placebo. It has not ever been compared directly with, for example, paracetamol, or indeed a stiff whisky or something similar, so we are left with some doubt about its effectiveness in prevention.

Q22 Chair: You make me wonder how much whisky we could have bought for £560 million.

Fiona Godlee: Well, absolutely. It is a good question. It depends on the quality of the whisky.

Q23 Chair: Yes, indeed.

Can I be clear? I imagine either of you can comment on this. Why did we, the taxpayers, spend £560 million? Actually, I think some of it was spent on Relenza; £424 million was spent on Tamiflu. Why did we spend £424 million on Tamiflu? Was it so that we could reduce flu-like symptoms by a couple of days?

Fiona Godlee: I will give you my brief answer; I am sure Ben has views on this. I think it was politically expedient. There was an outbreak of potentially serious influenza. There was a World Health Organisation recommendation that countries should do this. I should say that there is a whole host of information about what led to that WHO recommendation, with industry-funded advisers helping WHO reach that decision. The UK was confronted with a situation in which it wanted something. There isn’t anything else for pandemic flu. To cut a long answer short, I would say it was bread and circuses to keep the populace happy, and I think it was misleading and wrong, especially as the alternative, paracetamol, is well understood, and Tamiflu has adverse effects, apart from its cost.

Dr Goldacre: It is fair to say that it may have been a combination of wishful thinking and perhaps an ambition to reduce public panic in the event of a dreadful pandemic, but when we fail to recognise that there is uncertainty about the effects of treatments, we also miss opportunities to resolve that uncertainty. In 2008 and 2009, for example, when we were giving out Tamiflu on telephone lines to people who wanted it, I think we had the opportunity to conduct a cluster randomised trial that would have helped to resolve the uncertainty about whether Tamiflu really does reduce the rate of complications and hospitalisation.

Not only have we failed to make an informed decision and to allow independent doctors and researchers to scrutinise the decision that we made-full chemical study reports minus individual patient data have not been made publicly available-but by allowing ourselves to believe that we could be fairly certain, we have lost the opportunity to conduct a simple cluster randomised trial at low cost, which would have helped reduce that uncertainty and answered this question.

Q24 Ian Swales: Can I build on a specific? The Report says on page 16 that the European Medicines Agency issued infringement proceedings against Roche last October following inspection by the Medicines and Healthcare products Regulatory Agency, because the MHRA found that a significant amount of safety data gathered by Roche on 46 medicines authorised in the UK, including Tamiflu, had not been fully reported.

First, is Roche a rogue company, or can we assume that everybody operates like this? Secondly, should the public be worried that a company is withholding safety information to that extent?

Dr Goldacre: The Roche investigation, as I understand it, is looking at the withholding of about 80,000 or 85,000 individual reports. These kinds of infringement happen. I think there is an investigation going on at the moment that was supposed to report by now or by the end of June. To me, this is not an issue of safety; it is an issue of effectiveness and relative effectiveness.

Q25 Ian Swales: So it is not just safety data? You think we are talking about efficacy as well?

Dr Goldacre: My primary concern is that when we withhold the results of clinical trials, we are withholding information about effectiveness. I worry that that is one reason why this issue has not received enough attention. When there is a drug that does more harm than good, or information about harm is withheld, that is easier for TV producers and newspaper journalists to grasp hold of and appreciate, but I think that just as much harm is done when we spend money on drugs when we are not sure what the benefits are, or when we allow a situation to arise in which we are misled about the relative benefits of two treatments.

Q26 Ian Swales: To answer my question, if the MHRA go into another company besides Roche, do you think that they will find the same story about commonly solved medicines? What I am really trying to get at is: are Roche a particular case, or is this how the industry as a whole works?

Dr Goldacre: Roche, more broadly, to give one example, are no longer members of the ABPI and do not follow-

Q27 Chair: Sorry, could you say that name again?

Dr Goldacre: The ABPI-the Association of the British Pharmaceutical Industry. It is the UK pharmaceutical representative body.

Q28 Chair: And did Roche pull out of it, or were they kicked out of it?

Dr Goldacre: They did not do well in one particular case, and then they left, so they are not subject to the ABPI’s self-regulation framework. But that is still only self-regulation and, to be absolutely clear, it is preposterous, in my view, that this issue of access to clinical study reports is left in the hands of self-regulation with no prominent legislation.

Ian Swales: Are you saying that they are even a rogue in the world of self-regulation-they have now left the UK self-regulation framework?

Q29 Chair: For the record, could you say the name of the body again?

Fiona Godlee: The Association of the British Pharmaceutical Industry.

Dr Goldacre: To be clear, they are quite a problematic body in themselves. After I drew attention to these problems in my book, they issued a statement in which they said that all these problems are historic and they have all been long addressed, which is not-

Chair: We are very used to that answer in this Committee on a whole range of things.

Dr Goldacre: I can imagine that.

Q30 Chair: Apart from Roche, are all the other major manufacturers in the pharmaceutical industry members of this association?

Dr Goldacre: I believe so, yes. But, to be absolutely clear, there are no good grounds at the moment to believe that any company or group of individuals is any better than any other for withholding access to clinical trial results, with the possible exception of GlaxoSmithKline. As you may know, they have recently made a clear commitment to share clinical study reports-with personally identifiable information removed-going back to their foundation at the beginning of 2000, 2001. And they have signed up to our campaign, so they are proactive on this. That is still at the status of a promise thus far, and I am always very sceptical and cautious, but they are making all the right sounds.

Q31 Ian Swales: May I finish on this paragraph? The NAO Report says that a timetable has been agreed for releasing this safety data. Then, it says, "There were no immediate safety concerns". Those two ideas seem out of step-if we have not got the safety data, how do we know that there are not any safety concerns? My original question was: should the public be worried by this sort of framework?

Dr Goldacre: The public should be more worried about the fact that there is no competent legislation to ensure that doctors and researchers have access to all the methods and results of all the trials that have been done on all the uses of all of the treatments that we are currently prescribing in medicine. The fact that we do not have simple, clear, obvious pathways for access to this information, so that we could have a serious, professional discussion about which treatments work best, means that we cannot practice evidence-based medicine in the way that we purport to.

Q32 Ian Swales: Just thinking about solutions to this, how would we do this in a way that was not tainted by commercial interests? What would your recommendation be going forward? It is one thing to make all the data available, but what would we do with it and who would do that?

Dr Goldacre: We already have people in place who go through and summarise this information: independent academics; researchers; doctors; and the Cochrane Collaboration. There are 14,000 academics worldwide working on this stuff, making summaries that are gold standard and used almost universally by doctors and payers and researchers in different parts of the world.

The key issue is access to this information, and I think that we have had a spectacular lack of ambition on the part of policy makers, who I think have not been adequately informed about these problems by regulators, but also by regulators and professional bodies. It would be very straightforward to fix.

Q33 Ian Swales: It seems to me that, given the quantity of work and the balance of power, this is one for international collaboration. Thank heavens we are in the EU-sorry, that was an in-joke-but should we be looking to form collaborations in a wider way, so that this work is done once around the world? How would that work?

Dr Goldacre: The issue of who should summarise this stuff is secondary; there are huge numbers of people out there who already summarise the more limited information that is already made available, so that is not a problem. The problem is getting access to the full methods and results of all these trials, and there is a very simple solution.

The European Medicines Agency has a clinical trials database, which, like all clinical trials registries, is an administrative legacy project. People think that it is a list of all the trials that have been done on all the uses of all the medicines that we currently prescribe, but in fact it is a list of all trials conducted in a European country since March 2004; that is a much smaller set of trials and it is hopeless. In America, there is another registry, which, again, is incomplete, but incomplete by design. There has been a huge lack of ambition. The European Medicines Agency could very straightforwardly say-the legislation is up for revision in two years-to everybody who markets a drug anywhere in Europe, "Look, we have the European trials register, and, as you know, it is a bit different from everybody else’s. It contains all the results of all the trials that have been conducted on all the uses of all the medicines that are currently being prescribed. Here are the forms. Please write down all the information and we will put it online and make it publicly available."

Q34 Ian Swales: Even if the trial took place outside Europe?

Dr Goldacre: Increasingly, trials are conducted in Brazil, Russia, India and China, such as trials conducted on antidepressants for anxiety and PTSD. We need all that evidence to make informed decisions. It is absolutely mind-boggling that nobody has ever sat down and said, "Why don’t we ask?" People are preoccupied with how the world would cave in and people would refuse to hand such information over, but we have not tried asking. The discussion around access to such information often becomes heated because, inevitably, it only happens when people think that something funny is going on, like what happened with reboxetine or Tamiflu, but actually this is a banal, routine issue that covers the whole of medical practice, and we should take the heat out of it by having universal legislation.

Q35 Chair: Specifically in relation to the influenza pandemic, what would you have done differently to prepare for the risk of an influenza pandemic?

Dr Goldacre: First, I would have ensured that all the methods and the results of all the trials that had ever been done on all of these treatments were made publicly available, so that all the most intelligent and well trained pharmacoepidemiologists in the world would have been able to scrutinise it, because regulators and health technology appraisal bodies miss signals. That is not because they are stupid-they are very clever, highly motivated and well trained-but these are difficult problems. If we look at some of the biggest problems spotted in medicine, such as those with Vioxx, rosiglitazone-Avandia-and the evidence base for Tamiflu, they were spotted not by regulators but by independent doctors and researchers, who often had to work very hard, sometimes even using leaked information, to work out where the problematic signals were. Regulators miss things. I would put everything in the public domain, so that we could have as many good people as possible working on these issues.

Secondly, I would use the fact that we, as a Government, are paying for this stuff to roll it out in the context of a pragmatic, clustered, randomised control trial, so that where there is uncertainty, we would generate new knowledge. That is actually something that we as the NHS are very bad at doing. We have huge opportunities in the UK, because it is common for health care to be provided free at the point of access by the state, but it is fairly unusual for it to be provided through one administrative body with universal coverage and electronic health care records that cover everybody. We could routinely be saying, wherever there is uncertainty about new medicines, "We are only approving this for use if it is in the context of a randomised control trial," and we will then resolve the existing uncertainties about how good or bad it is. I am amazed that we have never been sufficiently ambitious about doing that. We invented the basic notions of evidence-based medicine in the ‘50s, ‘70s and maybe ‘80s and then we sat back and awarded ourselves a point as if we had rolled it out properly, but we have not: we leave uncertainties unresolved and vitally important information to be analysed behind closed doors only. We have to fix that.

Q36 Chair: Dr Godlee, do you have anything to add?

Fiona Godlee: I would agree that, faced with a pandemic, which is a scary thing-the public are worried and the Government want to look like they are doing what they should be doing-secrecy does not serve us well. The claim that this information is "commercial in confidence" is something that we should absolutely challenge. Obviously, the molecule or drug is patented, which is fine-that is shareholder value-but the information about whether the drug works is something that should be in the public domain if the public are paying for it. We need legislation to ensure that that happens. Obviously, if it were happening voluntarily, we could do without legislation, but that is not what the situation is.

Can I add to the reply to Ian Swales’s question about what the solution might be? Unless we can find a solution to the "commercial in confidence" problem, we have to recognise that the pharmaceutical industry has an irreducible conflict of interest in relation to the way it represents its drugs in science and in marketing. Unless we can resolve this in a way that is more in the public interest and in patients’ interests, I would argue that drug companies should not be allowed to evaluate their own products.

Q37 Chair: They should be evaluated independently?

Fiona Godlee: Yes.

Q38 Chair: We are a value-for-money Committee: we don’t look at policy; we want to know if things are effective, efficient and economic. With something like this, knowing whether it works or not-

Fiona Godlee: Is essential.

Q39 Chair: Is essential. Obviously, we as a Committee are not equipped to look at the scientific case, but we want to make sure that the architecture that makes that happen-that ensures that things happen effectively, efficiently and economically-does so. Did the Comptroller and Auditor General want to come in?

Amyas Morse: I have a question, but before I ask it, I should say that I think I need to declare a slight interest; I had a very brief moment as a member of what I think I am right in remembering was called the Flu Pandemic Board-they wanted to have some non-execs on it-and I think I attended one meeting of it. I need to say that, leading into another point.

Q40 Chair: This was in a previous incarnation?

Amyas Morse: Yes. Actually, interestingly enough, it was, but it was cut short by my changing into this incarnation.

Now, I would like to ask something. Not setting aside anything that you have been saying about publication of research or anything of that sort, as a practical matter, if you find yourself in the situation where you have got World Health Organisation guidance, are we saying that we think it was a faulty decision to have supplies of Tamiflu available or not?

Fiona Godlee: For the UK?

Amyas Morse: Yes, for the UK. That is what we are addressing.

Fiona Godlee: I can see the difficulties of the politicians and the medical officers involved in that decision. I absolutely understand that they had a problem. They wanted to be able to provide something. In the end, we do not know whether what they provided was value for money, and that is the problem your Committee faces: we just do not have the answer. That is a situation that I guess nobody wants to be in in the future. We want to be able to say either we are going to spend £500 million on stockpiling a potentially useful drug based on this information, or we are going to spend the £500 million on something else. You do not have the information in front of you to decide whether that was the right decision or not; nor do I. What I do know is that paracetamol is cheap and easy and has known side effects, whereas Tamiflu is relatively expensive and has an unknown safety and effectiveness profile. That is the information I can provide.

Q41 Fiona Mactaggart: I think I am hearing from you, Dr Godlee, that Tamiflu was used by politicians as a placebo, in effect. That is what it sounds like. What I am concerned about is the point that Dr Goldacre made right at the beginning when he said that he didn’t think that at any stage Roche had broken the law, but the law is broken. Both of you are arguing that this requires a change in the law. What I don’t think I understand is why the regulatory bodies can’t say, "We are not going to authorise your drug to have NHS money spent on it unless we have 100% of all the trials." Why can’t they do that? I have not quite understood, from all the papers I have read, why they can’t do that, if they had some balls-excuse my language.

Dr Goldacre: That is not what we have asked them to do. As a society, through our legislative frameworks, we have asked regulators to make a decision about whether a drug is better than nothing in order for it to come on the market. We have not asked them to ensure that the information that they see is made publicly available, so that doctors, researchers and other investigators can make their own judgment about the quality of that information.

My impression is that everybody here is very happy to follow the current regulations and nobody has had any ambition to change them. Regulators, for whatever reason, have not come to you and said, "We don’t think it is enough for us to see this stuff behind closed doors," and obviously the companies have not asked for legislation requiring greater transparency, but actually, having spent a lot of time speaking to them-some of them behind closed doors-in trying to get them to sign up to our AllTrials campaign, my impression is that these organisations are rule followers. They often do not have a senior medic on their main board of directors; they are auditors, accountants, managers-people who will do whatever is asked of them in order to conduct their business. The pharmaceutical industry will do whatever is required of them. To an extent, it is easier for them to operate in a framework in which perhaps they can elide over good quality evidence about the relative risks and benefits of different companies’ treatments-it softens the sting of producing the second or third best treatment in the class if there is some obfuscation about which is the best, so you can still get some return on your investment for making the second or third best drug in class-but I get the impression that they would be very happy to comply with any legislation that was asked of them.

There is certainly resistance. They have lobbied hard in Europe to try and stop greater legislation from coming in-they have raised some preposterous canards, like pretending that we have asked for people’s confidential medical records to be posted in public when we simply have not-but I think they would comply with that legislation; it is just that we have never asked that of them. I am disappointed that regulators have not asked for greater transparency and that they have been happy with seeing stuff themselves behind closed doors, but there it is. They haven’t.

Q42 Fiona Mactaggart: Are you confident that regulators see enough of the stuff?

Fiona Godlee: That is what I was going to say. I think that regulators do not know at the moment. That is because the whole universe of studies done on an individual drug is obscure and difficult to unpick. What we are heading for, in an ideal world, is a situation where we would know that this number of patients have been randomised into this number of trials and these are the summary results. So the AllTrials campaign and others before us have been asking for registration of trials and summary results to be made available. Trial registration now happens, but it is far from complete, and summary results are being made available, but again it is far from 100%. We know what we need to have, and the regulators-over-burdened, under-resourced and doing their best-are not aware of the universe of trials.

There was one case, the IQWiG case, of reboxetine in Germany: that was one drug, and for whatever reason they applied themselves to this one drug. It involved a vast amount of work and a huge amount of political effort, and jobs were put on the line because of the pharmaceutical pressure on them. That was just one drug. That is just not sustainable across the whole piece.

Q43 Chair: Jobs put on the line in IQWiG?

Fiona Godlee: Yes.

Q44 Chair: They had to withstand that, as it were.

Fiona Godlee: Absolutely. Huge lobbying and pressure from industry to remove them.

Q45 Chair: We are running out of time. We have other officials from whom we need to take evidence. In conclusion, can I clarify one point? The NAO Report states: "This memorandum does not attempt to draw conclusions on whether Tamiflu is value for money." Are you saying that on the present available evidence-what is publicly available-it is not at the moment possible to make a conclusion about whether it is value for money?

Fiona Godlee: I think I am saying that it depends on what value you put on public reassurance. There is no doubt that having the Tamiflu there reassured the public, because people were told that it was effective. I do not know if that is true. If people meant it to be effective in reducing infection and symptoms, I am afraid I cannot tell you whether that is value for money. It may have been politically value for money, but whether it was medically value for money is highly dubious.

Chair: Thank you very much indeed. Thank you for your time.

<?oasys [pg6,cwe1] ?>Examination of Witnesses

Witnesses: Una O’Brien, Permanent Secretary, Department of Health, Sir Andrew Dillon, Chief Executive, National Institute for Health and Care Excellence, Professor Sir Kent Woods, Chief Executive, Medicines and Healthcare Products Regulatory Agency, and Professor Dame Sally Davies, Chief Medical Officer, Department of Health, gave evidence.

Chair: We now move to part two. We are joined by Sir Andrew Dillon from the National Institute for Health and Care Excellence. You have changed your title-

Sir Andrew Dillon: Again, yes.

Chair: So we can’t call you NICE any more, although I’m sure you are.

Sir Andrew Dillon: You can. It’s still NICE.

Q46 Chair: We are joined also by Professor Dame Sally Davies, who is the chief medical officer at the Department of Health; by Una O’Brien, who is the permanent secretary and whom we have seen many times before; and by Professor Sir Kent Woods, who is the chief executive of the Medicines and Healthcare Products Regulatory Agency. You are all very welcome.

May I start with you, Ms O’Brien? Are you satisfied with the regime and the completeness and transparency of your access to data on drugs such as Tamiflu?

Una O’Brien: I would start by saying that clearly there is a range of evidence about the effectiveness of Tamiflu. I think you rightly alluded to it in your questions of the previous witnesses, and I thought your summary was exactly as we would see it. Obviously, I am here this afternoon with three of the best technical experts in the country, so we can get into the detail of your questions as far as you wish to go, but what I want to say at the outset, if I may, is that the risk of pandemic influenza is the No. 1 risk on the Government’s national risk assessment for civil emergencies. It is ahead of coastal flooding, ahead of a major terrorist incident, so it is a matter that is taken profoundly seriously within the Department of Health in the way we plan, model, take account of scientific evidence and take account of historical data. It is because of this, and it is in that context, that we have to make judgments about the relative merits of all the medicines that could be available, whether that is antivirals or the ability to plan for the development of vaccines, which unfortunately can take up to six months after a flu outbreak occurs. So the main point I want to make at the outset is that this is a matter we take extremely seriously and we have to balance our judgments about the scientific evidence and the value for money in the context of the scale of the risk and uncertainty that we are planning for.

Q47 Chair: You’ve said that you take it "profoundly seriously" and "extremely seriously". Can you then account for the way in which so much of the Tamiflu stockpile was destroyed because of very basic errors about how it should be stored? That does not sound to me like profound seriousness at all. Just to remind the Committee and the members of the public, 6.5 million units were written off, at a cost of £74 million, due to poor record keeping by the NHS about their storage environment. It was not that they had been poorly stored-in other words, in a fridge at 8° or below-but that the people who had stored them did not know whether they had been stored in a fridge at 8° or below. They might have been or they might not have been, so because the information simply was not available, £74 million of public money went on tablets that were thrown away that might, perfectly possibly, have been still okay to use, but we didn’t know. That doesn’t sound to me profoundly serious.

Una O’Brien: The first thing to say is that they were actually not thrown away. What you are referring to is the technical write-off in the accounts. Sally can give you more details in a moment, but my understanding, having looked into it, was that when those medicines were distributed at the time of the pandemic in 2009, they were distributed to many, many different places around the country, and when they were returned-those that were not used-we did not have the records to prove, totally reliably, that they had been kept at room temperature, and because of that, they were technically written off, although they were in fact kept until their expiry date-

Q48 Chair: And then thrown away.

Una O’Brien: That is, in effect, what happens with a stockpile. The nature of a stockpile is that you maintain the things for the period that they are viable and then-

Q49 Chair: And then they stop being viable and then you destroy them. That is inevitable in the process; I think the Report uses the word "inevitable" somewhere. My point was that if your attitude to this whole area is one of profound seriousness and extreme seriousness-those were your words-why would you not ensure, in that spirit of profound and extreme seriousness, that something as basic and as important as how they were stored was equally taken profoundly and extremely seriously? Why would you not ensure that?

Una O'Brien: We obviously learned that lesson. The key thing here is the evidence of how they were kept. There was not sufficient to enable us to say that we could absolutely nail them when they were returned to us, bearing in mind that they were distributed thinking that they would in fact be used. Let me ask Sally to fill in on the detail to complete the answer to your question.

Dame Sally Davies: Tamiflu needs keeping at under 25°, and Relenza at under 30°, so that is room temperature, and it was not a hot summer. Ideally, and in planning for the future, we need to make sure that we have those spiral temperature measures that can reassure us that it was kept at that temperature. Despite telling the receiving sites that that was what was needed, they did not have the equipment because the pandemic happened quickly. We were not able to say definitely that they had been kept below 25°, but it was a cool summer. We kept the drugs and we would have used them if people had needed them.

Q50 Chair: May I just give Sir Kent Woods and Sir Andrew Dillon an opportunity to answer my first question: to what extent are you satisfied with the completeness and transparency of your access to data from Roche on Tamiflu?

Sir Kent Woods: I am confident that we had access to all the relevant data, because there is legal force to require that. If a company does not provide us with all the data, we have enforcement powers to insist on it. The licensing of Tamiflu was carried out by the centralised European route, through the European Medicines Agency. Both at European level and at national level, when our scientific assessors look at the dossiers that companies bring forward, if there are additional points of information that we require, a list of questions to the applicants goes back and, as I have said, there is the force of European law transposed into UK law that that data shall be provided. Whether the data relates to incomplete trials, negative trials, or studies carried out in other indications apart from the one for which a licence is being sought, it matters not. Any information that bears on the safety and efficacy of that product has to be made available to the regulator in order to support a marketing authorisation.

Q51 Chair: At request? To go back to our earlier hearing, can you clarify the difference between the different kinds of information that may be supplied? You, we were told earlier by the NAO, have the legal right to obtain this information. That is to say, a pharmaceutical manufacturer is legally obliged to give you information. They are legally obliged to give you all the information about the drug. Are they legally obliged to give you all the information about the drug that they hold, or are they legally obliged to give you all the information about the drug that you ask for?

Sir Kent Woods: All the information that they have about that product when they bring it forward for marketing authorisation.

Q52 Chair: Including any trials that have been conducted on it anywhere in the world?

Sir Kent Woods: Yes.

Q53 Chair: And the results of them?

Sir Kent Woods: Yes.

Q54 Chair: So if they had a series of trials and they told you only about some of them rather than all of them, they would be in breach of their legal obligation to you?

Sir Kent Woods: Indeed.

Q55 Chair: And it is not a case of what you did or did not ask them for; you asked them for everything?

Sir Kent Woods: Yes.

Q56 Chair: Can we talk about the relationship between you and NICE. NICE, Sir Andrew, does not have the legal right to obtain everything, does it?

Sir Andrew Dillon: No, we do not have the same legal powers as the MHRA, but then of course we do a different job. NICE is concerned about the comparative effectiveness of treatment, so we rely on the work done by the regulatory body, which is concerned about the safety, efficacy and quality of treatments. We are generally only interested in a subset of the data that is published or available in clinical studies that have been run on a particular drug. We begin from the position that the drug has an effect which is sufficient for it to justify its licence and it is safe-

Q57 Chair: You start from that position as it were because the MHRA has given its imprimatur, so you know you can start from that position, or at least you think you can.

Sir Andrew Dillon: Yes, we start from that very confident position.

Q58 Chair: Sir Kent, when you receive from a pharmaceutical manufacturer all the information that it has about a drug, are you, in some sense, prohibited from handing that information on to anyone else? Do you have any restrictions through some form of confidentiality agreement that prevent you from handing it on to others, including to other public bodies such as NICE, or not?

Sir Kent Woods: It is a very important, and to some extent, changing area. Under the 1968 Medicines Act, the regulatory staff were explicitly precluded from passing information that they had gathered, as part of their regulatory work, to other parties. That has been repealed, and under the regulations that were introduced in 2012, that constraint is removed. We do not have a problem with sharing data with, for instance, NICE, as a public body.

Q59 Chair: When you say that you don’t have a problem, you mean that you don’t have a legal problem. You are able to do it.

Sir Kent Woods: That’s right. There are two issues. One is that there may be, within the data that we receive, some information which is personal confidential information. There may be identities of individuals in there-in the clinical study report or elsewhere. So, to that extent, information cannot be put in the public domain directly without being redacted.

The second and very vexed issue is about what is commercial in confidence information. It has been argued-and is still argued in some quarters-that with some clinical trial data, before the regulatory decision to license or not to license has been made, that clinical trial data will contain commercial in confidence information. Our own view is that, when there is commercial in confidence information in a dossier, it usually relates to manufacturing and quality, and not necessarily to the clinical trials evidence, so our constraints on releasing clinical trials data are much more around data protection issues and redacting personal information than they are about commercial in confidence issues. We would certainly support the view that the clinical trials data supporting a licensing decision should be put in the public domain once the licensing decision has been taken.

Q60 Ian Swales: Surely that is a trivial issue, isn’t it? Taking somebody’s name out and calling them patient A or patient B-you’re not seriously saying that that causes prevention of publication of important information. I know it is a clerical job, but surely you cannot accept the argument that that information cannot be published because it has somebody’s name in it.

Sir Kent Woods: Can I give you some figures on that? I am, at the moment, the chairman of the European Medicines Agency, as well as my executive role in the MHRA, and since 2010, the EMA has adopted a policy of data transparency. We have released approximately 1.9 million pages of documents. It has cost the agency around €3 million to do that, and most of the work is the labour of going through thousands and thousands and thousands of pages to redact the information.

Q61 Ian Swales: Why not make the manufacturers do it? Why not only accept the information if they have already anonymised it? They have plenty of money. Surely they don’t get through the door if they give you that kind of-that is an excuse, isn’t it, which we surely shouldn’t accept?

Sir Kent Woods: We don’t think that the regulator should be acting as the archivist here. If the company is going to go to an appraisal body such as NICE, seeking a market for its product, it should provide the information in toto needed to support a decision. I think that is the responsibility of the company, and I quite agree with you. I think what is needed for the future is clarity and the redaction at source of any information-

Q62 Chair: When you say at source, do you mean by the company?

Sir Kent Woods: Yes.

Q63 Chris Heaton-Harris: I looked up your biography before I came, Sir Kent, so I know you have a European hat as well. Therefore, you see 26 or 27-soon to be 28, and maybe a few more-cases of best practice, where similar regulators across Europe have a relationship. The main recommendation of the Report is that you should work better together. What are the barriers to stop you from doing that at this time?

Sir Kent Woods: Do you mean better with NICE?

Chris Heaton-Harris: With NICE, sorry.

Sir Kent Woods: We have had, for a long time, a memorandum of understanding with NICE. In fact, it predates the MHRA and goes back to the Medicines Control Agency. We are perfectly willing to revisit and revise that, but in practice, the working relationship between the MHRA and NICE has been entirely constructive, and we have not had situations where we have had to refuse to provide NICE with information that it wishes to have. We both report to the Secretary of State. To that extent, we are not talking about the public dissemination of information; we are talking about the availability of information between one part of the health system and another.

Q64 Chair: Just for the avoidance of doubt, there are no legal impediments that prevent you sharing information with NICE.

Sir Kent Woods: I do not think there are. Having said that, the policy of clinical trial data release at the EMA has currently been brought to a halt by a restraining order put on it by the European Court, at the request of-

Q65 Chair: Can you be clear about which European Court you are talking about? Is it the Court of Justice?

Sir Kent Woods: The Court of Justice, yes. The reason for that is that two companies have claimed that their rights are being infringed.

Q66 Chair: Which ones?

Sir Kent Woods: InterMune is one. I forget the name of the second but I can let you know.

Q67 Chair: If you could write to us, that would be great.

Sir Kent Woods: Those companies have asked that the EMA should not release data until there has been a court hearing.

Q68 Chair: Mr Moon, do you have the other name?

David Moon: I think Ben might.

Dr Goldacre: It is InterMune and AbbVie.

Sir Kent Woods: So, when I say that I do not know of any legal impediment, I have to say that that particular matter is sub judice.

Q69 Chair: Sir Andrew, when you are doing your work-and you have said your work for NICE is a different job from the MHRA-do you at times have occasion to ask the MHRA for information, that you know they will have that you do not have?

Sir Andrew Dillon: Our first port of call is the company, because after all they have supplied the information to the MHRA in the first place, so they have it. We have already established a dialogue with the company, because we are engaged with them in an appraisal. They will already have supplied us with the initial data set that we asked for.

If we need to go beyond that, if we think there is something that they have not supplied, or we want to explore the data they have given us in more detail, we go to the company first of all. We have not been in the position where our work has been frustrated to the point where we have had to terminate an appraisal because we have not been able to get that additional data from a company.

Q70 Chair: One thing the Report makes clear in paragraph 7 on page 5 is that the MHRA and the EMA-the European Medicines Agency-do not ask for as much information as the United States FDA, the Food and Drug Administration, at the initial application stage. The main difference according to the Report is that the FDA asks for patient-level data upon which it may conduct its own analysis. It goes on to say, "The European agencies would require more analytical capacity to be able to do this."

I think that means that the European agencies would require more analytical capacity to conduct their own analysis, not that they would require more analytical capacity to be able to ask for patient-level data. That is an important difference. Is it correct that you ask for less information than the FDA? Is the reason you do so because it would not be of any use to you because you do not have, in the words of the Report, "the sufficient analytical capacity" that you would require to do something with it?

Sir Kent Woods: The analytical capacity that is used to assess a dossier that comes in for a centralised licence at the EMA is actually provided by the member state agencies. For any application, there will be two member state agencies-the rapporteur and co-rapporteur-that will take on responsibility for doing that assessment.

Q71 Chair: Have you been in the position of having to talk to yourself when you have brought forward something for potential approval? You are saying that in this case the MHRA would bring it forward to the European Medicines Agency for consideration.

Sir Kent Woods: No. If a company makes an application to the EMA the scientific committee-the Committee for Medicinal Products for Human Use-will decide two member states to lead on that assessment.

So the analytical capacity actually comes from the member states. We certainly have statistical expertise within the MHRA. Not every agency does, but within the European network there is the analytical capacity, but perhaps not on the scale that the FDA has provided it. We will use that analytical capacity if we wish to probe further.

Q72 Chair: You must first have the information. This appears to suggest that you do not ask for as much information in the first place because you do not have the analytical capacity. Those are quite separate things. I will give you an analogy with the US Justice Department and the information that cigarette companies were forced to disclose about tobacco. Ms O’Brien is nodding; she will know what I am about to say. I think there were 11 million pages of information. We looked at the evidence in this Committee, and I think we are about to look at tobacco smuggling again at some point in the not too distant future. Once it was dug into-because there were 11 million pages it took some while to do that-it became quite clear that tobacco companies were taking account of illicit duty, not paid routes to market, in determining their overall advertising budgets. They were all caught bang to rights, and the only reason why that was possible was because all the data was disclosed. I am a lay person and a non-scientist, and most lay people’s starting point would be, "Give me every known thing in the human universe about this drug and I will put it in the corner and I will say, "That is everything that the human species knows about Tamiflu", and then we will decide how we deal with it. But you don’t do that, do you? You ask for less because you have less analytical capacity. That is what it says in paragraph 7.

Sir Kent Woods: No, it is not so much about how much-we are talking about the level of detail that the company is asked to provide.

Q73 Chair: In my nice big pile in the corner there is everything, and you are not asking for everything, are you?

Sir Kent Woods: If you take a clinical study that a company brings forward to support the efficacy of its product, there is a clinical study report, which is an enormously detailed summary of the study they have done and the results they have obtained. Those results are in summary form rather than being the raw data.

Q74 Chair: But you could get the raw data if you wanted.

Sir Kent Woods: We could.

Q75 Chair: You are legally able to get it if you want it.

Sir Kent Woods: Indeed.

Q76 Chair: So it is a question of whether you ask for the raw data or not.

Sir Kent Woods: Absolutely. If we were not satisfied with the analytical approach that the company had taken, we could go back to the level of the raw data and do it again, but we do not routinely do that.

Q77 Fiona Mactaggart: I should say that I have been to a number of events that have been sponsored by the ABPI. People might think that that might influence my views here, but one of the things I am interested in is that it sounds as though it would be possible to ask for that data. We heard from our earlier witnesses that if that data was publicly known, other people would do certain bits of analysis, such as a number of GPs who feel that something does not match their experience. That is the kind of thing that could trigger a different analysis and a challenge. Using the wisdom of masses might help us get more effective analysis of clinical trials. The present system prevents that from occurring, does it not?

Sir Kent Woods: I disagree with that. There are three levels of transparency, and it is important to understand what is implied by each of them. At the first level, we need to know that a study has been done and we need to know its results. That is absolutely a given. Secondly, the regulator needs to see the clinical study reports of every one of those trials, which provide the summarised data.

Q78 Fiona Mactaggart: Does that include the ones that companies abandon because they think they will not like the results?

Sir Kent Woods: Absolutely. If it provides relevant information on risk and benefit, we need to know it. That will include safety data, for instance. The third level of transparency is down to individual measurements of blood pressure, temperature or whatever of every single patient randomised in that trial. I do not think that it would help the general public to have that information available. It might well be necessary for academics to have access to that patient-level data, if they wished to carry out a systematic review-a meta-analysis-using individual patient data. That is the most refined form of meta-analysis, which is done from time to time when there is an absolutely crucial question and you need to draw information from every single trial that has been done. The individual patient-level data will not be of great help to the general public.

Q79 Fiona Mactaggart: I was not suggesting it be made available to the general public, because I am one of those who simply would not understand it. I was suggesting that one issue is relatively expert clinicians feeling that the reality they are seeing challenges the conclusions to which you have come, and I think there have been such cases. Therefore, those clinicians may want to have the data to be able to underpin their sense that, "If I am practising in south Wales, there may be something in the south Wales gene pool that produces a different result." If they could see the full data, they could, from their experience, challenge the conclusions to which you have come. I do not see a good reason for not doing it.

Dame Sally Davies: Perhaps I could come in on this. We have a system of the regulator looking at efficacy and safety and NICE looking at cost-effectiveness. Most of our clinicians-we are talking generally about doctors, as the drug is only prescribed-do not have either the time or the expertise to do the analysis that you are talking about.

Fiona Mactaggart: Indeed.

Dame Sally Davies: Therefore, we set out, as a system, to give our patients and public the best service we can in terms of efficacy, safety and cost-effectiveness. I, with all my colleagues, have worked hard on transparency; the Government believe in that. Personally, in the mid-2000s I led a lot of work at the WHO on their clinical trial registry work to agree the domains and to ensure that the WHO work lined up with in the States, with EMEA-now EMA-and with everyone else. Registration is the most important thing, so that we know what trials have been done, and that is improving. Summaries of results are useful. Individual patient data is important when a researcher who understands the methodology has a good hypothesis to test. What we are now working to do increasingly is making that data redacted and often available only in a safe haven to protect the patient’s privacy, which is paramount so that these things can be contested and looked at.

Let me turn to the Cochrane Collaboration. We fund that from the National Institute of Health Research, which is the funding route for the Department of Health for clinical, evaluative and applied policy and research, and I hold that budget. The Cochrane Collaboration was set up initially by us in the mid-’90s. We fund over half of the collaborative editorial groups; I have been an editor. I believe strongly in this, and I believe in the hierarchy that you have descriptive studies, going up to case control-better than that; it is a randomised control trial-and then you have meta-analysis. But there are different ways of looking at it. Having read it, I do not believe-Kent and Andrew may have other views-that the Cochrane review on Tamiflu is the last answer, not just because they do not have all the data, but, first of all, because they made up their hypotheses once they had got data, and that is not standard research practice. They extracted data from 25 studies but excluded 42 and took no data from published studies.

Q80 Chair: They took no data from published studies?

Dame Sally Davies: No, and I could go on.

Q81 Chair: I thought the whole point was that they withdrew the non-published information.

Dame Sally Davies: Yes, but then they left out what was published.

Q82 Chair: Can you write to us about this? It is very interesting. I would like to see a longer, more detailed and more forensic explanation of what you were just saying than is possible in the time available in this Committee.

Dame Sally Davies: Absolutely. We will.

I want to finish by saying that we continue to fund this and we believe in an open debate. We were going to close the funding down because Roche had not agreed to supply the data. They have now agreed, so we are continuing to fund them in order to allow the open debate.

Chair: May I bring in the Comptroller and Auditor General, and then Mr Swales?

Q83 Amyas Morse: I just have a basic, auditor-type question. Are you limited at all by resource as to the amount of work you can undertake, or at least the style of work that you can undertake? We have seen that in other areas of our work. Is your budget going up or down, taking one year compared with another? Please may I ask that question to each witness, just to establish whether you are resource-constrained or not?

Sir Kent Woods: The MHRA operates as a trading fund. Under the will of Parliament, we levy fees for the work that we do. These are statutory fees that are reviewed every year. The resource that we use is not from the taxpayer; it is from those who are regulated. We are fortunate in that because there is then a relationship between the work that we have to do and the resource that we have to do it. The issue is not that we are so resource-constrained that we cannot do the job properly. We are seeking to do the process of regulation efficiently and we do not think it would be efficient to re-do analyses that a company has done when we can probe, if we wish, to make sure that it has done that properly. It really is a matter of regulatory efficiency rather than doing a rush job because we do not have the resources to do it properly.

Sir Andrew Dillon: Our budget is going down but we are becoming more efficient, so we have been able to protect our investment.

Q84 Mr Bacon: You cannot levy fees in the way the MHRA can.

Sir Andrew Dillon: No, we do not, but we have been able to protect the capacity to engage with companies on this kind of issue, so I feel quite confident that we have the resources to do our particular job.

Q85 Mr Bacon: Professor Davies, as chief medical officer, what is happening to your budget?

Dame Sally Davies: Actually, as chief medical officer, I have no budget.

Q86 Mr Bacon: You set a fine example to us all, and I want to put that on the record. This Committee has no budget either.

Dame Sally Davies: With respect to pandemic planning, if we make the appropriate business case-I highlight that we did so right through to the Treasury-we can buy what we need.

Q87 Ian Swales: Perhaps Sir Kent could answer this. Returning to paragraph 2.10, which I referred to earlier, I do not know whether to be worried or encouraged by the fact that the MHRA prosecuted someone for falsifying clinical trials and has found two companies-GlaxoSmithKline and, most relevantly today, Roche-not giving up important safety information. Clearly, it is encouraging that you found that, but what does it tell us about the climate out there, why did you go into those companies, and how often do you do this kind of work? In other words, what does that section tell us about what you do?

Sir Kent Woods: We have a division that is committed to inspection, enforcement and standards. It has a finite capacity, so we are using its resources in a risk-based way. Over the last couple of years, we have developed some statistical algorithms, which we think are world class, to allow us to spot the factors that would point us in the right direction. For example, if we see information from a company that does not tally with what we know, if a company has a poor inspection history, or if we have soft intelligence from one place or another, that is where we would prioritise our inspection resource, and that is precisely how this particular matter came to light. It was because the company in question had gone through a major reorganisation and had completely redeveloped its pharmacovigilance database that we spotted those as potential risk factors. We carried out the inspection and the result is as you see.

Q88 Ian Swales: To repeat the question I asked the previous witnesses, do you think, particularly regarding the second bullet point about Roche, the 46 medicines and the safety issues, that the public should be worried, are they technical administrative matters you found that we do not need to worry about, or do we not know?

Sir Kent Woods: When the information came to light, we asked two immediate questions. First, was there a public health issue that we did not know about? The medicines on which there have been some failures of response on safety data were medicines about which we already knew a great deal, and the question was whether the additional data that we had not seen would alter our estimate of the risk-benefit. We were able to look fairly quickly at that, and when we did not see an immediate safety concern it was for exactly that reason. There is a deeper question about whether it was an error or there was culpability, and that is a legal matter. As the infringement proceedings are going ahead, I cannot comment, but it illustrates first that we inspect, secondly, that if anything is amiss we find it, and thirdly, that we have legal powers.

Q89 Ian Swales: If I am an independent researcher or a pharmaceutical company, how often can I expect a knock on the door from people in your organisation?

Sir Kent Woods: I cannot give you a quantitative answer to that. We are of course responsible for pharmaceutical production, not just in the UK and not just in Europe, but around the world. I think there are 42 countries, at the last count, manufacturing the raw materials for medicines that come into the European Union in 1,600 different sites. It is a large task and we put our resource where we think it will most likely deliver the goods.

Q90 Ian Swales: I think it is particularly research that we are talking about here. I do not know where the Chair has got to in the proceedings, but are we going on to Tamiflu itself?

Chair: Yes, by all means. Please ask about that while I confer with Ms Doyle-Price.

Q91 Ian Swales: Okay, I am now referring to sections 322 and 323 of the Report, which talk about the evidence for the effectiveness of antivirals. I do not know whether Ms O’Brien or Mr Dillon would be the best person to answer this, or maybe the chief medical officer. Section 323 contains some quite worrying statements in terms of the decision that was taken. This is about the Scientific Pandemic Influenza Advisory Committee and the point that the paper you were looking at stated, "there was no published evidence on a reduction in mortality due to antiviral use and very limited evidence on reduced complications and hospitalisations." Then it says: "The Scientific Pandemic Influenza Advisory Committee…advised that an assumption of 40 to 50 per cent reduction in both hospitalisations and deaths should be used in the modelling" for the paper. This sounds like a straightforward doctoring of the numbers to make a case. How would you respond to that?

Dame Sally Davies: Let me try and explain. There was an H1N1 epidemic in 1918, when 25% of the population caught it and 2% of them died, which meant that there were 316,000 deaths. It was massive. I believe that at the time we started our pandemic planning-I was in charge of research, not the CMO-we were worried about an H5N1 epidemic coming our way.

Q92 Chair: H5N1 was avian flu-bird flu.

Dame Sally Davies: Yes. Which looked as if it-though it did not have much human-to-human transmission-had high mortality rates. So when the Mexican swine flu appeared, which was an H5N1, our experience was from the 1918 epidemic. Put that vision of what a pandemic can do-we do have the figures for the impact on the NHS, on attendance at one site of employment and the economy-and the unknown about how severe it will be, besides the evidence we had, which was not for a pandemic at all; it was for using Tamiflu in seasonal flu, which, outside the risk groups of people who are either elderly or have pre-existing disease, is not usually very severe. We worked with a number of scientific groups to look at what was likely to be the impact, but we were clear that-our modellers and our scientific advisory groups advised that we could have an assumption of 40% to 50% reduction in hospitalisations and deaths, for the modelling to build the business case, but that the evidence was not there because we had not had a serious pandemic. We still have-

Q93 Chair: So the 40% to 50% was sort of plucked out of the air, in effect. Is that right?

Dame Sally Davies: No, it was no plucked out of the air.

Q94 Chair: Well, where was it plucked from? The Report says, in paragraph 15: "The paper stated that there was no published evidence" and you have just said there was no evidence, so how did you come up with a number? If it was not plucked from somewhere, how did it-

Dame Sally Davies: It was worked out by looking at historical pandemics, as to what would be reasonable and we had three sets of modellers looking at this. We had scientific groups expert in flu and three sets of modellers-absolutely independent academics; the Health Protection Agency; independent and Government modellers-looking at it, who advised us to work on those assumptions.

What I would like to come back to is that, when we reviewed the data after the pandemic, it looked as though there was about that level of reduction of severe cases. So we think that the modelling for a pandemic was actually pretty good.

Q95 Ian Swales: We will come back to the post justification in a moment. I certainly take Ms O’Brien’s comment about this being the No. 1 risk. We are not trying to minimise that at all. We are talking about the data on which a £400 million spending decision was taken. It is about the data that we are taking it on. I know about the politics. I wonder if we would have bought as much if it hadn’t had "flu" in the title. Obviously, the public were more-I cannot even remember the name of the other one, which tells you something about brand marketing.

We are talking about the process by which this huge spending decision was taken. It sounds very much as though it was a finger in the air. Alongside the earlier evidence about the doubt about the efficacy of this product, I guess we are groping for whether the public should be concerned, not so much about the flu, but about the way we spent this amount of money. That is what this Committee is about. That is really what I am trying to drive at.

Dame Sally Davies: This, as I said, came from a standing scientific advisory group, and it was reviewed. We had some scientific work jointly with the Royal Society and the Academy of Medical Sciences. The then Government chief scientific adviser was concerned about whether we were getting it right, and we had a colloquium, bringing all our planning papers, with about 20 external scientists and the Government chief scientific adviser. They all felt-all agreed-that those papers were the best effort that we could make to base our planning on. We used vast amounts of external scientific advice. It was not a finger in the air; it was modelled, and it was carefully done.

Q96 Ian Swales: We all remember this was an international issue; in fact, it started in other countries. Are you aware of what other Administrations facing the same issue as your organisation did? Did anybody else buy this amount of this particular drug, or did other people make different judgments?

Dame Sally Davies: Other people started to stockpile. We have a history of being very good at planning; the WHO always congratulates us. We were one of the few countries-I would have to write to you to tell you how many did-that put in place an advance purchase agreement for vaccines. We knew that if you get a pandemic, you not only get a new bug; there is no resistance to it in the community, and there are no vaccines. For flu, it takes six months to produce early vaccines, and before you get to a number that will be enough, it is another six to 12 months.

We have to protect our public in that first six to 12 months. The only known protection is the antivirals, and we knew that if we waited for a pandemic, everyone would be panicking and demanding them. There would be a three-month running for small supplies. Our history as a nation is to plan and think it through, and that is what we did, but other countries have stockpiles, such as Japan. We have a stockpile of 50% at the moment; Japan has a stockpile of 40%, and France and Germany have stockpiles.

Q97 Ian Swales: And that is as a proportion of the population?

Dame Sally Davies: Yes. I should point out that Tamiflu makes up only 35% of that, because of course you can get resistance, so we have 15% Relenza. We do not want full Relenza, because you can get resistance to that, it is not licensed for under-five-year-olds and you have to sniff it, so it is quite difficult to give.

Q98 Ian Swales: There is also a comment on the same page that there was a scenario indicating that covering 50% of the population would only yield small additional benefits to a stockpile of 25% in a worst-case scenario, and no additional benefits under other scenarios. How did you come to the decision about how much to stockpile, given that some people were saying that if you have enough for 25% of the population, that will solve the problem? You bought double that.

Dame Sally Davies: My understanding, though if I am wrong we will write and correct, as I was not party to this, was that we were not only trying to provide treatment for the at-risk groups, but, because it was going to be a pandemic, for a broader group, and actually as prophylaxis, to protect people: to try-which we did try, as you know, with school closures and treating contacts; my daughter was treated-to contain it for as long as possible, in order to give time for the preparations to be put in place on the ground, and as long as possible, or as short as possible, before vaccines became available. So we upped it because we were not just having a treatment for at-risk groups, but a broader treatment and a prophylaxis stockpile.

Q99 Ian Swales: But the suggestion is that that offered no additional benefits. That is the phrase; and some views were that there would be no additional benefits for buying that amount-that doubling the amount was probably not good value.

Dame Sally Davies: But without that, we could not have tried prophylaxis. We would have been stuck with just hygiene measures, with school closures. I go back to the fact that, in the event, it was not a particularly serious virus, except if you were one of the pregnant women who ended up on ECMO for eight weeks, or one of the thousands who died-the excess winter deaths were over 3,000-then you would say it was severe; but we needed to try and protect the population.

Q100 Chair: We have to bring this to a conclusion. Unfortunately various Members need to take part in the Second Reading of the Pensions Bill.

Sir Kent, could we just return to this question of who has access to the information; because you said earlier that much of the patient-level data really wouldn’t be of much interest to the general public, which may or may not be true. There might be individuals and groups who might find it useful, although most members of the public probably wouldn’t, and wouldn’t understand it.

What I find odd and difficult to understand is, given that you yourselves don’t always ask for a look at the patient-level data, why would one come to the conclusion that this is somehow something which is a sphere where it is okay for only the regulators to be looking at this? The evidence we heard earlier suggests that you are staffed up by well motivated and highly intelligent people, but that, plainly, because you are human beings, you too can make mistakes. Wouldn’t it be better, in terms of critical appraisal, to have a wider pool of eyes looking at this problem than you currently have?

Sir Kent Woods: I agree with that sentiment, and we certainly wouldn’t wish to, as somebody said earlier, do our work behind closed doors. The question is whether it is our responsibility to make those data available, or the companies’ responsibility; but we would certainly welcome multiple pairs of eyes. If we take the European system, any guidance, any opinion that comes out of the CHMP has had 27 members states’ experts looking at it; so to that extent there are multiple eyes.

I would just like to come back, if I may, Chairman, to this question about the trials evidence; because we must never forget that all those trials we are talking about were done in seasonal flu-and we are planning for a pandemic. The difference between seasonal flu and pandemic flu-and we go back to 1918 as a worst-case scenario: the lethality of that influenza virus was 100 to 200 times greater. So I am uneasy about the suggestion that Tamiflu is a kind of expensive paracetamol for something which is actually like a bad cold. Pandemics are really serious public health problems.

Q101 Chair: I think we all appreciate that. The issue is about the efficacy in the event of a pandemic. In fact, Mr Goldacre talks about the difference between seasonal flu and a pandemic extensively in the book.

Sir Kent Woods: If I can follow that point, when you are doing a randomised trial, it is difficult to demonstrate effects against very rare outcomes. For seasonal flu, death is a very rare outcome. For pandemic flu, it is a far more common outcome. To say that you did not demonstrate a reduction in serious illness, hospitalisation or mortality, for a molecule that we know specifically interferes with the replication of the influenza virus, by no means precludes that, and, indeed the fact that death is such a rare event makes it a little difficult to extrapolate a negative outcome from trials in seasonal influenza, to say "Therefore it is not going to work."

Q102 Chair: I do appreciate that. It does, though, make it less scientific, doesn’t it?

Sir Kent Woods: One has to make judgments in advance, on the basis of best evidence. I totally agree.

Q103 Ian Swales: One question on this: none of us on this side of the table has anything like the medical knowledge that is on the other side of the table, so we can’t really question that kind of thing. I guess we are in the value-for-money game here. If I can just test another angle of that, because you would be able to answer it.

Chair: You’ll have to be quick.

Q104 Ian Swales: Yes, very quick. Of the 40 million units we have purchased, only 2.4 million have been used in the last three or four years. Was there any different commercial arrangement that would have been possible, that would have both met the need but also managed the finance better for the taxpayer?

Una O'Brien: All I can say is that we have sought to get the very best possible procurement and to beat down every last pound. We will continue to do that, particularly when Tamiflu comes off licence in a couple of years’ time.

If I may, I think it is important to add that, if you look at the cost and break it down, it is 1p per household per day. We are really in a form of insurance here. On the best evidence available, we are trying to make a judgment, and I would rather be here explaining why we did it than explaining why we did not have a stockpile and why we did not have Tamiflu available to people during the mild outbreak in 2009. I think it is about looking at the whole picture.

Q105 Chair: I must say that it is a neat headline-it always is when you come down to 1p when we have a population of 62 million people-but the fact is that a ratio of 40 million units purchased to 2.4 million units used suggests that there might be a little bit of room for improvement.

Sir Andrew, we are running out of time, so may I just finish with you? Why doesn’t NICE make it obligatory for manufacturers to confirm at a global level that the information provided for appraisals is complete?

Sir Andrew Dillon: When we approach companies and ask them to make a submission to our routine technology appraisal process, we ask the medical director to confirm that, to his or her knowledge, all the relevant information is available for the appraisal.

Q106 Chair: Yes, I know, but that was not my question. The Roche study in Shanghai was a huge study that Roche in Switzerland apparently did not know about, which is relevant here. The question I asked is why NICE does not ask companies to confirm that all the relevant information is made available at a global level. These are, after all, global companies. You could do that, couldn’t you?

Sir Andrew Dillon: Yes. That is the purpose of the question.

Q107 Chair: Why don’t you ask a better question?

Sir Andrew Dillon: We are going to ask a better question. We will insert the word "global."

Q108 Chair: Will you write to us with the question that you are going to ask?

Sir Andrew Dillon: Yes, I will.

Chair: Thank you very much.

I thank you all very much for your time. It is possible that we will return to this at some point in the future, but in the meantime I thank you all very much. We appreciate it.

Prepared 30th December 2013