03/23/21

The Trickery of Drug Approval

© Andriy Popov | 123rf.com

From all that the public is hearing and seeing about the COVID vaccines, both the pharmaceutical companies and the FDA have done an amazing job bringing the first two vaccines to market. In order to alleviate public mistrust of the “warp speed” development process, Dr. Anthony Fauci and NIH director Francis Collins publicly received their first dose of the Moderna vaccine. Dr Fauci said it was remarkable to be receiving it less than a year after the virus it treated was discovered. “What we’re seeing now is the culmination of years of research which have led to a phenomenon that has truly been unprecedented.” But will the pharmaceutical companies continue this standard of fast, safe and effective drug development?

In January 2020, just before the emergence of the pandemic, Harvard Medical School researchers published a study in JAMA that found the FDA is approving new drugs more quickly than ever before and using less stringent standards to determine if the drugs actually work. The lead author of the study told NPR “There has been a gradual erosion of the evidence that’s required for FDA approval.” As a result, patients and doctors “should not expect the new drugs will be dramatically better than older ones.” The use of expedited programs (Accelerated Approval, Fast-Track, and Priority Review) for new drugs increased over time, with 81% of new drugs benefiting from at least one such program in 2018. NPR reported the study found the median review time for standard drug applications was just over 10 months in 2018 compared to 2.8 years for standard and priority applications from 1986 through 1992.

The proportion of new approvals supported by at least 2 pivotal trials decreased from 80.6% in 1995-1997 to 52.8% in 2015-2017, based on 124 and 106 approvals, respectively, while the median number of patients studied did not change significantly (774 vs 816). FDA drug review times declined from more than 3 years in 1983 to less than 1 year in 2017. But total time from the authorization of clinical testing to approval has remained at approximately 8 years over that period.

Drug makers began to pay FDA fees to fund the review process as a result of AIDS activists protesting the slowness of the agency in the 1980s. In 1993, the first year after Congress passed the Prescription Drug User Fee Act, the FDA collected $29 million in fees. That amount rose to $908 million in 2018. The industry fees amounted to around 80% of the money spent on FDA employee salaries for drug reviews that year. The lead author of the JAMA study said: “There is some concern about the incentives that this created within the FDA … And whether it has created a culture in the FDA where the primary client is no longer viewed as the patient, but the industry.”

The Pharma Marketing Blog tracked the relationship of fees paid to the FDA by the pharmaceutical industry and the push for less rigorous scientific proof in clinical trials (and therefore faster drug approvals). He noted that there was a negative correlation between the rise in user fees and a drop in the number of warning letters sent out by the FDA to companies. There was also a positive correlation between drug user fees and adverse event reports, which track drug safety. See the following graphs taken from the Pharma Marketing Blog.

This hasn’t been the only recent evidence of how the pharmaceutical industry seems to be replacing patients as the FDA’s primary clients. Researchers published a study of the “Association between FDA and EMA [European Medicines Agency] expedited approval programs and therapeutic value of new medicines” in the October 2020 issue of the BMJ. The study sought to characterize the therapeutic value of new drugs approved by the FDA and EMA and how these ratings were associated with the regulatory approval process of the expedited programs of the FDA and EMA.

Over the past few decades both agencies have established programs to expedite drug development for serious conditions. The four main expedited programs of the FDA are: fast track (introduced in 1987), accelerated approval (1992), priority review (1992), and breakthrough therapy (2012). Emergency use authorization, under which the COVID-19 vaccines have been expedited, technically isn’t an FDA approval of the drug, but it authorizes the FDA to facilitate an unapproved product during a declared state of emergency. Its latest update occurred in 2017. The EMA has two expedited programs, accelerated assessment (2005) and conditional marketing authorization (2006). The EMA instituted a third program, PRIME, the priority medicines scheme, in 2016.

These expedited programs were intended to prioritize the most important medicines for faster access to patients, and are increasingly the route by which new medicines are approved. For example, the FDA approved 60% of new drugs through at least one expedited program in 2019, while only 34% of drug approvals in 2000 were expedited. The FDA and EMA guidance indicated that an expedited program should be reserved for drugs that are expected to show an improvement over the available therapies. “However, neither the FDA nor the EMA specifically requires data on, or makes regulatory approval contingent on, comparative effectiveness; most new drugs are approved on the basis of placebo-controlled trials or single arm studies.”

This means the therapeutic value of medicines that benefitted from the FDA and EMA expedited programs is uncertain. Using ratings of therapeutic value published by health authorities in four countries and an independent non-profit organization, the researchers “evaluated the association between expedited programs and ratings of therapeutic value for all new drugs approved by the FDA and EMA from 2007 through 2017.”

We found that less than a third of all new drugs approved by the FDA and EMA were rated by any of five independent organizations as having high therapeutic value—that is, providing moderate or better improvement in clinical outcomes for patients. Most of the increase in the number of new drug approvals over the past decade was driven by drugs rated as having low therapeutic value, which calls into question the common practice of using simple counts of new drug approvals as a measure of innovation. Rather, a more nuanced view of innovation is needed that takes into account the clinical benefits and relevance to patients of new medicines.

The study’s findings suggest that after FDA regulatory approval, there is a widening gap between the drug’s approval and the clinical and public health priorities of health systems, payers and patients in drug safety and efficacy. Contributing to this gap is the varying quality of clinical evidence available at the time of approval. This leads to uncertainty around the extent of clinical benefit of the respective drug. The study’s data emphasizes the importance of robust post marketing evaluation for expedited drugs. “Such an evaluation would confirm early evidence of efficacy and help to elucidate findings from several previous studies suggesting that accelerated approval, priority review, and fast track drugs were associated with increased safety related reports or labeling changes.”

The researchers suggested one step leading to greater assurance of timely completion of post marketing study requirements for expedited drugs could be to require that certain mandated studies enroll patients before the FDA or EMA grants approval. They also suggested that regulatory agencies explore whether additional explanations were necessary. These explanations could include elaboration in product labeling, press releases, or approval documents. They could provide more realistic expectations of benefit for expedited drug approvals by patients and clinicians. Their findings also had implications for the controversy around drug prices.

In the US, the largest public payers are required by law to cover most (Medicaid) or a substantial number (Medicare) of drugs approved by the FDA, regardless of the quality of the evidence supporting their approval or their therapeutic value. Previous studies of cancer drugs have found no association between clinical benefit and drug prices and reimbursement.

In conclusion, the researchers said while the FDA and EMA are increasingly using expedited programs to facilitate drug development, the absolute value of highly rated drugs approved by the FDA and EMA over the past decade was low. Policy makers could explore implementing therapeutic value ratings more widely for new drug approvals. This would align the evidentiary needs of regulatory approval and reimbursement decisions with informing patients and doctors about the benefits and risks of new drugs, particularly those approved by expedited programs.

It’s not so surprising, then, that so many Americans are hesitant to say they plan to get a coronavirus vaccine. It seems that the above discussed results of research into new drug development by the pharmaceutical companies is at least partly to blame. Many people do not trust the claims drug companies make about their products.

The Pew Research Center conducted a survey of Americans at the end of November 2020. Sixty percent said they would definitely or probably get a vaccine for the coronavirus, which was up from 51% in September. Thirty-nine percent say they will definitely or probably not get a coronavirus vaccine. About half of this group, 18%, said it’s possible they would decide to get vaccinated once people start getting vaccinated and there is more information available. “Yet, 21% of U.S. adults do not intend to get vaccinated and are ‘pretty certain’ more information will not change their mind.”

While public intent to get a vaccine and confidence in the vaccine development process are up, there’s considerable wariness about being among the first to get a vaccine: 62% of the public says they would be uncomfortable doing this. Just 37% would be comfortable.

Public confidence has increased since September that the research and development process will yield a safe and effective vaccine for COVID-19. Seventy-five percent of individuals now have a great deal or fair amount of confidence in the R&D process. However, one of the factors influencing whether someone intends to get a vaccine for COVID-19 is mistrust of the vaccine development process. Sixteen percent of Americans do not have much confidence in the process; 8% have no confidence that the R&D process will produce a safe and effective vaccine for COVID-19. Confidence in scientists remains slightly higher than before the pandemic.

With scientists and their work in the spotlight, 39% of Americans say they have a great deal of confidence in scientists to act in the public’s best interest, an uptick from 35% who said this before the pandemic took hold. Most Americans have at least a fair amount of confidence in scientists. However, ratings of scientists are now more partisan than at any point since Pew Research Center first asked this question in 2016: 55% of Democrats now say they have a great deal of confidence in scientists, compared with just 22% of Republicans who say the same.

Pharmaceutical companies have an opportunity when they resume the research and development process for new drug applications after the pandemic. Will they continue to use external committees of scientists vetting the data for new drug applications and produce truly independent recommendations and rejections? If pharmaceutical companies can maintain an open and transparent R&D process and develop drugs with a truly high therapeutic value, the confidence level of patients and their doctors would be higher than ever. For more on COVID, see “Learning from COVID Drug Development.”

09/14/18

Machiavellian Drug Approval

photo by JoJan; Creative Commons Attribution 3.0 Unported license.

ProPublica noted that when the FDA’s responsibilities expanded in the 1970s, the review times for new drug approvals began to lag to more than 35 months on the average. The AIDS crisis came soon after, leading activists to accuse the FDA of holding back cures and then press the agency for faster drug approval times. One of the then activists, now an assistant professor of epidemiology at Yale, said they were desperate back then and naively thought there were drugs behind the FDA approval curtain being held back by its slow process. “Thirty years of our rash thinking has led us to a place where we know less and less about the drugs that we pay more and more for.”

The activists’ protests helped bring about the Prescription Drug User Fee Act in 1992, which began drug industry contributions to fund FDA salaries. In return, the FDA promised to speed up review times for drugs—within 12 months for normal applications, and 6 months for priority cases. You can probably guess what happened. The more the FDA relied upon industry fees to pay for drug reviews, the greater was its tendency towards approval. “The virginity was lost in ’92,” according to Jerry Avorn, who is a professor at Harvard Medical School. “Once you have that paying relationship, it creates a dynamic that’s not a healthy one.”

In 1993 Pharma funded 27% of the FDA’s scientific review budgets for branded and generic drugs. In 2017, that had increased to 75% or $905 million. Staffers know you don’t get promoted if you aren’t pro-industry. A former FDA medical team leader said: “You don’t survive as a senior official at the FDA unless you’re pro-industry.” He added the FDA has to pay attention to what Congress says, and the industry will lobby to replace you if they don’t like you. The attitude at the agency is: “Keep Congress off your back and make your life easier.”

The FDA’s Center for Drug Evaluation and Research gives internal awards annually to review teams. Former FDA employees said they never saw an award granted to a team that rejected a drug application. Congratulatory emails are sent to review teams by higher-up administrators when a drug is approved. “Nobody gets congratulated for turning a drug down, but you get seriously questioned.” FDA rejections of all drug applications have fallen over 50% since 2008. See the following graph from the above linked article in ProPublica.

Over the past thirty years Congress authorized the FDA to implement at least four major routes to faster approvals. Initially, these pathways were supposed to be the exception to the rule, but now they seem to have become the rule.  In 1988 Congress authorized the FDA to create “fast track” regulations. In 1992 the Prescription Drug User Fee Act formalized “accelerated approval” and “priority review.” Then when the law was reauthorized in 1997, the goal for review times was lowered to ten months. Finally, in 2012, the designation of “breakthrough therapy” enabled the FDA to waive normal procedures for drugs “that showed substantial improvement over available treatments.”

Sixty-eight percent of novel drugs approved by the FDA between 2014 and 2016 qualified for one or more of these accelerated pathways, Kesselheim and his colleagues have found. Once described by Rachel Sherman, now FDA principal deputy commissioner, as a program for “knock your socks off, home run” treatments, the “breakthrough therapy” label was doled out to 28 percent of drugs approved from 2014 to 2016.

The industry’s lobbying group, Pharmaceutical Research and Manufacturers of America (PhRMA), is pressing for even faster approvals. A policy memo on its website warns of “needless delays in drug review and approval that lead to longer developmental times.” Aaron Kesselheim, an associate professor at Harvard Medical School said he thought it was reasonable to want to move drugs faster, particularly for “an extremely promising new product, which treats a serious or life-threatening disease.” When you do that, he said the key factor “is that you’ve got to make sure you closely follow the drug in a thoughtful way and unfortunately, too often we don’t do that in the U.S.” FDA approvals of novel drug applications have nearly doubled since 2008. See the following graph from the above linked article in ProPublica.

Nuplazid, a drug for hallucinations and delusions associated with Parkinson’s disease, was an example of the potential consequences from this accelerated approval process in Caroline Chen’s article for ProPublica. The drug was created in 2001 by a chemist at Acadia Pharmaceuticals. In 2009 it failed to prove its benefit over a placebo in the first of two Phase 3 clinical trials; two successful Phase 3 trials are required. The company halted the second trial and asked the FDA for permission to revise the scale used to measure benefit. They argued the original scale was typically used for schizophrenia assessments and thus wasn’t appropriate for Parkinson’s-related psychosis.

Given that Acadia didn’t raise this issue with the FDA until after its failed clinical trial, their objection seems like sour grapes to me. Why didn’t they use the revised scale from the beginning? Nevertheless, the FDA agreed to this new scale—even though it had never been used before in a study for drug approval! Then, since there were no treatments approved for Parkinson’s-related psychosis, the FDA granted Acadia’s request for break-through therapy status, meaning Nuplazid now only needed one positive Phase 3 clinical instead of two for approval. “In 2012, Acadia finally got the positive trial results it had hoped for. In a study of 199 patients, Nuplazid showed a small but statistically significant advantage over a placebo.”

An FDA medical reviewer was skeptical of Nuplazid. In analyzing all of the drug’s trial results, he calculated you would have to treat 91 patients to get seven who would receive the full benefit. Five of those 91 would suffer “serious adverse events,” including one death. He recommended against approval, citing “an unacceptably increased, drug-related, safety risk of mortality and serious morbidity.” So the FDA convened an advisory committee to help it decide. That committee eventually voted 12-2 to recommend accelerated approval.

Fifteen members of the public testified at its hearing. Three were physicians who were paid consultants for Acadia. Four worked with Parkinson’s advocacy organizations funded by Acadia. The company paid for the travel of three other witnesses who were relatives of Parkinson’s patients, and made videos shown to the committee of two other caregivers. Two speakers, the daughter and granddaughter of a woman who suffered from Parkinson’s, said they had no financial relationship with Acadia. However, the granddaughter is now a paid “brand ambassador” for Nuplazid. All begged the FDA to approve Nuplazid. . . . The only speaker who urged the FDA to reject the drug was a scientist at the National Center for Health Research who has never had any financial relationship with Acadia.

Since Nuplazid was approved in 2016, Acadia raised its price twice from the original base price of $24,000 to more than $33,000. “There have been 6,800 reports of adverse events for patients on the drug, including 887 deaths” as of March 31st of 2018. In more than 400 instances Nuplazid was associated with worsening hallucinations—“one of the very symptoms it was supposed to treat.” After a CNN report about adverse events related to Nuplazid in April of 2018, the FDA began an evaluation. There are more examples of drugs-gone-bad after approval in the article.

Although the FDA expedites drug approvals, it will wait ten years or more for the post-marketing studies manufacturers agree to do when their drug is approved. Studies on Nuplazid aren’t expected until 2021. One of the reasons post-marketing studies take so long to complete is the fact it’s harder to recruit patients to risk being given a placebo when the drug is available on the market. In addition, the manufacturer no longer has a financial incentive to study its impact since the drug is on the market and could lose money if the results are negative. “Of post-marketing studies agreed to by manufacturers in 2009 and 2010, 20 percent had not started five years later, and another 25 percent were still ongoing.”

The FDA has the authority to issue fines or pull a drug from the market if a manufacturer doesn’t meet its post-marketing requirements. “Yet the agency has never fined a company for missing a deadline.”  The agency would have the burden to show the company was dragging its feet, which could be difficult to prove. “It’d be an administrative thing that companies could contest,” according to the FDA director of the Center for Drug Evaluation and Research.

Michael Carome, the director of the health research group for Public Citizen, a nonprofit advocacy organization, said instead of a regulator and a regulated industry, we now have a partnership. “That relationship has tilted the agency away from a public health perspective to an industry friendly perspective.”

In “FDA’s revolving door,” Charles Piller pointed out how many former FDA employees end up working or consulting for the drug makers they previously regulated. There are safeguards that are supposed to prevent the prospect of industry employment from affecting an employee’s decisions while at the agency. And there are others to discourage them from exploiting relationships with former colleagues after they leave. But the reality seems to be somewhat different. Piller cited a 2016 BMJ article that found 15 of 26 FDA employees who had conducted reviews over a 9-year time period in the hematology oncology field later worked or consulted for the biopharmaceutical industry.

Science has discovered that 11 of 16 FDA medical examiners who worked on 28 drug approvals and then left the agency for new jobs are now employed by or consult for the companies they recently regulated. This can create at least the appearance of conflicts of interest.

The co-author of the 2016 BMJ study thought that weak federal restrictions and the expectation of future employment inevitably biases how FDA staffers conduct drug reviews. “When your No. 1 major employer after you leave your job is sitting across the table from you, you’re not going to be a hard-ass when you regulate. That’s just human nature.” No, that’s not human nature, it’s just plain Machiavellian behavior—whether you’re doing whatever it takes to get your drugs on the market or whether you’re trying to position yourself for a future job with Pharma as you regulate their drugs.