• Contact Us
Friday, May 27, 2022
Health Business
Advertisement
  • Home
  • News
    Ebola vaccine approved by FDA

    Covid: Fourth-dose jab trial shows good boost

    Microbiology diagnostics: Removing the Kenyan antimicrobial resistance blindfold

    Microbiology diagnostics: Removing the Kenyan antimicrobial resistance blindfold

    Food apps and online gaming driving obesity – WHO

    Food apps and online gaming driving obesity – WHO

    Hepatitis detected in nearly 300 children worldwide

    Hepatitis detected in nearly 300 children worldwide

  • Events
  • Private
    • KHF
    • Providers
  • Government
    • Medical Research
    • Politics & Policy
    • Regulation, Enforcement & Compliance
  • Finance
  • Tech
  • Epaper
  • Videos
  • Home
  • News
    Ebola vaccine approved by FDA

    Covid: Fourth-dose jab trial shows good boost

    Microbiology diagnostics: Removing the Kenyan antimicrobial resistance blindfold

    Microbiology diagnostics: Removing the Kenyan antimicrobial resistance blindfold

    Food apps and online gaming driving obesity – WHO

    Food apps and online gaming driving obesity – WHO

    Hepatitis detected in nearly 300 children worldwide

    Hepatitis detected in nearly 300 children worldwide

  • Events
  • Private
    • KHF
    • Providers
  • Government
    • Medical Research
    • Politics & Policy
    • Regulation, Enforcement & Compliance
  • Finance
  • Tech
  • Epaper
  • Videos
No Result
View All Result
Health Business
No Result
View All Result

Only one in ten medical treatments are backed by high-quality evidence

by Health Business
September 8, 2020
in News
0
Only one in ten medical treatments are backed by high-quality evidence
Share This:
Jeremy Howick, University of Oxford

When you visit your doctor, you might assume that the treatment they prescribe has solid evidence to back it up. But you’d be wrong. Only one in ten medical treatments are supported by high-quality evidence, our latest research shows.

The analysis, which is published in the Journal of Clinical Epidemiology, included 154 Cochrane systematic reviews published between 2015 and 2019. Only 15 (9.9%) had high-quality evidence according to the gold-standard method for determining whether they provide high or low-quality evidence, called GRADE (grading of recommendations, assessment, development and evaluation). Among these, only two had statistically significant results – meaning that the results were unlikely to have arisen due to random error – and were believed by the review authors to be useful in clinical practice. Using the same system, 37% had moderate, 31% had low, and 22% had very low-quality evidence.

The GRADE system looks at things like risk of bias. For example, studies that are “blinded” – in which patients don’t know whether they are getting the actual treatment or a placebo – offer higher-quality evidence than “unblinded” studies. Blinding is important because people who know what treatment they are getting can experience greater placebo effects than those who do not know what treatment they are getting.

Among other things, GRADE also considers whether the studies were imprecise because of differences in the way the treatment was used. In the 2016 review, researchers found that 13.5% – about one in seven – reported that treatments were supported by high-quality evidence. Lack of high-quality evidence, according to GRADE, means that future studies might overturn the results.

The 154 studies were chosen because they were updates of a previous review of 608 systematic reviews, conducted in 2016. This allows us to check whether reviews that had been updated with new evidence had higher-quality evidence. They didn’t. In the 2016 study, 13.5% reported that treatments were supported by high-quality evidence, so there was a trend towards lower quality as more evidence was gathered.

There were a few limitations to the study. First, the sample size in the study may not have been representative, and other studies have found that over 40% of medical treatments are likely to be effective. Also, the sample in the study was not large enough to check whether there were certain types of medical treatments (pharmacological, surgical, psychological) that were better than others. It is also possible that the “gold standard” for ranking evidence (GRADE) is too strict.

Too many low-quality studies

Many poor-quality trials are being published, and our study merely reflected this. Because of the pressure to “publish or perish” to survive in academia, more and more studies are being done. In PubMed alone – a database of published medical papers – more than 12,000 new clinical trials are published every year. That’s 30 trials published every day. Systematic reviews were designed to synthesise these, but now there are too many of those, too: over 2,000 per year published in PubMed alone.

The evidence-based medicine movement has been banging a drum about the need to improve the quality of research for more than 30 years, but, paradoxically, there is no evidence that things have improved despite a proliferation of guidelines and guidance.

In 1994, Doug Altman, a professor of statistics in medicine at Oxford University, pleaded for less, but better, research. This would have been good, but the opposite has happened. Inevitably, the tsunami of trials published every year, combined with the need to publish in order to survive in academia, has led to a great deal of rubbish being published, and this has not changed over time.

Poor-quality evidence is serious: without good evidence, we simply can’t be sure that the treatments we use work.

Dr Leo Spaceman from the TV comedy 30 Rock saying:
It was meant to be a joke.
Twitter

GRADE system too harsh

A carpenter should only blame their tools as a last resort, so the excuse that GRADE doesn’t work should be only be used cautiously. Yet it’s probably true that the GRADE system is too harsh for some contexts. For example, it is near impossible for any trial evaluating a particular exercise regime to be of high quality.

An exercise trial cannot be “blinded”: anyone doing exercise will know they are in the exercise group, while those in the control group will know they are not doing exercise. Also, it is hard to make large groups of people do exactly the same exercise, whereas it is easier to make everyone take the same pill. These inherent problems condemn exercise trials to being judged to be of lower quality, no matter how useful safe exercise is.

Also, our method was strict. Whereas the systematic reviews had many outcomes (each of which could be high quality), we focused on the primary outcomes. For example, the primary outcome in a review of painkillers would be a reduction in pain. Then they might also measure a range of secondary outcomes, ranging from anxiety reduction to patient satisfaction.

Focusing on the primary outcomes prevents spurious findings. If we look at many outcomes, there is a danger that one of them will be high quality just by chance. To mitigate this, we looked at whether any outcome – even if it wasn’t the primary outcome. We found that one in five treatments had high-quality evidence for any outcome.

On average, most of the medical treatments whose effectiveness has been tested in systematic reviews are not supported by high-quality evidence. We need less, but better, research to address uncertainties so that we can become more confident that the treatments we take work.The Conversation

Jeremy Howick, Director of the Oxford Empathy Programme, University of Oxford

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Share This:
Previous Post

Is body weight affected by when you eat? Here's what science knows so far

Next Post

Weekly injection could treat type 2 diabetes, new enzyme discovery suggests

Related Posts

Ebola vaccine approved by FDA
News

Covid: Fourth-dose jab trial shows good boost

May 12, 2022
Microbiology diagnostics: Removing the Kenyan antimicrobial resistance blindfold
News

Microbiology diagnostics: Removing the Kenyan antimicrobial resistance blindfold

May 12, 2022
Food apps and online gaming driving obesity – WHO
News

Food apps and online gaming driving obesity – WHO

May 5, 2022
Next Post
Weekly injection could treat type 2 diabetes, new enzyme discovery suggests

Weekly injection could treat type 2 diabetes, new enzyme discovery suggests

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

No Result
View All Result

Follow Us

Most Read

  • Microbiology diagnostics: Removing the Kenyan antimicrobial resistance blindfold

    Microbiology diagnostics: Removing the Kenyan antimicrobial resistance blindfold

    0 shares
    Share 0 Tweet 0
  • Understanding of low back pain with recent evidence

    0 shares
    Share 0 Tweet 0
  • Menopause: what are the symptoms and why does it happen?

    0 shares
    Share 0 Tweet 0
Health Business

Health Business contains need-to-know features, news and case studies that explain the administrative and commercial issues affecting healthcare and hospital management. Health Business supports several high profile exhibitions - coverage of which is always timed for maximum impact. Regular topics include ICT, Finance/Funding, Facilities Management, Security, Health & Safety. Contributors range from government ministers through to top-level health administrators and association chairs.

Top Stories

Ebola vaccine approved by FDA

Covid: Fourth-dose jab trial shows good boost

May 12, 2022
Microbiology diagnostics: Removing the Kenyan antimicrobial resistance blindfold

Microbiology diagnostics: Removing the Kenyan antimicrobial resistance blindfold

May 12, 2022
Food apps and online gaming driving obesity – WHO

Food apps and online gaming driving obesity – WHO

May 5, 2022

Interests

  • Events
  • Finance
  • Government
  • Magazines
  • Medical Research
  • News
  • Politics & Policy
  • Providers
  • Public Health
  • Regulation, Enforcement & Compliance
  • Technology
  • Videos

Follow Us

  • Contact Us

© 2019 | Site by Mark & Ryse.

No Result
View All Result
  • Home
  • News
  • Events
  • Private
    • KHF
    • Providers
  • Government
    • Medical Research
    • Politics & Policy
    • Regulation, Enforcement & Compliance
  • Finance
  • Tech
  • Epaper
  • Videos

© 2019 | Site by Mark & Ryse.