Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

The New Coffee Room

  1. TNCR
  2. General Discussion
  3. Follow the science?

Follow the science?

Scheduled Pinned Locked Moved General Discussion
4 Posts 4 Posters 44 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • George KG Offline
    George KG Offline
    George K
    wrote on last edited by
    #1

    What science?

    https://www.jclinepi.com/article/S0895-4356(22)00100-7/fulltext


    Objective

    To estimate the proportion of healthcare interventions tested within Cochrane Reviews that are effective according to high-quality evidence.

    Methods

    We selected a random sample of 2,428 (35%) of all Cochrane Reviews published between 1 January 2008 and 5 March 2021. We extracted data about interventions within these reviews that were compared with placebo, or no treatment, and whose outcome quality was rated using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system. We calculated the proportion of interventions whose benefits were based on high-quality evidence (defined as having high quality GRADE rating for at least one primary outcome, statistically significant positive results, and being judged by review authors as effective. We also calculated the proportion of interventions that suggested harm.

    Results

    Of 1,567 eligible interventions, 87 (5.6%) had high-quality evidence supporting their benefits. Harms were measured for 577 (36.8%) interventions. There was statistically significant evidence for harm in 127 (8.1%) of these. Our dependence on the reliability of Cochrane author assessments (including their GRADE assessments) was the main potential limitation of our study.

    Conclusion

    More than 9 in 10 healthcare interventions studied within recent Cochrane Reviews are not supported by high-quality evidence, and harms are under-reported.

    =-=-=-=-

    Highlights

    • In this large sample of 1,567 interventions studied within Cochrane reviews, effects of most interventions (94%) interventions were not supported by high-quality evidence.
    • Potential harms of healthcare interventions were measured more rarely than benefits.
    • Patients, doctors, and policy makers should consider the lack of high-quality evidence supporting the benefits and harms of many interventions in their decision-making.

    "Now look here, you Baltic gas passer... " - Mik, 6/14/08

    The saying, "Lite is just one damn thing after another," is a gross understatement. The damn things overlap.

    CopperC 1 Reply Last reply
    • JollyJ Offline
      JollyJ Offline
      Jolly
      wrote on last edited by
      #2

      Treat the patient, not the statistic.

      “Cry havoc and let slip the DOGE of war!”

      Those who cheered as J-6 American prisoners were locked in solitary for 18 months without trial, now suddenly fight tooth and nail for foreign terrorists’ "due process". — Buck Sexton

      1 Reply Last reply
      • George KG George K

        What science?

        https://www.jclinepi.com/article/S0895-4356(22)00100-7/fulltext


        Objective

        To estimate the proportion of healthcare interventions tested within Cochrane Reviews that are effective according to high-quality evidence.

        Methods

        We selected a random sample of 2,428 (35%) of all Cochrane Reviews published between 1 January 2008 and 5 March 2021. We extracted data about interventions within these reviews that were compared with placebo, or no treatment, and whose outcome quality was rated using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system. We calculated the proportion of interventions whose benefits were based on high-quality evidence (defined as having high quality GRADE rating for at least one primary outcome, statistically significant positive results, and being judged by review authors as effective. We also calculated the proportion of interventions that suggested harm.

        Results

        Of 1,567 eligible interventions, 87 (5.6%) had high-quality evidence supporting their benefits. Harms were measured for 577 (36.8%) interventions. There was statistically significant evidence for harm in 127 (8.1%) of these. Our dependence on the reliability of Cochrane author assessments (including their GRADE assessments) was the main potential limitation of our study.

        Conclusion

        More than 9 in 10 healthcare interventions studied within recent Cochrane Reviews are not supported by high-quality evidence, and harms are under-reported.

        =-=-=-=-

        Highlights

        • In this large sample of 1,567 interventions studied within Cochrane reviews, effects of most interventions (94%) interventions were not supported by high-quality evidence.
        • Potential harms of healthcare interventions were measured more rarely than benefits.
        • Patients, doctors, and policy makers should consider the lack of high-quality evidence supporting the benefits and harms of many interventions in their decision-making.

        CopperC Offline
        CopperC Offline
        Copper
        wrote on last edited by
        #3

        @George-K said in Follow the science?:

        • Potential harms of healthcare interventions were measured more rarely than benefits.

        Was there any question about this?

        Isn't this the whole idea?

        1 Reply Last reply
        • MikM Offline
          MikM Offline
          Mik
          wrote on last edited by
          #4

          How exactly were interventions defined and selected? It feels like the outcome is like only looking at the tip of the iceberg while the bulk of relevant information is unseen.

          "The intelligent man who is proud of his intelligence is like the condemned man who is proud of his large cell." Simone Weil

          1 Reply Last reply
          Reply
          • Reply as topic
          Log in to reply
          • Oldest to Newest
          • Newest to Oldest
          • Most Votes


          • Login

          • Don't have an account? Register

          • Login or register to search.
          • First post
            Last post
          0
          • Categories
          • Recent
          • Tags
          • Popular
          • Users
          • Groups