{"id":3698,"date":"2015-03-12T15:37:58","date_gmt":"2015-03-12T15:37:58","guid":{"rendered":"https:\/\/www.hri-research.org\/?p=3698"},"modified":"2022-03-08T14:36:54","modified_gmt":"2022-03-08T14:36:54","slug":"nhmrc-publishes-flawed-report-despite-concerns-raised-during-public-consultation","status":"publish","type":"post","link":"https:\/\/www.hri-research.org\/ru\/2015\/03\/nhmrc-publishes-flawed-report-despite-concerns-raised-during-public-consultation\/","title":{"rendered":"Australia&#8217;s NHMRC publishes flawed report despite concerns raised during public consultation"},"content":{"rendered":"<p>Although the HRI welcomes thorough research in homeopathy, only studies carried out using appropriate and rigorous scientific methods can produce meaningful results.\u00a0We therefore lament the recent publication by Australia&#8217;s\u00a0National Health\u00a0and Medical\u00a0Research Council (NHMRC), which fails to meet this standard.<\/p>\n<p>During a public consultation on the draft version of this report, HRI and others highlighted\u00a0deep flaws in how the NHMRC had analysed the evidence on homeopathy. None of these serious problems were addressed in the final publication.\u00a0This raises questions as to\u00a0whether the public consultation was ever meant to have any impact on the final report, leading to serious concerns about the conduct of this governmental body.<\/p>\n<p>We maintain that the conclusions of the NHMRC report are inconsistent with the evidence.<\/p>\n<p>The inaccuracy of the NHMRCs conclusions stem primarily from one\u00a0fundamental flaw at the heart of this report &#8212; the NHMRC reviewers considered the results of all trials for one condition together as a whole, even though the individual trials were assessing very different types of homeopathic treatment.<\/p>\n<p>To illustrate this flaw, the NHMRC reviewers asked, \u201cIs homeopathy effective for condition A?\u2019, working from the premise that a positive trial showing that one homeopathic treatment is effective is somehow negated by a negative trial which shows that a completely different homeopathic treatment for that same condition is ineffective. This is a bizarre and unprecedented way of assessing scientific evidence. In conventional research the question asked would be, \u201cIs treatment X effective for condition A?\u201d, not \u201cIs conventional medicine effective for condition A?\u201d based on combining the results of all drug trials together. Some treatments work, some don\u2019t. The whole point of medical research is to establish which treatments are useful and which are of no value. This is no different in homeopathy.<\/p>\n<p>This single methodological\u00a0flaw explains why the NHMRCs has failed to find any \u2018reliable\u2019 evidence that homeopathy is effective for any of the 61 conditions under consideration.<\/p>\n<p>Secondly, we are deeply perplexed as to the reasons for the exclusion of some of the best evidence for key clinical conditions. In brief:<\/p>\n<ul>\n<li>Jacobs et al performed meta-analysis a meta-analysis of the treatment of childhood diarrhea using homeopathy in 2003, N=242 in placebo controlled trials, p-value = 0.008. This meta-analysis\u00a0was excluded &#8230; why? [<a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/12634583\">Link<\/a>]<\/li>\n<li>Wiesenauer &amp; L\u00fcdtke conducted a meta-analysis into the treatment of hayfever in 1996, N=752 in placebo controlled RCTs, p-value &lt;0.0001. This meta-analysis was excluded. Again we ask ourselves why? [<a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/9381725\">Link<\/a>]<\/li>\n<li>Schneider et al conducted a meta-analysis of non-inferiority trials of homeopathy compared to usual care for the treatment of vertigo, N=1388, non-inferiority was clearly demonstrated. Again excluded, again why? [<a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/15727161\">Link<\/a>]<\/li>\n<\/ul>\n<p>A Cochrane review by Mathie et al inspected the evidence for the treatment of influenza using homeopathy concluded in favor of homeopathy (N=1259, placebo RCTs, p=0.001) yet this evidence was simply ignored in the final conclusions on the grounds of possible bias in the underlying studies [<a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/25629583\">Link<\/a>].<\/p>\n<p>The NHMRC also need to justify their use of N=150 as a line between reliable and unreliable trials and they certainly need to explain why size is relevant at all when the findings are statistically significant.<\/p>\n<p>Furthermore we do not see how there could be any justification for the absence of a homeopathy expert on the NHMRC review board. The presence of such an expert would potentially have prevented many of the issues raised here and would definitely have reassured the public about allegations of bias on the part of the NHMRC.<\/p>\n<p>We note that the conclusions of the NHMRC report are at odds with the conclusions of the recent extensive meta-analysis of RCTs using homeopathy performed by Mathie and co-workers which concludes in favour of an effect of homeoapthy[<a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/25480654\">Link<\/a>].<\/p>\n<p>The HRI does not dispute the fact that there are few high-quality, positive studies in homeopathy and that these need independent replication, but we do dispute the NHMRC\u2019s failure to identify these positive studies in their Information Paper as promising studies which should be repeated.<\/p>\n<p>Despite the considerable means spent on this report and great profession of due process and absence of bias, as demonstrated above the NHMRC has failed both in terms of the process they used and in the fairness of their assessment of the evidence.<\/p>\n<p>&nbsp;<\/p>\n<p>The NHMRC documents, including the final statement, can be found <a href=\"https:\/\/www.nhmrc.gov.au\/about-us\/resources\/homeopathy\" target=\"_blank\" rel=\"noopener noreferrer\">here.<\/a><\/p>\n<p>The HRI&#8217;s response to the initial draft\u00a0can be found <a href=\"https:\/\/www.hri-research.org\/wp-content\/uploads\/2014\/10\/HRI-Response-to-Australian-NHMRC-Report-2014.pdf\">here<\/a>, and our submission to the NHMRC can be found <a href=\"https:\/\/www.hri-research.org\/wp-content\/uploads\/2014\/07\/HRI-Submission-to-NHMRC-public-consultation-draft-Information-Paper-on-homeopathy.pdf\">here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Although the HRI welcomes thorough research in homeopathy, only studies carried out using appropriate and rigorous scientific methods can produce meaningful results.\u00a0We therefore lament the recent publication by Australia&#8217;s\u00a0National Health\u00a0and Medical\u00a0Research Council (NHMRC), which fails to meet this standard. During a public consultation on the draft version of this report, HRI and others highlighted\u00a0deep flaws [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[18],"tags":[],"class_list":["post-3698","post","type-post","status-publish","format-standard","hentry","category-press-releases"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.hri-research.org\/ru\/wp-json\/wp\/v2\/posts\/3698","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hri-research.org\/ru\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hri-research.org\/ru\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hri-research.org\/ru\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hri-research.org\/ru\/wp-json\/wp\/v2\/comments?post=3698"}],"version-history":[{"count":0,"href":"https:\/\/www.hri-research.org\/ru\/wp-json\/wp\/v2\/posts\/3698\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.hri-research.org\/ru\/wp-json\/wp\/v2\/media?parent=3698"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hri-research.org\/ru\/wp-json\/wp\/v2\/categories?post=3698"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hri-research.org\/ru\/wp-json\/wp\/v2\/tags?post=3698"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}