Misrepresentation of Randomized Controlled Trials in Press Releases and News Coverage: A Cohort Study

English version České info

Background:
Previous studies indicate that in published reports, trial results can be distorted by the use of “spin” (specific reporting strategies, intentional or unintentional, emphasizing the beneficial effect of the experimental treatment). We aimed to (1) evaluate the presence of “spin” in press releases and associated media coverage; and (2) evaluate whether findings of randomized controlled trials (RCTs) based on press releases and media coverage are misinterpreted.

Methods and Findings:
We systematically searched for all press releases indexed in the EurekAlert! database between December 2009 and March 2010. Of the 498 press releases retrieved and screened, we included press releases for all two-arm, parallel-group RCTs (n = 70). We obtained a copy of the scientific article to which the press release related and we systematically searched for related news items using Lexis Nexis.

“Spin,” defined as specific reporting strategies (intentional or unintentional) emphasizing the beneficial effect of the experimental treatment, was identified in 28 (40%) scientific article abstract conclusions and in 33 (47%) press releases. From bivariate and multivariable analysis assessing the journal type, funding source, sample size, type of treatment (drug or other), results of the primary outcomes (all nonstatistically significant versus other), author of the press release, and the presence of “spin” in the abstract conclusion, the only factor associated, with “spin” in the press release was “spin” in the article abstract conclusions (relative risk [RR] 5.6, [95% CI 2.8–11.1], p<0.001). Findings of RCTs based on press releases were overestimated for 19 (27%) reports. News items were identified for 41 RCTs; 21 (51%) were reported with “spin,” mainly the same type of “spin” as those identified in the press release and article abstract conclusion. Findings of RCTs based on the news item was overestimated for ten (24%) reports.

Conclusion:
“Spin” was identified in about half of press releases and media coverage. In multivariable analysis, the main factor associated with “spin” in press releases was the presence of “spin” in the article abstract conclusion.

Vyšlo v časopise: Misrepresentation of Randomized Controlled Trials in Press Releases and News Coverage: A Cohort Study. PLoS Med 9(9): e32767. doi:10.1371/journal.pmed.1001308
Kategorie: Research Article
prolekare.web.journal.doi_sk: https://doi.org/10.1371/journal.pmed.1001308

Souhrn

Zdroje

1. SchwartzLM, WoloshinS (2004) The media matter: a call for straightforward medical reporting. Ann Intern Med 140: 226–228.

2. Jaques H (2011) BMJ Careers - get your research reported well in the news. Available: http://careers.bmj.com/careers/advice/view-article.html?id=20001805. Accessed 8 August 2012.

3. Incomplete reporting of research in academic press releases. Lancet 373: 1920.

4. WoloshinS, SchwartzLM (2002) Press releases: translating research into news. JAMA 287: 2856–2858.

5. van TrigtAM, de Jong-van den BergLT, Haaijer-RuskampFM, WillemsJ, TrompTF (1994) Journalists and their sources of ideas and information on medicines. Soc Sci Med 38: 637–643.

6. KuriyaB, SchneidEC, BellCM (2008) Quality of pharmaceutical industry press releases based on original research. PLoS One 3: e2828 doi:10.1371/journal.pone.0002828.

7. ChapmanS, NguyenTN, WhiteC (2007) Press-released papers are more downloaded and cited. Tob Control 16: 71.

8. EntwistleV (1995) Reporting research in medical journals and newspapers. BMJ 310: 920–923.

9. WoloshinS, SchwartzLM, KramerBS (2009) Promoting healthy skepticism in the news: helping journalists get it right. J Natl Cancer Inst 101: 1596–1599.

10. SackettDL, RosenbergWM, GrayJA, HaynesRB, RichardsonWS (1996) Evidence based medicine: what it is and what it isn't. BMJ 312: 71–72.

11. PhillipsDP, KanterEJ, BednarczykB, TastadPL (1991) Importance of the lay press in the transmission of medical knowledge to the scientific community. N Engl J Med 325: 1180–1183.

12. BoutronI, DuttonS, RavaudP, AltmanDG (2010) Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA 303: 2058–2064.

13. WoloshinS, SchwartzLM, CasellaSL, KennedyAT, LarsonRJ (2009) Press releases by academic medical centers: not so academic? Ann Intern Med 150: 613–618.

14. Als-NielsenB, ChenW, GluudC, KjaergardLL (2003) Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA 290: 921–928.

15. SchwartzLM, WoloshinS (2002) News media coverage of screening mammography for women in their 40 s and tamoxifen for primary prevention of breast cancer. JAMA 287: 3136–3142.

16. ZouG (2004) A modified poisson regression approach to prospective studies with binary data. Am J Epidemiol 159: 702–706.

17. AustinPC, TuJV (2004) Bootstrap methods for developing predictive models. The American Statistician 58: 131–137.

18. HaasJS, KaplanCP, GerstenbergerEP, KerlikowskeK (2004) Changes in the use of postmenopausal hormone therapy after the publication of clinical trial results. Ann Intern Med 140: 184–188.

19. GrilliR, RamsayC, MinozziS (2002) Mass media interventions: effects on health services utilisation. Cochrane Database Syst Rev CD000389.

20. SharmaV, DowdMD, SwansonDS, SlaughterAJ, SimonSD (2003) Influence of the news media on diagnostic testing in the emergency department. Arch Pediatr Adolesc Med 157: 257–260.

21. SchwartzLM, WoloshinS, WelchHG (1999) Misunderstandings about the effects of race and sex on physicians' referrals for cardiac catheterization. N Engl J Med 341: 277–279.

22. MoynihanR, BeroL, Ross-DegnanD, HenryD, LeeK, et al. (2000) Coverage by the news media of the benefits and risks of medications. N Engl J Med 342: 1645–1650.

23. NaylorCD, ChenE, StraussB (1992) Measured enthusiasm: does the method of reporting trial results alter perceptions of therapeutic effectiveness? Ann Intern Med 117: 916–921.

24. SchwartzLM, WoloshinS, AndrewsA, StukelTA (2012) Influence of medical journal press releases on the quality of associated newspaper coverage: retrospective cohort study. BMJ 344: d8164.

25. HopewellS, ClarkeM, MoherD, WagerE, MiddletonP, et al. (2008) CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med 5: e20 doi:10.1371/journal.pmed.0050020.

26. GøtzschePC (2006) Believability of relative risks and odds ratios in abstracts: cross sectional study. BMJ 333: 231–234.

27. HortonR (2002) The hidden research paper. JAMA 287: 2775–2778.