Meta-analyses of Adverse Effects Data Derived from Randomised Controlled Trials as Compared to Observational Studies: Methodological Overview

1. ChouRHelfandM

2005

Challenges in systematic reviews that assess treatment

harms.

Ann Intern Med

142

1090

1099

2. MittmannNLiuBAKnowlesSRShearNH

1999

Meta-analysis and adverse drug reactions.

CMAJ

160

987

988

3. IoannidisJPMulrowCDGoodmanSN

2006

Adverse events: the more you search, the more you

find.

Ann Intern Med

144

298

300

4. LevineMWalterSLeeHHainesTHolbrookA

1994

User's guides to the medical literature, IV: how to use an

article about harm.

JAMA

271

1615

1619

5. MeadeMOCookDJKernermanPBernardG

1997

How to use articles about harm: the relationship between high

tidal volumes, ventilating pressures, and ventilator-induced lung

injury.

Crit Care Med

25

1915

1922

6. PapanikolaouPNChristidiGDIoannidisJPA

2006

Comparison of evidence on harms of medical interventions in

randomized and nonrandomized studies.

CMAJ

174

635

641

7. PriceDJeffersonTDemicheliV

2004

Methodological issues arising from systematic reviews of the

evidence of safety of vaccines.

Vaccine

22

2080

2084

8. AnelloC

1996

Does research synthesis have a place in drug regulatory policy?

synopsis of issues: assessment of safety and postmarketing

surveillance.

Clin Res Reg Aff

13

13

21

9. JacobRFLloydPM

2000

How to evaluate a dental article about harm.

J Prosthet Dent

84

8

16

10. KallenBAJ

2005

Methodological issues in the epidemiological study of the

teratogenicity of drugs.

Congenit Anom (Kyoto)

45

44

51

11. PedersenATOttesenB

2003

Issues to debate on the Women's Health Initiative (WHI)

study. Epidemiology or randomized clinical trials—time out for hormone

replacement therapy studies?

Hum Reprod

18

2241

2244

12. SackettDLHaynesRBGuyattGHTugwellP

1991

Clinical epidemiology.

London

Little, Brown and Company

13. SkeggDC

2001

Evaluating the safety of medicines, with particular reference to

contraception.

Stat Med

20

3557

3569

14. BrewerTColditzGA

1999

Postmarketing surveillance and adverse drug reactions: current

perspectives and future needs.

JAMA

281

824

829

15. EggerMSchneiderMDavey SmithG

1998

Spurious precision? Meta-analysis of observational

studies.

BMJ

316

140

144

16. StrausSERichardsonWSGlasziouPHaynesRB

2005

Evidence-based medicine: how to practice and teach

EBM.

London

Elsevier

17. RothwellPM

2005

External validity of randomised controlled trials: “to whom

do the results of this trial apply?”.

Lancet

365

82

93

18. EdwardsJEMcQuayHJMooreRACollinsSL

1999

Reporting of adverse effects in clinical trials should be

improved: lessons from acute postoperative pain.

J Pain Symptom Manage

18

427

437

19. PapanikolaouPNIoannidisJP

2004

Availability of large-scale evidence on specific harms from

systematic reviews of randomized trials.

Am J Med

117

582

589

20. IoannidisJPLauJ

2001

Completeness of safety reporting in randomized trials: an

evaluation of 7 medical areas.

JAMA

285

437

443

21. LokeYKDerryS

2001

Reporting of adverse drug reactions in randomised controlled

trials—a systematic survey.

BMC Clin Pharmacol

1

3

22. IoannidisJPEvansSJGotzschePCO'NeillRTAltmanDG

2004

Better reporting of harms in randomized trials: an extension of

the CONSORT statement.

Ann Intern Med

141

781

788

23. LevyJH

1999

Adverse drug reactions in hospitalized patients. The Adverse Reactions

Source. Available: http://adversereactions.com/reviewart.htm. Accessed 17 March

2011

24. PapanikolaouPNChurchillRWahlbeckKIoannidisJP

2004

Safety reporting in randomized trials of mental health

interventions.

Am J Psychiatry

161

1692

1697

25. IoannidisJPContopoulos-IoannidisDG

1998

Reporting of safety data from randomised trials.

Lancet

352

1752

1753

26. CuervoGLClarkeM

2003

Balancing benefits and harms in health care.

BMJ

327

65

66

27. NuovoJSatherC

2007

Reporting adverse events in randomized controlled

trials.

Pharmacoepidemiol Drug Saf

16

349

351

28. EthgenMBoutronIBaronGGiraudeauBSibiliaJ

2005

Reporting of harm in randomized, controlled trials of

nonpharmacologic treatment for rheumatic disease.

Ann Intern Med

143

20

25

29. LeePEFischerbHDRochonbPAGillbSSHerrmanngN

2008

Published randomized controlled trials of drug therapy for

dementia often lack complete data on harm J Clin Epidemiol

61

1152

1160

30. YaziciY

2008

Some concerns about adverse event reporting in randomized

clinical trials.

Bull NYU Hosp Jt Dis

66

143

145

31. GartlehnerGThiedaPHansenRAMorganLCShumateJA

2009

Inadequate reporting of trials compromises the applicability of

systematic reviews.

Int J Technol Assess Health Care

25

323

330

32. RiefWNestoriucYvon Lilienfeld-ToalADoganISchreiberF

2009

Differences in adverse effect reporting in placebo groups in SSRI

and tricyclic antidepressant trials: a systematic review and

meta-analysis.

Drug Saf

32

1041

1056

33. HenryDHillS

1999

Meta-analysis-its role in assessing drug safety.

Pharmacoepidemiol Drug Saf

8

167

168

34. BuekensP

2001

Invited commentary: rare side effects of obstetric interventions:

are observational studies good enough?

[comment] Am J Epidemiol

153

108

109

35. ClarkeADeeksJJShakirSA

2006

An assessment of the publicly disseminated evidence of safety

used in decisions to withdraw medicinal products from the UK and US

markets.

Drug Saf

29

175

181

36. DieppePBartlettCDaveyPDoyalLEbrahimS

2004

Balancing benefits and harms: the example of non-steroidal

anti-inflammatory drugs.

BMJ

329

31

34

37. EtminanMCarletonBRochonPA

2004

Quantifying adverse drug events: are systematic reviews the

answer?

Drug Saf

27

757

761

38. GuttermanEM

2004

Pharmacoepidemiology in safety evaluations of newly approved

medications.

Drug Inf J

38

61

67

39. HallWDLuckeJ

2006

How have the selective serotonin reuptake inhibitor

antidepressants affected suicide mortality?

Aust N Z J Psychiatry

40

941

950

40. HughesMDWilliamsPL

2007

Challenges in using observational studies to evaluate adverse

effects of treatment.

New Engl J Med

356

1705

1707

41. HyrichKL

2005

Assessing the safety of biologic therapies in rheumatoid

arthritis: the challenges of study design.

J

Rheumatol

Suppl 72

48

50

42. JeffersonTDemicheliV

1999

Relation between experimental and non-experimental study designs.

HB vaccines: a case study.

J Epidemiol Comm Health

53

51

54

43. JeffersonTTraversaG

2002

Hepatitis B vaccination: risk-benefit profile and the role of

systematic reviews in the assessment of causality of adverse events

following immunisation.

J Med Virol

67

451

453

44. KaufmanDWShapiroS

2000

Epidemiological assessment of drug-induced

disease.

Lancet

356

1339

1343

45. BeardKLeeA

2006

Introduction.

LeeA

Adverse drug reactions, 2nd ed

London

Pharmaceutical Press

46. LokeYKPriceDHerxheimerA

Cochrane Adverse Effects Methods Group

2007

Systematic reviews of adverse effects: framework for a structured

approach.

BMC Med Res Methodol

7

32

47. OlssonSMeyboomR

2006

Pharmacovigilance.

MulderGJDenckerL

Pharmaceutical toxicology: safety sciences of drugs

London

Pharmaceutical Press

229

241

48. RayWA

2003

Population-based studies of adverse drug effects.

N Engl J Med

349

1592

1594

49. VitielloBRiddleMAGreenhillLLMarchJSLevineJ

2003

How can we improve the assessment of safety in child and

adolescent psychopharmacology?

J Am Acad Child Adolesc Psychiatry

42

634

641

50. VandenbrouckeJP

2004

Benefits and harms of drug treatments.

BMJ

329

2

3

51. VandenbrouckeJP

2004

When are observational studies as credible as randomised

trials?

Lancet

363

1728

1731

52. VandenbrouckeJP

2006

What is the best evidence for determining harms of medical

treatment?

CMAJ

174

645

646

53. AagaardLHansenEH

2009

Information about ADRs explored by pharmacovigilance approaches:

a qualitative review of studies on antibiotics, SSRIs and

NSAIDs.

BMC Clin Pharmacol

9

1

31

54. AhmadSR

2003

Adverse drug event monitoring at the food and drug

administration: your report can make a difference.

J Gen Intern Med

18

57

60

55. RavaudPTubachF

2005

Methodology of therapeutic trials: lessons from the late evidence

of the cardiovascular toxicity of some coxibs.

Joint Bone Spine

72

451

455

56. Hordijk-TrionMLenzenMWijnsWde JaegerePSimoonsML

2006

Patients enrolled in coronary intervention trials are not

representative of patients in clinical practice: results from the Euro Heart

Survey on Coronary Revascularization.

Eur Heart J

27

671

678

57. TramerMRMooreRAReynoldsDJMcQuayHJ

2000

Quantitative estimation of rare adverse events which follow a

biological progression: a new model applied to chronic NSAID

use.

Pain

85

169

182

58. McDonaghMPetersonKCarsonS

2006

The impact of including non-randomized studies in a systematic

review: a case study [abstract].

Abstract P084. 14th Cochrane Colloquium; 2006 October 23-26; Dublin,

Ireland

59. PsatyBMKoepsellTDLinDWeissNSSiscovickDS

1999

Assessment and control for confounding by indication in

observational studies.

J Am Geriatr Soc

47

749

754

60. ReevesBC

2008

Principles of research: limitations of non-randomized

studies.

Surgery

26

120

124

61. StrickerBHPsatyBM

2004

Detection, verification, and quantification of adverse drug

reactions.

BMJ

329

44

47

62. VandenbrouckeJP

2008

Observational research, randomised trials, and two views of

medical science.

PLoS Med

5

e67

doi:10.1371/journal.pmed.0050067

63. BrittonAMcKeeMBlackNMcPhersonKSandersonC

1998

Choosing between randomised and non-randomised studies: a

systematic review.

Health Technol Assess

2

1

124

64. ConcatoJShahNHorwitzRI

2000

Randomised, controlled trials, observational studies, and the

hierarchy of research designs.

N Engl J Med

342

1887

1892

65. IoannidisJPHaidichABPappaMPantazisNKokoriSI

2001

Comparison of evidence of treatment effects in randomised and

non-randomised studies.

JAMA

286

821

830

66. MacLehoseRRReevesBCHarveyIMSheldonTARussellIT

2000

A systematic review of comparisons of effect sizes derived from

randomised and non-randomised studies.

Health Technol Assess

4

67. ShepherdJBagnallA-MColquittJDinnesJDuffyS

2006

Sometimes similar, sometimes different: a systematic review of

meta-analyses of random and non-randomized policy intervention

studies.

Abstract P085. 14th Cochrane Colloquium; 2006 October 23-26; Dublin,

Ireland

68. ShikataSNakayamaTNoguchiYTajiYYamagishiH

2006

Comparison of effects in randomized controlled trials with

observational studies in digestive surgery.

Ann Surg

244

668

676

69. OliverSBagnallAMThomasJShepherdJSowdenA

2010

Randomised controlled trials for policy interventions: a review

of reviews and meta-regression.

Health Technol Assess

14

1

192

70. BerlinJAColditzGA

1999

The role of meta-analysis in the regulatory process for foods,

drugs and devices.

JAMA

28

830

834

71. KramerBSWilentzJAlexanderDBurklowJFriedmanLM

2006

Getting it right: being smarter about clinical

trials.

PLoS Med

3

e144

doi:10.1371/journal.pmed.0030144

72. HenryDMoxeyAO'ConnellD

2001

Agreement between randomized and non-randomized studies: the

effects of bias and confounding [poster

presentation].

9th Chochrane Colloqium. 2001 October 9-13; Lyon, France

73. MartinG

2005

Conflicting clinical trial data: a lesson from

albumin.

Crit Care

9

649

650

74. KimJEvansSSmeethLPocockS

2006

Hormone replacement therapy and acute myocardial infarction: a

large observational study exploring the influence of age.

Int J Epidemiol

35

731

738

75. McPhersonKHemminkiE

2004

Synthesising licensing data to assess drug

safety.

BMJ

328

518

520

76. PetittiDB

1994

Coronary heart disease and estrogen replacement therapy. Can

compliance bias explain the results of observational

studies?

Ann Epidemiol

4

115

118

77. PosthumaWFWestendorpRGVandenbrouckeJP

1994

Cardioprotective effect of hormone replacement therapy in

postmenopausal women: is the evidence biased?

[comment].

BMJ

308

1268

1269

78. JickHRodriguezGPerez-GuthannS

1998

Principles of epidemiological research on adverse and beneficial

drug effects.

Lancet

352

1767

1770

79. PereraRHeneghanC

2008

Interpretating meta-analysis in systematic

reviews.

Evid Based Med

13

67

69

80. DaviesHTO

1998

Interpreting measures of treatment effect.

Hosp Med

59

499

501

81. DeeksJHigginsJAltmanDG

2008

Analysing data and undertaking meta-analyses.

HigginsJPGreenS

Cochrane handbook for systematic reviews of interventions

Chichester

John Wiley and Sons

82. BagerPWhohlfahrtJWestergaardT

2008

Caesarean delivery and risk of atopy and allergic disease:

meta-analysis.

Clin Exp Allergy

38

634

642

83. BergendalAOdlindVPerssonIKielerH

2009

Limited knowledge on progestogen-only contraception and risk of

venous thromboembolism.

Acta Obstet Gynecol Scand

88

261

266

84. BolliniPGarciaRLAPérezGSWalkerAM

1992

The impact of research quality and study design on epidemiologic

estimates of the effect of nonsteroidal anti-inflammatory drugs on upper

gastrointestinal tract disease.

Arch Int Med

152

1289

1295

85. ChanWSRayJWaiEKGinsburgSHannahME

2004

Risk of stroke in women exposed to low-dose oral contraceptives:

a critical evaluation of the evidence.

Arch Intern Med

164

741

747

86. ChouRFuRCarsonSSahaSHelfandM

2006

Empirical evaluation of the association between methodological

shortcomings and estimates of adverse events.

Rockville (Maryland)

Agency for Healthcare Research and Quality

Technical Reviews, No. 13

87. ChouRFuRCarsonSSahaSHelfandM

2007

Methodological shortcomings predicted lower harm estimates in one

of two sets of studies of clinical interventions.

J Clin Epidemiol

60

18

28

88. CosmiBCastelvetriCMilandriMRubboliAConfortiA

2000

The evaluation of rare adverse drug events in Cochrane reviews:

the incidence of thrombotic thrombocytopenic purpura after ticlopidine plus

aspirin for coronary stenting [abstract].

Abstract PA13. 8th Cochrane Colloquium; 2000 October; Cape Town, South

Africa

89. DolovichLRAddisAVaillancourtJMPowerJDKorenG

1998

Benzodiazepine use in pregnancy and major malformations or oral

cleft: meta-analysis of cohort and case-control studies.

BMJ

317

839

843

90. GargPPKerlikowskeKSubakLGradyD

1998

Hormone replacement therapy and the risk of epithelial ovarian

carcinoma: a meta-analysis.

Obstet Gynecol

92

472

479

91. GillumLAMamidipudiSKJohnstonSC

2000

Ischemic stroke risk with oral contraceptives: a

meta-analysis.

JAMA

284

72

78

92. GradyDGebretsadikTKerlikowskeKErnsterVPetittiD

1995

Hormone replacement therapy and endometial cancer risk: a

meta-analysis.

Obstet Gynecol

85

304

313

93. HenryDMcGettiganP

2003

Epidemiology overview of gastrointestinal and renal toxicity of

NSAIDs.

Int J Clin

Pract

Suppl 135

43

49

94. JensenPMikkelsenTKehletH

2002

Postherniorrhaphy urinary retention—effect of local,

regional, and general anesthesia: a review.

Reg Anesth Pain Med

27

612

617

95. JohnstonSCColfordJMJrGressDR

1998

Oral contraceptives and the risk of subarachnoid

hemorrhage.

Neurology

51

411

418

96. JonesGRileyMCouperDDwyerT

1999

Water fluoridation, bone mass and fracture: a quantitative

overview of the literature.

Aust N Z J Public Health

23

34

40

97. LeipzigRMCummingRGTinettiME

1999

Drugs and falls in older people: a systematic review and

meta-analysis: I. Psychotropic drugs.

J Am Geriatr Soc

47

30

39

98. LeipzigRMCummingRGTinettiME

1999

Drugs and falls in older people: a systematic review and

meta-analysis: II. Cardiac and analgesic drugs.

J Am Geriatr Soc

47

40

50

99. LokeYKDerrySAronsonJK

2004

A comparison of three different sources of data in assessing the

frequencies of adverse reactions to amiodarone.

Br J Clin Pharmacol

57

616

621

100. McGettiganPHenryD

2006

Cardiovascular risk and inhibition of cyclooxygenase: a

systematic review of the observational studies of selective and nonselective

inhibitors of cyclooxygenase 2.

JAMA

296

1633

1644

101. NalysnykLFahrbachKReynoldsMWZhaoSZRossS

2003

Adverse events in coronary artery bypass graft (CABG) trials: a

systematic review and analysis.

Heart

89

767

772

102. OgerEScarabinPY

1999

Assessment of the risk for venous thromboembolism among users of

hormone replacement therapy.

Drugs Aging

14

55

61

103. RossSDDiGeorgeAConnellyJEWhittingGWMcDonnellN

1998

Safety of GM-CSF in patients with AIDS: A review of the

literature.

Pharmacotherapy

18

1290

1297

104. SalhabMAl SarakbiWMokbelK

2005

In vitro fertilization and breast cancer risk: a

review.

Int J Fertil Womens Med

50

259

266

105. SchwarzEBMorettiMENayakSKorenG

2008

Risk of hypospadias in offspring of women using loratadine during

pregnancy: a systematic review and meta-analysis.

Drug Saf

31

775

788

106. ScottPAKingsleyGHSmithCMChoyEHScottDL

2007

Non-steroidal anti-inflammatory drugs and myocardial infarctions:

comparative systematic review of evidence from observational studies and

randomised controlled trials.

Ann Rheum Dis

66

1296

1304

107. SiegelCAMardenSMPersingSMLarsonRJSandsBE

2009

Risk of lymphoma associated with combination anti-tumor necrosis

factor and immunomodulator therapy for the treatment of Crohn's

disease: a meta-analysis.

Clin Gastroenterol Hepatol

7

874

881

108. SmithJSGreenJBerrington de GonzalezAApplebyPPetoJ

2003

Cervical cancer and use of hormonal contraceptives: a systematic

review.

Lancet

36

1159

1167

109. TakkoucheBMontes-MartínezAGillSSEtminanM

2007

Psychotropic medications and the risk of fracture: a

meta-analysis.

Drug Saf

30

171

184

110. TramerMRMooreRAMcQuayHJ

1997

Propofol and bradycardia: causation, frequency and

severity.

Br J Anaesth

78

642

651

111. VohraSJohnstonBCCramerKHumphreysK

2007

Adverse events associated with pediatric spinal manipulation: a

systematic review.

Pediatrics

119

e275

e283

112. WangTColletJPShapiroSWareMA

2008

Adverse effects of medical cannabinoids: a systematic

review.

CMAJ

178

1669

1678

113. WoolcottJCRichardsonKJWiensMOPatelBMarinJ

2009

Meta-analysis of the impact of 9 medication classes on falls in

elderly persons.

Arch Int Med

169

1952

1960

114. Agency for Healthcare Research and Quality

2002

Hormone replacement therapy and risk of venous

thromboembolism.

Rockville (Maryland)

Agency for Healthcare Research and Quality

115. AlghamdiAAMoussaFFremesSE

2007

Does the use of preoperative aspirin increase the risk of

bleeding in patients undergoing coronary artery bypass grafting surgery?

Systematic review and meta-analysis.

J Card Surg

22

247

256

116. BrowningDRMartinRM

2007

Statins and risk of cancer: a systematic review and

metaanalysis.

Int J Cancer

120

833

843

117. CanonicoMPlu-BureauGLoweGDOScarabinPY

2008

Hormone replacement therapy and risk of venous thromboembolism in

postmenopausal women: systematic review and meta-analysis.

BMJ

336

1227

1231

118. CapursoGSchünemannHJTerrenatoIMorettiAKochM

2007

Meta-analysis: the use of non-steroidal anti-inflammatory drugs

and pancreatic cancer risk for different exposure

categories.

Aliment Pharmacol Ther

26

1089

1099

119. ColNFKimJAChlebowskiRT

2005

Menopausal hormone therapy after breast cancer: a meta-analysis

and critical appraisal of the evidence.

Breast Cancer Res

7

R535

R540

120. CutlerCGiriSJeyapalanSPaniaguaDViswanathanA

2001

Acute and chronic graft-versus-host disease after allogeneic

peripheral-blood stem-cell and bone marrow transplantation: a

meta-analysis.

J Clin Oncol

19

3685

3691

121. DouketisJDGinsbergJSHolbrookACrowtherMDukuEK

1997

A reevaluation of the risk for venous thromboembolism with the

use of oral contraceptives and hormone replacement therapy.

Arch Int Med

157

1522

1530

122. KosterTSmallRARosendaalFRHelmerhorstFM

1995

Oral contraceptives and venous thromboembolism: a quantitative

discussion of the uncertainties.

J Intern Med

238

31

37

123. LoeSMSanchez-RamosLKaunitzAM

2005

Assessing the neonatal safety of indomethacin tocolysis: a

systematic review with meta-analysis.

Obstet Gynecol

106

173

179

124. LokeYKSinghSFurbergCD

2008

Long-term use of thiazolidinediones and fractures in type 2

diabetes: A meta-analysis.

CMAJ

180

32

39

125. MacLennanSCMacLennanAHRyanP

1995

Colorectal cancer and oestrogen replacement therapy. A

meta-analysis of epidemiological studies.

Med J Aust

162

491

493

126. McAlisterFAClarkHDWellsPSLaupacisA

1998

Perioperative allogenic blood transfusion does not cause adverse

sequelae in patients with cancer: a meta-analysis of unconfounded

studies.

Br J Surg

85

171

178

127. McGettiganPHenryD

2008

Cardiovascular ischaemia with anti-inflammarory drugs [oral

presentation]

128. OfmanJJMacLeanCHStrausWLMortonSCBergerML

2002

A meta-analysis of severe upper gastrointestinal complications of

non-steroidal anti-inflammatory drugs.

J Rheumatol

29

804

812

129. ScottPAKingsleyGHScottDL

2008

Non-steroidal anti-inflammatory drugs and cardiac failure:

meta-analysis of observational studies and randomised controlled

trials.

Eur J Heart Fail

10

1102

1107

130. SinghSLokeYKFurbergCD

2007

Thiazolidinediones and heart failure: A

teleo-analysis.

Diabetes Care

30

2148

2153

131. TorloniMRVedmedovskaNMerialdiMBetranAPAllenT

2009

Safety of ultrasonography in pregnancy: WHO systematic review of

the literature and meta-analysis.

Ultrasound Obstet Gynecol

33

599

608

132. PrenticeRChlebowskiRStefanickMMansonJLangerR

2008

Conjugated equine estrogens and breast cancer risk in the

Women's Health Initiative clinical trial and observational

study.

Am J Epidemiol

167

1407

1415

133. VandenbrouckeJ

2009

The HRT controversy: observational studies and RCTs fall in

line.

Lancet

373

1233

1235

134. LevineMAHametPNovoselSJolainB

1997

A prospective comparison of four study designs used in assessing

safety and effectiveness of drug therapy in hypertension

management.

Am J Hypertens

10

1191

1200

135. RossSD

2001

Drug-related adverse events: a readers' guide to assessing

literature reviews and meta-analyses.

Arch Int Med

161

1041

1046

136. SuttonAJCooperNJLambertPCJonesDRAbramsKR

2002

Meta-analysis of rare and adverse event data.

Expert Rev Pharmacoecon Outcomes Res

2

367

379

137. LokeYKTrivediANSinghS

2008

Meta-analysis: gastrointestinal bleeding due to interaction

between selective serotonin uptake inhibitors and non-steroidal

anti-inflammatory drugs.

Aliment Pharmacol Ther

27

31

40