Generalizing findings from a randomized controlled trial to a real-world study of the iLookOut, an online education program to improve early childhood care and education providers’ knowledge and attitudes about reporting child maltreatment

English version

Autoři: Chengwu Yang ^aff001; Carlo Panlilio ^aff002; Nicole Verdiglione ^aff003; Erik B. Lehman ^aff004; Robert M. Hamm ^aff005; Richard Fiene ^aff006; Sarah Dore ^aff003; David E. Bard ^aff008; Breanna Grable ^aff006; Benjamin Levi ^aff009
Působiště autorů: Department of Epidemiology and Health Promotion, New York University College of Dentistry, New York City, New York, United States of America ^aff001; Department of Educational Psychology, Counseling and Special Education, Pennsylvania State University, University Park, Hershey, Pennsylvania, United States of America ^aff002; Departments of Humanities, Penn State College of Medicine, Hershey, Pennsylvania, United States of America ^aff003; Departments of Population Health Sciences, Penn State College of Medicine, Hershey, Pennsylvania, United States of America ^aff004; Department of Family and Preventive Medicine, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, United States of America ^aff005; Departments of Psychology & Human Development Research Center, Pennsylvania State University, Middletown, Pennsylvania, United States of America ^aff006; Research Institute for Key Indicators, Middletown, Pennsylvania, United States of America ^aff007; Department of Pediatrics, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma, United States of America ^aff008; Departments of Humanities & Pediatrics, Penn State College of Medicine, Hershey, Pennsylvania, United States of America ^aff009
Vyšlo v časopise: PLoS ONE 15(1)
Kategorie: Research Article
prolekare.web.journal.doi_sk: https://doi.org/10.1371/journal.pone.0227398

Souhrn

In recent years, real-world studies (RWS) are gaining increasing interests, because they can generate more realistic and generalizable results than randomized controlled clinical trials (RCT). In 2017, we published a RCT in 741 early childhood care and education providers (CCPs). It is the Phase I of our iLookOut for Child Abuse project (iLookOut), an online, interactive learning module about reporting suspected child maltreatment. That study demonstrated that in a RCT setting, the iLookOut is efficient at improving CCPs’ knowledge of and attitudes towards child maltreatment reporting. However, the generalizability of that RCT’s results in a RWS setting remains unknown. To address this question, we design and conduct this large RWS in 11,065 CCPs, which is the Phase II of the iLookOut. We hypothesize replication of the earlier RCT findings, i.e., the iLookOut can improve CCPs’ knowledge of and attitudes toward child maltreatment reporting in a real world setting. In addition, this RWS also explores whether demographic factors affect CCPs’ performance. Results of this RWS confirmed the generalizability of the previous RCT’s results in a real world setting. It yielded similar effect sizes for knowledge and attitudes as were found in the earlier RCT. Cohen’s d for knowledge improvement was 0.95 in that RCT, 0.96 in this RWS; Cohen’s d for attitude improvement was 0.98 in that RCT, 0.80 in this RWS. Also, we found several significant differences in knowledge and attitude improvement with regard to age, race, education, and employment status. In conclusion, iLookOut improves knowledge and attitudes of CCPs about child maltreatment prevention and reporting in a real-world setting. The generalizability of the initial RCT findings to this RWS provides strong evidence that the iLookout will be effective in other real world settings. It can be a useful model for other interventions aimed at preventing child maltreatment.

Clinical trial registration for the original RCT: NCT02225301 (ClinicalTrials.gov Identifier)

Klíčová slova:

Teachers – Employment – Jobs – Internet – Religion – Randomized controlled trials – Child abuse – Pennsylvania

Zdroje

1. Kaptchuk TJ. The double-blind, randomized, placebo-controlled trial: gold standard or golden calf? J Clin Epidemiol. 2001;54(6):541–9. doi: 10.1016/s0895-4356(00)00347-4 11377113

2. Garrison LP Jr, Neumann PJ, Erickson P, Marshall D, Mullins CD. Using real‐world data for coverage and payment decisions: The ISPOR real‐world data task force report. Value in Health. 2007;10(5):326–35. doi: 10.1111/j.1524-4733.2007.00186.x 17888097

3. Sherman RE, Anderson SA, Dal Pan GJ, Gray GW, Gross T, Hunter NL, et al. Real-World Evidence—What Is It and What Can It Tell Us? N Engl J Med. 2016;375(23):2293–7. doi: 10.1056/NEJMsb1609216 27959688

4. Administration USFD. Use of real-world evidence to support regulatory decision-making for medical devices. Guidance for industry and food and drug administration staff. Docket Number: FDA-2016-D-2153. 2017.

5. Sun X, Tan J, Tang L, Guo JJ, Li X. Real world evidence: experience and lessons from China. BMJ. 2018;360:j5262. doi: 10.1136/bmj.j5262 29437644

6. Corrigan-Curay J, Sacks L, Woodcock J. Real-world evidence and real-world data for evaluating drug safety and effectiveness. JAMA. 2018;320(9):867–8. doi: 10.1001/jama.2018.10136 30105359

7. Food U, Administration D. Framework for FDA’s real-world evidence program. 2018.

8. Klonoff DC. The Expanding Role of Real-World Evidence Trials in Health Care Decision Making. Journal of Diabetes Science and Technology. 2019:1932296819832653.

9. Evans K. Real World Evidence: Can We Really Expect It to Have Much Influence? Drugs—Real World Outcomes. 2019;6(2):43–5. doi: 10.1007/s40801-019-0155-3 31016548

10. Calvert MJ, O’Connor DJ, Basch EM. Harnessing the patient voice in real-world evidence: the essential role of patient-reported outcomes. Nature Reviews Drug Discovery. 2019;18(5).

11. Mathews B, Yang C, Lehman EB, Mincemoyer C, Verdiglione N, Levi BH. Educating early childhood care and education providers to improve knowledge and attitudes about reporting child maltreatment: A randomized controlled trial. PLoS ONE. 2017;12(5):e0177777. doi: 10.1371/journal.pone.0177777 28542285

12. Curry SJ, Krist AH, Owens DK, Barry MJ, Caughey AB, Davidson KW, et al. Interventions to prevent child maltreatment: US Preventive Services Task Force Recommendation Statement. JAMA. 2018;320(20):2122–8. doi: 10.1001/jama.2018.17772 30480735

13. Kohl PL, Jonson-Reid M, Drake B. Time to leave substantiation behind: Findings from a national probability study. Child Maltreatment. 2009;14(1):17–26. doi: 10.1177/1077559508326030 18971346

14. Stoltenborgh M, Bakermans‐Kranenburg MJ, van IJzendoorn MH, Alink LR. Cultural–geographical differences in the occurrence of child physical abuse? A meta‐analysis of global prevalence. International Journal of Psychology. 2013;48(2):81–94. doi: 10.1080/00207594.2012.697165 23597008

15. Alvarez KM, Kenny MC, Donohue B, Carpin KM. Why are professionals failing to initiate mandated reports of child maltreatment, and are there any empirically based training programs to assist professionals in the reporting process? Aggression and Violent Behavior. 2004;9(5):563–78.

16. Dinehart L, Kenny MC. Knowledge of child abuse and reporting practices among early care and education providers. Journal of Research in Childhood Education. 2015;29(4):429–43.

17. IOM, NRC. New directions in child abuse and neglect research. The National Academies Press Washington, DC; 2014.

18. McGrath P, Cappelli M, Wiseman D, Khalil N, Allan B. Teacher awareness program on child abuse: a randomized controlled trial. Child Abuse & Neglect. 1987;11(1):125–32.

19. Khan A, Rubin D, Winnik G. Evaluation of the mandatory child abuse course for physicians: do we need to repeat it? Public Health. 2005;119(7):626–31. doi: 10.1016/j.puhe.2004.10.010 15925678

20. Kenny MC. Web-based training in child maltreatment for future mandated reporters. Child Abuse & Neglect. 2007;31(6):671–8.

21. Kenny MC, Lopez-Griman AM, Donohue B. Development and initial evaluation of a cost-effective, internet-based program to assist professionals in reporting suspected child maltreatment. Journal of Child & Adolescent Trauma. 2017;10(4):385–93.

22. Von Elm E, Altman D, Egger M, Pocock S. G? tzsche PC, Vandenbroucke JP: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. PLoS Med. 2007;4(10):e296. doi: 10.1371/journal.pmed.0040296 17941714

23. Walsh K, Rassafiani M, Mathews B, Farrell A, Butler D. Exploratory factor analysis and psychometric evaluation of the teacher reporting attitude scale for child sexual abuse. J Child Sex Abus. 2012;21(5):489–506. doi: 10.1080/10538712.2012.689423 22994689

Generalizing findings from a randomized controlled trial to a real-world study of the iLookOut, an online education program to improve early childhood care and education providers’ knowledge and attitudes about reporting child maltreatment

Souhrn

Klíčová slova:

Zdroje

PLOS One

Aktuální možnosti diagnostiky a léčby litiáz