Recall accuracy of weekly automated surveys of health care utilization and infectious disease symptoms among infants over the first year of life

English version

Autoři: Catherine Ley ^aff001; Lauren Willis ^aff001; Maria de la Luz Sanchez ^aff001; Julie Parsonnet ^aff001
Působiště autorů: Division of Infectious Diseases and Geographic Medicine, Department of Medicine, Stanford School of Medicine, Stanford, CA, United States of America ^aff001; Division of Epidemiology, Department of Health Research and Policy, Stanford School of Medicine, Stanford, CA, United States of America ^aff002
Vyšlo v časopise: PLoS ONE 14(12)
Kategorie: Research Article
prolekare.web.journal.doi_sk: https://doi.org/10.1371/journal.pone.0226623

Souhrn

Automated surveys, by interactive voice response (IVR) or email, are increasingly used for clinical research. Although convenient and inexpensive, they have uncertain validity. We sought to assess the accuracy of longitudinally-collected automated survey responses compared to medical records. Using data collected from a well-characterized, prospective birth cohort over the first year of life, we examined concordance between guardians’ reports of their infants’ health care visits ascertained by weekly automated survey (IVR or email) and those identified by medical chart review. Among 180 survey-visit pairs, concordance was 51%, with no change as number of visits per baby increased. Accuracy of recall was higher by email compared to IVR (61 vs. 43%; adjusted OR = 2.5 95% CI: 1.3–4.8), did not vary by health care encounter type (hospitalization: 50%, ER: 64%, urgent care: 44%, primary care: 52%; p = 0.75), but was higher for fever (77%, adjusted OR = 5.1 95%CI: 1.5–17.7) and respiratory illness (58%, adjusted OR = 2.9 95%CI: 1.5–5.8) than for other diagnoses. For the 75 mothers in these encounters, 69% recalled at least one visit; among 41 mothers with two or more visits, 85% recalled at least one visit. Predictors of accurate reporting by mothers after adjusting for illness in the baby included increased age and increased years of education (age per year, β = 0.05, p = 0.03; education per year, β = 0.08, p = 0.04). Additional strategies beyond use of automated surveys are needed to ascertain accurate health care utilization in longitudinal cohort studies, particularly in healthy populations with little motivation for accurate reporting.

Klíčová slova:

Critical care and emergency medicine – Pediatrics – Respiratory infections – Schools – Surveys – Fevers – Hospitalizations – Parenting behavior

Zdroje

1. Pew Research Center: What Low Response Rates Mean for Telephone Surveys http://www.pewresearch.org/methods/2017/05/15/what-low-response-rates-mean-for-telephone-surveys/

2. Houser SH, Ray MN, Maisiak R, Panjamapirom A, Willing J, Schiff GD, et al. Telephone follow-up in primary care: can interactive voice response calls work? Stud Health Technol Inform. 2013;192:112–6. 23920526

3. Andersson C, Danielsson S, Silfverberg-Dymling G, Löndahl G, Johansson BA. Evaluation of Interactive Voice Response (IVR) and postal survey in follow-up of children and adolescents discharged from psychiatric outpatient treatment: a randomized controlled trial. SpringerPlus. 2014 February 8;3:77. doi: 10.1186/2193-1801-3-77 24567883

4. Perrine MW, Mundt JC, Searles JS, Lester LS. Validation of daily self-reported alcohol consumption using interactive voice response (IVR) technology. J Stud Alcohol Drugs. 1995 September;56(5):487–90.

5. Searles JS, Helzer JE, Rose GL, Badger GJ. Concurrent and retrospective reports of alcohol consumption across 30, 90 and 366 days: interactive voice response compared with the timeline follow back. J Stud Alcohol. 2002 May;63(3):352–62. doi: 10.15288/jsa.2002.63.352 12086136

6. Nikolaou CK, Hankey CR, Lean MEJ. Accuracy of on-line self-reported weights and heights by young adults. Eur J Public Health. 2017 Oct 1;27(5):898–903. doi: 10.1093/eurpub/ckx077 28633350

7. Miller DI, Talbot V, Gagnon M, Messier C. Administration of Neuropsychological Tests Using Interactive Voice Response Technology in the Elderly: Validation and Limitations. Front Neurol. 2013; 4: 10 doi: 10.3389/fneur.2013.00010

8. Brodey BB, Rosen CS, Winters KC, Brodey IS, Sheetz BM, Steinfeld RR, et al. Conversion and validation of the Teen-Addiction Severity Index (T-ASI) for Internet and automated-telephone self-report administration. Psychology of Addictictive Behaviors. 2005 March;19(1):54–61.

9. Lam MY, Lee H, Bright R, Korzenik JR, Sands BE. Validation of interactive voice response system administration of the Short Inflammatory Bowel Disease Questionnaire. Inflamm Bowel Dis 2009 Apr;15(4):599–607. doi: 10.1002/ibd.20803 19023897

10. Kunugi H, Koga N, Hashikura M, Noda T, Shimizu Y, Kobayashi T, et al. Validation of computer-administered clinical rating scale: Hamilton Depression Rating Scale assessment with Interactive Voice Response technology—Japanese version. Psychiatry Clin Neurosci. 2013 May;6(4):253–8.

11. Moore HK, Hughes CW, Mundt JC, Rush AJ, Macleod L, Emslie GJ, et al. A pilot study of an electronic, adolescent version of the quick inventory of depressive symptomatology. J Clin Psychiatry. 2007 September;68(9):1436–40. doi: 10.4088/jcp.v68n0917 17915985

12. Turvey C, Sheeran T, Dindo L, Wakefield B, Klein D. Validity of the Patient Health Questionnaire, PHQ-9, administered through interactive-voice-response technology. J Telemed Telecare. 2012 September;18(6):348–51. doi: 10.1258/jtt.2012.120220 22933480

13. Brown JB, Adams ME. Patients as reliable reporters of medical care process: Recall of ambulatory encounter events. Medical Care. 1992 May;30(5):400–411. doi: 10.1097/00005650-199205000-00003 1583918

14. Bruijnzeels MA, van der Wouden JC, Foets M, Prins A, van den Heuvel WJ. Validity and accuracy of interview and diary data on children's medical utilisation in the Netherlands. J Epidemiol Community Health. 1998 Jan; 52(1): 65–69. doi: 10.1136/jech.52.1.65 9604044

15. D'Souza-Vazirani D, Minkovitz CS, Strobino DM. Validity of maternal report of acute health care use for children younger than 3 years. Arch Pediatr Adolesc Med. 2005 Feb;159(2):167–72. doi: 10.1001/archpedi.159.2.167 15699311

16. Liu G, Liao Z, Xu X, Liang Y, Xiong Y, Ni J. Accuracy of parent-reported measles-containing vaccination status of children with measles. Public Health. 2017 Mar;144:92–95. doi: 10.1016/j.puhe.2016.12.013 28274390

17. Nandy K, Menon U, Szalacha LA, Park H, Lee J, Lee EE. Self-Report Versus Medical Record for Mammography Screening Among Minority Women. West J Nurs Res. 2016 Dec;38(12):1627–1638. doi: 10.1177/0193945916647059 27138447

18. Bonner R, Bountziouka V, Stocks J, Harding S, Wade A, Griffiths C, et al. Birth data accessibility via primary care health records to classify health status in a multi-ethnic population of children: an observational study. NPJ Prim Care Respir Med. 2015 Jan 22;25:14112. doi: 10.1038/npjpcrm.2014.112 25612149

19. Hinkle SN, Rawal S, Zhu Y, Grewal J, Albert PS, Zhang C. Validation of self-reported diagnosis of gestational diabetes at 6-weeks postpartum. Epidemiology. 2017 Sep;28(5):747–752. doi: 10.1097/EDE.0000000000000695 28570385

20. Keenan K, Hipwell A, McAloon R, Hoffmann A, Mohanty A, Magee K. Concordance between maternal recall of birth complications and data from obstetrical records. Early Hum Dev. 2017 Feb;105:11–15. doi: 10.1016/j.earlhumdev.2017.01.003 28095344

21. Krakowiak P, Walker CK, Tancredi DJ, Hertz-Picciotto I. Maternal recall versus medical records of metabolic conditions from the prenatal period: a validation study. Matern Child Health J. 2015 September 19(9):1925–35. doi: 10.1007/s10995-015-1723-0 25656730

22. Shenkin SD, Zhang MG, Der G, Mathur S, Mina TH, Reynolds RM. Validity of recalled v. recorded birth weight: a systematic review and meta-analysis. J Dev Orig Health Dis. 2017 Apr;8(2):137–148. doi: 10.1017/S2040174416000581 27776565

23. D'Aloisio AA, Nichols HB, Hodgson ME, Deming-Halverson SL, Sandler DP. Validity of self-reported breast cancer characteristics in a nationwide cohort of women with a family history of breast cancer. BMC Cancer. 2017 Oct 23;17(1):692. doi: 10.1186/s12885-017-3686-6 29058598

24. Camplain R, Kucharska-Newton A, Loehr L, Keyserling TC, Layton JB, Wruck L, et al. Accuracy of Self-Reported Heart Failure. The Atherosclerosis Risk in Communities (ARIC) Study. J Card Fail. 2017 Nov;23(11):802–808. doi: 10.1016/j.cardfail.2017.09.002 28893677

25. Cho S, Shin A, Song D, Park JK, Kim Y, Choi JY, et al. Validity of self-reported cancer history in the health examinees (HEXA) study: A comparison of self-report and cancer registry records. Cancer Epidemiol. 2017 Oct;50(Pt A):16–21. doi: 10.1016/j.canep.2017.07.010 28763723

26. Vissing NH, Jensen SM, Bisgaard H. Validity of information on atopic disease and other illness in young children reported by parents in a prospective birth cohort study. BMC Med Res Methodol. 2012 Oct 22;12:160. doi: 10.1186/1471-2288-12-160 23088330

27. Weiss A, Sommer G, Kuonen R, Scheinemann K, Grotzer M, Kompis M, et al. Validation of questionnaire-reported hearing with medical records: A report from the Swiss Childhood Cancer Survivor Study. PLoS One. 2017 Mar 23;12(3):e0174479. doi: 10.1371/journal.pone.0174479 28333999

28. Dreyer NA, Blackburn SC, Mt-Isa S, Richardson JL, Thomas S, Laursen M, et al. Direct-to-Patient Research: Piloting a New Approach to Understanding Drug Safety During Pregnancy. JMIR Public Health Surveill. 2015 Dec 22;1(2):e22. doi: 10.2196/publichealth.4939 27227140

29. Ley C, Sanchez M de la L, Mathur A, Yang S, Sundaram V, Parsonnet J. Stanford’s Outcomes Research in Kids (STORK): a prospective study of healthy pregnant women and their babies in Northern California. BMJ Open. 2016 April 13 6(4):e010810 doi: 10.1136/bmjopen-2015-010810 27075843

30. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)–A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2008 September 30;42.

31. Aglipay M, Birken CS, Parkin PC, Loeb MB, Thorpe K, Chen Y, et al. Effect of High-Dose vs Standard-Dose Wintertime Vitamin D Supplementation on Viral Upper Respiratory Tract Infections in Young Healthy Children. JAMA. 2017 Jul 18;318(3):245–254. doi: 10.1001/jama.2017.8708 28719693

32. Schuez-Havupalo L, Lahti E, Junttila N, Toivonen L, Aromaa M, Rautava P, et al. Parents' depression and loneliness during pregnancy and respiratory infections in the offspring: A prospective birth cohort study. PLoS One. 2018 Sep 7;13(9):e0203650. doi: 10.1371/journal.pone.0203650 30192872

33. Sarna M, Ware RS, Sloots TP, Nissen MD, Grimwood K, Lambert SB. The burden of community-managed acute respiratory infections in the first 2-years of life. Pediatr Pulmonol. 2016 Dec;51(12):1336–1346. doi: 10.1002/ppul.23480 27228308

34. Toivonen L, Karppinen S, Schuez-Havupalo L, Teros-Jaakkola T, Vuononvirta J, Mertsola J, et al. Burden of Recurrent Respiratory Tract Infections in Children: A Prospective Cohort Study. Pediatr Infect Dis J. 2016 Dec;35(12):e362–e369. doi: 10.1097/INF.0000000000001304 27455443

35. Dragojlovic N, Kim E, Elliott AM, CAUSES Study, Friedman JM, Lynd LD. Evaluating the use of parental reports to estimate health care resource utilization in children with suspected genetic disorders. J Eval Clin Pract. 2018 Apr;24(2):416–422. doi: 10.1111/jep.12876 29603523

36. Kjellsson G, Clarke P, Gerdtham UG. Forgetting to remember or remembering to forget: a study of the recall period length in health care survey questions. J Health Econ. 2014 May;35:34–46. doi: 10.1016/j.jhealeco.2014.01.007 24595066

37. Cummings P, Rivara FP, Thompson RS, Reid RJ. Ability of parents to recall the injuries of their young children. Inj Prev. 2005, 11:47–47

38. Cobb EM, Singer DC, Davis MM. Public interest in medical research participation: differences by volunteer status and study type. Clin Transl Sci. 2014 Apr;7(2):145–9. doi: 10.1111/cts.12142 24456538

39. Lissner L, Skoog I, Andersson K, Beckman N, Sundh V, Waern M, et al. Participation bias in longitudinal studies: experience from the population study of women in Gothenburg, Sweden, Scand J Prim Health Care, 2003 21:4, 242–247

40. Unger JM, Hershman DL, Albain KS, Moinpour CM, Petersen JA, Burg K, et al. Patient income level and cancer clinical trial participation. J Clin Oncol. 2013 Feb 10;31(5):536–42. doi: 10.1200/JCO.2012.45.4553 23295802

41. Galobardes B, Shaw M, Lawlor DA, Lynch JW. Indicators of socioeconomic position (part1). J Epidemiol Community Health 2006 60(1): 7–12 doi: 10.1136/jech.2004.023531 16361448

42. Burakevych N, McKinlay CJ, Alsweiler JM, Harding JE, CHYLD Study team. Accuracy of caregivers' recall of hospital admissions: implications for research. Acta Paediatr. 2015 Nov;104(11):1199–204. doi: 10.1111/apa.13208 26355393

43. McPhee SJ, Nguyen TT, Shema SJ, Nguyen B, Somkin C, Vo P, et al. Validation of recall of breast and cervical cancer screening by women in an ethnically diverse population. Prev Med. 2002 Nov;35(5):463–73. doi: 10.1006/pmed.2002.1096 12431895

44. Franke KH, Krumkamp R, Mohammed A, Sarpong N, Owusu-Dabo E, Brinkel J, et al. A mobile phone based tool to identify symptoms of common childhood diseases in Ghana: development and evaluation of the integrated clinical algorithm in a cross-sectional study. BMC Med Inform Decis Mak. 2018 Mar 27;18(1):23 doi: 10.1186/s12911-018-0600-3 29580278

45. Tsoli S, Sutton S, Kassavou A. Interactive voice response interventions targeting behaviour change: a systematic literature review with meta-analysis and meta-regression. BMJ Open. 2018 Feb 24;8(2):e018974. doi: 10.1136/bmjopen-2017-018974 29478016

Recall accuracy of weekly automated surveys of health care utilization and infectious disease symptoms among infants over the first year of life

Souhrn

Klíčová slova:

Zdroje

PLOS One

Aktuální možnosti diagnostiky a léčby litiáz