The effect of overnight consolidation in the perceptual learning of non-native tonal contrasts

English version

Autoři: Zhen Qin ^aff001; Caicai Zhang ^aff001
Působiště autorů: Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong SAR, China ^aff001; Research Center for Language, Cognition, and Neuroscience, The Hong Kong Polytechnic University, Hong Kong SAR, China ^aff002
Vyšlo v časopise: PLoS ONE 14(12)
Kategorie: Research Article
prolekare.web.journal.doi_sk: https://doi.org/10.1371/journal.pone.0221498

Souhrn

Sleep-mediated overnight consolidation has been found to facilitate perceptual learning by promoting learners’ generalization across talkers in their perception of novel segmental categories. Lexical tone is characterized by high variability across talkers, and displays dynamic change over time. For this reason, it remains unclear whether a similar effect of overnight consolidation would be found for perceptual learning of novel tonal contrasts. Thus, this study aims to examine whether overnight consolidation facilitates talker-independent learning of lexical tones in the identification and discrimination of novel Cantonese level tones by Mandarin listeners. Two groups of Mandarin listeners were perceptually trained either in the morning or in the evening. Listeners were trained in a tone identification (ID) task with feedback using stimuli produced by a trained talker. Their post-training changes and generalization to a novel talker were then tested in the ID and AX discrimination tasks using stimuli produced by trained and untrained talkers in three posttests following training: immediately after training, 12-hour delay, and 24-hour delay. While the evening group slept between the first and second posttests, the morning group did not. The accuracy rates in the ID task showed that the evening group showed an improved trend, predicted by their individual sleep time, in identifying the level tones produced by both the trained and untrained talkers; in contrast, the morning group showed a declining trend. The d-prime scores in the AX discrimination task did not show different patterns between the two groups. The finding of sleep-related identification changes over time suggests that overnight consolidation might have facilitated tone learning of stimuli produced by the novel talker and eventually facilitated the formation of a more talker-independent representation of novel tone categories in long-term memory. The results are discussed in light of the features of lexical tones to shed light on the mechanism of phonetic learning.

Klíčová slova:

Learning – Sleep – Trainees – Pitch perception – Perceptual learning – Speech – Long term memory – Phonology

Zdroje

1. Gómez RL, Bootzin RR, Nadel L. Naps promote abstraction in language-learning infants. Psychol Sci. 2006;17: 670–674. doi: 10.1111/j.1467-9280.2006.01764.x 16913948

2. Gomez RL, Newman-Smith KC, Breslin JH, Bootzin RR. Learning, memory, and sleep in children. Sleep Medicine Clinics. W.B. Saunders; 2011. pp. 45–57. doi: 10.1016/j.jsmc.2010.12.002

3. Breitenstein C, Jansen A, Deppe M, Foerster AF, Sommer J, Wolbers T, et al. Hippocampus activity differentiates good from poor learners of a novel lexicon. Neuroimage. 2005;25: 958–968. doi: 10.1016/j.neuroimage.2004.12.019 15808996

4. Havas V, Taylor JSH, Vaquero L, de Diego-Balaguer R, Rodríguez-Fornells A, Davis MH. Semantic and phonological schema influence spoken word learning and overnight consolidation. Q J Exp Psychol. 2018;71: 1469–1481. doi: 10.1080/17470218.2017.1329325 28856956

5. Davis M, Di Betta AM, Macdonald M, Gaskell G. Learning and consololidation of novel spoken words: Behavioral and neural evidence. Cereb Cortex. 2008; 803–820.

6. Davis MH, Di Betta AM, Macdonald MJE, Gaskell MG. Learning and consolidation of novel spoken words. J Cogn Neurosci. 2009;21: 803–820. doi: 10.1162/jocn.2009.21059 18578598

7. Landi N, Malins JG, Frost SJ, Magnuson JS, Molfese P, Ryherd K, et al. Neural representations for newly learned words are modulated by overnight consolidation, reading skill, and age. Neuropsychologia. 2018;111: 133–144. doi: 10.1016/j.neuropsychologia.2018.01.011 29366948

8. Tamminen J, Davis MH, Merkx M, Rastle K. The role of memory consolidation in generalisation of new linguistic information. Cognition. 2012;125: 107–112. doi: 10.1016/j.cognition.2012.06.014 22832178

9. McClelland JL, McNaughton BL, O’Reilly RC. Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychol Rev. 1995;102: 419–457. doi: 10.1037/0033-295X.102.3.419 7624455

10. Davis MH, Gaskell MG. A complementary systems account of word learning: Neural and behavioural evidence. Philosophical Transactions of the Royal Society B: Biological Sciences. 2009. doi: 10.1098/rstb.2009.0054

11. Fenn KM, Nusbaum HC, Margoliash D. Consolidation during sleep of perceptual learning of spoken language. 2003;425: 614–616. doi: 10.1038/nature01971.1

12. Fenn KM, Margoliash D, Nusbaum HC. Sleep restores loss of generalized but not rote learning of synthetic speech. Cognition. 2013;128: 280–286. doi: 10.1016/j.cognition.2013.04.007 23747650

13. Brawn TP, Nusbaum HC, Margoliash D. Sleep Consolidation of Interfering Auditory Memories in Starlings. Psychol Sci. 2013;24: 439–447. doi: 10.1177/0956797612457391 23436785

14. Eisner F, McQueen JM. Perceptual learning in speech: Stability over time. J Acoust Soc Am. 2006;119: 1950–1953. doi: 10.1121/1.2178721 16642808

15. Earle FS, Myers EB. Building phonetic categories: An argument for the role of sleep. Frontiers in Psychology. 2014. pp. 1–12. doi: 10.3389/fpsyg.2014.00001

16. Flege JE. Second Language Speech Learning: Theory, Findings, and Problems. Speech Percept Linguist Exp Issues Cross-Language Res. 1995; doi: 10.1111/j.1600-0404.1995.tb01710.x

17. Best CT. A direct realist view of cross-language speech perception. Speech Percept Linguist Exp Issues cross-language Res. 1995; doi: 10.1016/0378-4266(91)90103-S

18. Earle FS, Landi N, Myers EB. Adults with Specific Language Impairment fail to consolidate speech sounds during sleep. Neurosci Lett. 2018; doi: 10.1016/j.neulet.2017.12.030 29253604

19. Earle FS, Myers EB. Overnight consolidation promotes generalization across talkers in the identification of nonnative speech sounds. J Acoust Soc Am. 2015;137: EL91–EL97. doi: 10.1121/1.4903918 25618106

20. Earle FS, Landi N, Myers EB. Sleep duration predicts behavioral and neural differences in adult speech sound learning. Neurosci Lett. 2017; doi: 10.1016/j.neulet.2016.10.044 27793703

21. Earle FS, Arthur DT. Native phonological processing abilities predict post-consolidation nonnative contrast learning in adults. J Acoust Soc Am. 2017;142: EL525–EL531. doi: 10.1121/1.5013141 29289078

22. Earle FS, Myers EB. Sleep and native language interference affect non-native speech sound learning. J Exp Psychol Hum Percept Perform. 2015;41: 1680–1695. doi: 10.1037/xhp0000113 26280264

23. Xie X, Earle FS, Myers EB. Sleep facilitates generalisation of accent adaptation to a new talker. Lang Cogn Neurosci. 2018; doi: 10.1080/23273798.2017.1369551 29372171

24. Moore CB, Jongman A. Speaker normalization in the perception of Mandarin Chinese tones. J Acoust Soc Am. 2002;102: 1864–1877. doi: 10.1121/1.420092 9301064

25. Qin Z, Tremblay A, Zhang J. Influence of within-category tonal information in the recognition of Mandarin-Chinese words by native and non-native listeners: An eye-tracking study. J Phon. 2019;73: 144–157. doi: 10.1016/j.wocn.2019.01.002

26. Shen J, Deutsch D, Rayner K. On-line perception of Mandarin Tones 2 and 3: Evidence from eye movements. J Acoust Soc Am. 2013;133: 3016–3029. doi: 10.1121/1.4795775 23654405

27. Malins JG, Joanisse MF. The roles of tonal and segmental information in Mandarin spoken word recognition: An eyetracking study. J Mem Lang. 2010;62: 407–420. doi: 10.1016/j.jml.2010.02.004

28. Wiener S, Ito K, Speer SR. Early L2 Spoken Word Recognition Combines Input-Based and Knowledge-Based Processing. Lang Speech. 2018;61: 632–656. doi: 10.1177/0023830918761762 29560782

29. Peng G, Zhang C, Zheng H-Y, Minett JW, Wang WS-Y. The Effect of Intertalker Variations on Acoustic–Perceptual Mapping in Cantonese and Mandarin Tone Systems. J Speech, Lang Hear Res. 2011;55: 579–595. doi: 10.1044/1092-4388(2011/11-0025)

30. Zhang C, Chen S. Toward an integrative model of talker normalization. J Exp Psychol Hum Percept Perform. 2016;42: 1252–1268. doi: 10.1037/xhp0000216 26950387

31. Zhang C, Peng G, Wang WSY. Achieving constancy in spoken word identification: Time course of talker normalization. Brain Lang. 2013;126: 193–202. doi: 10.1016/j.bandl.2013.05.010 23792769

32. Zhang C, Pugh KR, Mencl WE, Molfese PJ, Frost SJ, Magnuson JS, et al. Functionally integrated neural processing of linguistic and talker information: An event-related fMRI and ERP study. Neuroimage. 2016;124: 536–549. doi: 10.1016/j.neuroimage.2015.08.064 26343322

33. Zhang C. Online adjustment of phonetic expectation of lexical tones to accommodate speaker variation: a combined behavioural and ERP study. Lang Cogn Neurosci. 2018;33: 175–195. doi: 10.1080/23273798.2017.1376752

34. Wong PCM, Diehl RL. Perceptual Normalization for Inter- and Intratalker Variation in Cantonese Level Tones. J Speech, Lang Hear Res. 2006;46: 413–421. doi: 10.1044/1092-4388(2003/034)

35. Bakhtiar M, Zhang C, Ki SS. Impaired processing speed in categorical perception: Speech perception of children who stutter. PLoS One. 2019;14: 1–18. doi: 10.1371/journal.pone.0216124 31026270

36. Singh L, Goh HH, Wewalaarachchi TD. Spoken word recognition in early childhood: Comparative effects of vowel, consonant and lexical tone variation. Cognition. 2015;142: 1–11. doi: 10.1016/j.cognition.2015.05.010 26010558

37. Wewalaarachchi TD, Wong LH, Singh L. Vowels, consonants, and lexical tones: Sensitivity to phonological variation in monolingual Mandarin and bilingual English–Mandarin toddlers. J Exp Child Psychol. 2017;159: 16–33. doi: 10.1016/j.jecp.2017.01.009 28266332

38. Wiener S, Turnbull R. Constraints of Tones, Vowels and Consonants on Lexical Selection in Mandarin Chinese. Lang Speech. 2016;59: 59–82. doi: 10.1177/0023830915578000 27089806

39. Matthews S, Yip V. Cantonese: A Comprehensive Grammar. Cantonese: A Comprehensive Grammar. 2018. doi: 10.4324/9780203420843

40. Yip M. Tone: Phonology. Encyclopedia of Language & Linguistics. 2006. doi: 10.1016/b0-08-044854-2/00054-7

41. Francis AL, Ciocca V, Ma L, Fenn K. Perceptual learning of Cantonese lexical tones by tone and non-tone language speakers. J Phon. 2008;36: 268–294. doi: 10.1016/j.wocn.2007.06.005

42. Guion SG, Pederson E. Investigating the role of attention in phonetic learning. 2014; 57–77. doi: 10.1075/lllt.17.09gui

43. Gandour JT. Tone perception in far eastern-languages. J Phon. 1983;11: 149–175.

44. Li B, Shao J, Bao M. Effects of Phonetic Similarity in the Identification of Mandarin Tones. J Psycholinguist Res. 2017;46: 107–124. doi: 10.1007/s10936-016-9422-6 27017336

45. Qin Z, Chien Y-F, Tremblay A. Processing of word-level stress by Mandarin-speaking second language learners of English. Appl Psycholinguist. 2017;38. doi: 10.1017/S0142716416000321

46. Tremblay A, Broersma M, Coughlin CE. The functional weight of a prosodic cue in the native language predicts the learning of speech segmentation in a second language. Bilingualism. 2018;21: 640–652. doi: 10.1017/S136672891700030X

47. Francis AL, Ciocca V, Chit Ng BK. On the (non)categorical perception of lexical tones. Percept Psychophys. 2003;65: 1029–1044. doi: 10.3758/bf03194832 14674631

48. Mok PPK, Zuo D, Wong PWY. Production and perception of a sound change in progress: Tone merging in Hong Kong Cantonese. Language Variation and Change. 2013. pp. 341–370. doi: 10.1017/S0954394513000161

49. Lee KYS, Chan KTY, Lam JHS, Van Hasselt CA, Tong MCF. Lexical tone perception in native speakers of Cantonese. Int J Speech Lang Pathol. 2015;17: 53–62. doi: 10.3109/17549507.2014.898096 24780063

50. Chandrasekaran B, Sampath PD, Wong PCM. Individual variability in cue-weighting and lexical tone learning. J Acoust Soc Am. 2010;128: 456–465. doi: 10.1121/1.3445785 20649239

51. Jongman A, Qin Z, Zhang J, Sereno JA. Just noticeable differences for pitch direction, height, and slope for Mandarin and English listeners. J Acoust Soc Am. 2017;142: EL163–EL169. doi: 10.1121/1.4995526 28863605

52. Huang T, Johnson K. Language specificity in speech perception: Perception of mandarin tones by native and nonnative listeners. Phonetica. 2011; doi: 10.1159/000327392 21525779

53. Chen S, Zhu Y, Wayland R. Effects of stimulus duration and vowel quality in cross-linguistic categorical perception of pitch directions. PLoS One. 2017;12. doi: 10.1371/journal.pone.0180656 28671991

54. Chang YS, Yao Y, Huang BH. Effects of linguistic experience on the perception of high-variability non-native tones. J Acoust Soc Am. 2017;141: EL120–EL126. doi: 10.1121/1.4976037 28253645

55. Zhang K, Peng G, Li Y, Minett JW, Wang WSY. The effect of speech variability on tonal language speakers’ second language lexical tone learning. Front Psychol. 2018;9: 1–13. doi: 10.3389/fpsyg.2018.00001

56. Qin Z, Jongman A. Does Second Language Experience Modulate Perception of Tones in a Third Language? Lang Speech. 2016;59: 318–338. doi: 10.1177/0023830915590191 29924528

57. Qin Z, Mok PPK. Discrimination of Cantonese Tones by Speakers of Tone and Non-tone Languages. Kansas Work Pap Linguist. 2015; doi: 10.17161/kwpl.1808.12864

58. Leather J. Speaker normalization in perception of lexical tone. J Phon. 1983;

59. Stagray JR, Downs D. Differential Sensitivity for Frequency among Speakers of a Tone and a Nontone Language. J Chinese Linguist. 1993;

60. Zhang C, Peng G, Wang WS-Y. Unequal effects of speech and nonspeech contexts on the perceptual normalization of Cantonese level tones. J Acoust Soc Am. 2012;132: 1088–1099. doi: 10.1121/1.4731470 22894228

61. Pelzl E, Lau EF, Guo T, DeKeyser R. Advanced Second Language Learners’ Perception of Lexical Tone Contrasts. Stud Second Lang Acquis. 2019;41: 59–86. doi: 10.1017/s0272263117000444

62. Shen G, Froud K. Electrophysiological correlates of categorical perception of lexical tones by English learners of Mandarin Chinese: an ERP study. Bilingualism. 2019;22: 253–265. doi: 10.1017/S136672891800038X

63. Zou T, Chen Y, Caspers J. The developmental trajectories of attention distribution and segment-tone integration in Dutch learners of Mandarin tones. Bilingualism. 2017;20: 1017–1029. doi: 10.1017/S1366728916000791

64. Ho O, Shao J, Ou J, Law S, Zhang C. Tone Merging Patterns in Congenital Amusia in Hong Kong Cantonese. Proc Sixth Int Symp Tonal Asp Lang. 2018; 13–17.

65. Williamson VJ, Stewart L. Memory for pitch in congenital amusia: Beyond a fine-grained pitch discrimination problem. Memory. 2010;18: 657–669. doi: 10.1080/09658211.2010.501339 20706954

66. Peretz I, Coltheart M. Modularity of music processing. Nat Neurosci. 2003;6: 688–691. doi: 10.1038/nn1083 12830160

67. Zhang C, Shao J, Huang X. Deficits of congenital amusia beyond pitch: Evidence from impaired categorical perception of vowels in Cantonese-speaking congenital amusics. PLoS One. 2017;12: 1–24. doi: 10.1371/journal.pone.0183151 28829808

68. Jing S, Joanna Chor Yan M, Caicai Z. The role of talker similarity in the perceptual learning of L2 tone categories. Proc 39th Annu Meet Cogn Sci Soc. 2017;

69. Francis AL, Ciocca V. Stimulus presentation order and the perception of lexical tones in Cantonese. J Acoust Soc Am. 2003; doi: 10.1121/1.1603231 14514214

70. Macmillan NA, Creelman CD. Detection Theory: A User’s Guide: 2nd edition. Detection Theory: A User’s Guide: 2nd edition. 2004. doi: 10.4324/9781410611147

71. Baayen RH. Analyzing Linguistic Data: A Practical Introduction to Statistics Using R. Harald Baayen (2008). Socioling Stud. 2008; doi: 10.1558/sols.v2i3.471

72. Linck JA, Cunnings I. The Utility and Application of Mixed-Effects Models in Second Language Research. Lang Learn. 2015; doi: 10.1111/lang.12148

73. Tremblay A, Ransijn J. LMERConvenienceFunctions: A suite of functions to back-fit fixed effects and forward-fit random effects, as well as other miscellaneous functions. R package version 2.1. Compr R Arch Netw. 2015;

74. Kuznetsova A, Brockhoff PB, Christensen RHB. lmerTest Package: Tests in Linear Mixed Effects Models. R package version 3.0–1. J Stat Softw. 2018; doi: 10.18637/jss.v082.i13

75. Liu J, Zhang J. The effects of talker variability and variances on incidental learning of lexical tones. Proc 5th Int Symp Tonal Asp Lang (TAL 2016). 2016; 23–27.

76. Wang Y, Spence MM, Jongman A, Sereno JA. Training American listeners to perceive Mandarin tones. J Acoust Soc Am. 1999;106: 3649–3658. doi: 10.1121/1.428217 10615703

77. Chang CB, Bowles AR. Context effects on second-language learning of tonal contrasts. J Acoust Soc Am. 2015;138: 3703–3716. doi: 10.1121/1.4937612 26723326

78. Antoniou M, Wong PCM. Poor phonetic perceivers are affected by cognitive load when resolving talker variability. J Acoust Soc Am. 2015;138: 571–574. doi: 10.1121/1.4923362 26328675

79. Iverson P, Pinet M, Evans BG. Auditory training for experienced and inexperienced second-language learners: Native French speakers learning English vowels. Appl Psycholinguist. 2012;33: 145–160. doi: 10.1017/s0142716411000300

80. Iverson P, Ekanayake D, Hamann S, Sennema A, Evans BG. Category and Perceptual Interference in Second-Language Phoneme Learning: An Examination of English /w/-/v/ Learning by Sinhala, German, and Dutch Speakers. J Exp Psychol Hum Percept Perform. 2008;34: 1305–1316. doi: 10.1037/0096-1523.34.5.1305 18823213

81. Iverson P, Kuhl PK, Akahane-Yamada R, Diesch E, Tohkura Y, Kettermann A, et al. A perceptual interference account of acquisition difficulties for non-native phonemes. Cognition. 2003;87. doi: 10.1016/S0010-0277(02)00198-1

82. Guenther FH, Husain FT, Cohen MA, Shinn-Cunningham BG. Effects of categorization and discrimination training on auditory perceptual space. J Acoust Soc Am. 1999; doi: 10.1121/1.428112 10573904

The effect of overnight consolidation in the perceptual learning of non-native tonal contrasts

Souhrn

Klíčová slova:

Zdroje

PLOS One

Aktuální možnosti diagnostiky a léčby litiáz