Role of Visual Speech Cues (Cued Speech) in Foreign Language Learning by Hearing School-Age Children

Olga Grabowska-Chenczke; Piotr Francuz; Bibianna Bałaj

doi:10.18290/rpsych2023.0013

Published : 2023-10-09

Vol. 26 No. 3 (2023)

Role of Visual Speech Cues (Cued Speech) in Foreign Language Learning by Hearing School-Age Children

Olga Grabowska-Chenczke

https://orcid.org/0000-0002-1154-667X

Piotr Francuz

Bibianna Bałaj

https://orcid.org/0000-0001-5066-7493

DOI: https://doi.org/10.18290/rpsych2023.0013

Abstract

In this study, we aimed to determine the role of visual speech cues in the process of foreign ‎language learning by hearing school-age children. Our experiments used Cued Speech, a method ‎designed for people who are deaf or hard of hearing. We expected that the principles of the ‎method might also be beneficial for people with normal hearing because they may help distinguish ‎the sounds of foreign speech that are difficult to hear. This study mainly focused on the effects ‎of speech perception. We tested 126 Polish junior high school students (66 girls and 60 boys) ‎with a normal range of phonemic hearing and language aptitude. We envisaged that foreign ‎language learners using visual speech cues would achieve a higher score on a test of foreign ‎language than learners who had studied the language in the traditional manner. We also ‎formulated a hypothesis concerning the interaction of training type and training conditions on the ‎effectiveness of foreign language learning: that the difference in the effects of foreign language ‎learning between participants who received visual or executive training and typical training would ‎be more significant in the presence of auditory distractors than in their absence. We observed ‎interactions between conditions and types of training for speech sound identification. Under ‎conditions of auditory distraction, foreign language learners using Cued Speech scored ‎significantly higher than learners who had traditional training.‎

Keywords:

speech perception, foreign language learning, auditory distraction, visual speech cues, Cued Speech

Details

References

Statistics

Authors

Download files

pdf

Altmetric indicators

Cited by / Share

Licence

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

References

Alegria, J., Charlier, B. L., & Mattys, S. (1999). The role of lip-reading and cued speech in the processing of phonological information in French-educated deaf children. European Journal of Cognitive Psychology, 11(4), 451–472. https://doi.org/10.1080/095414499382255

Aparicio, M., Peigneux, P., Charlier, B., Balériaux, D., Kavec, M., & Leybaert, J. (2017). The neural basis of speech perception through lipreading and manual cues: Evidence from deaf native users of cued speech. Frontiers in Psychology, 8, Article 426. https://doi.org/10.3389/fpsyg.2017.00426

Baills, F., Suárez-González, N., González-Fuente, S., & Prieto, P. (2019). Observing and producing pitch gestures facilitates the learning of mandarin Chinese tones and words. Studies in Second Language Acquisition, 41(1), 33–58. https://doi.org/10.1017/S0272263118000074

Bayard, C., Machart, L., Strauß, A., Gerber, S., Aubanel, V., & Schwartz, J.-L. (2019). Cued speech enhances speech-in-noise perception. Journal of Deaf Studies and Deaf Education, 24(3), 223–233. https://doi.org/10.1093/deafed/enz003

Birdsong, D. (2018). Plasticity, variability and age in second language acquisition and bilingualism. Frontiers in Psychology, 9, Article 81. https://doi.org/10.3389/fpsyg.2018.00081

Bourguignon, M., Baart, M., Kapnoula, E. C., & Molinaro, N. (2020). Lip-reading enables the brain to synthesize auditory features of unknown silent speech. Journal of Neuroscience, 40(5), 1053–1065. https://doi.org/10.1523/JNEUROSCI.1101-19.2019

Cornett, R. O. (1967). Cued Speech. American Annals of the Deaf, 112, 3–13.

DeLuca, V., Miller, D., Pliatsikas, C., & Rothman, J. (2019). Brain adaptations and neurological indices of processing in adult second language acquisition: Challenges for the critical period hypothesis. In J. W. Schweiter (Ed.), The handbook of the neuroscience of multilingualism (pp. 192–218). Wiley-Blackwell. https://doi:10.1002/9781119387725.ch8

Domagała-Zyśk, E. (2013). English as a foreign language for the deaf and hard of hearing persons in Europe. Wydawnictwo KUL.

Dörnyei, Z. (2013). Motivation in second language learning. In M. Celce Murcia, D. M. Brinton, & M. A. Snow (Eds.), Teaching English as a second or foreign language (4th ed., pp. 518–531). Heinle Cengage ELT.

Elsabbagh, M., Hohenberger, A., Campos, R., Van Herwegen, J., Serres, J., de Schonen, S., Aschersleben, G., & Karmiloff-Smith, A. (2013). Narrowing perceptual sensitivity to the native language in infancy: Exogenous influences on developmental timing. Behavioral Sciences, 3(1), 120–132. https://doi.org/10.3390/bs3010120

Hannah, B., Wang, Y., Jongman, A., Sereno, J. A., Cao, J., & Nie, Y. (2017). Cross-modal association between auditory and visuospatial information in mandarin tone perception in noise by native and non-native perceivers. Frontiers in Psychology, 8, Article 2051. https://doi.org/10.3389/fpsyg.2017.02051

Hardison, D. M. (2003). Acquisition of second-language speech: Effects of visual cues, context, and talker variability. Applied Psycholinguistics, 24(4), 495–522. https://doi.org/10.1017/s0142716403000250

Hardison, D. M. (2021). Multimodal input in second-language speech processing. Language Teaching, 54(2), 206–220. https://doi.org/10.1017/S0261444820000592

Hartshorne, J. K., Tenenbaum, J. B., & Pinker, S. (2018). A critical period for second language acquisition: Evidence from 2/3 million English speakers. Cognition, 177, 263–277. https://doi.org/10.1016/j.cognition.2018.04.007

Hayes, E. A., Tiippana, K., Nicol, T. G., Sams, M., & Kraus, N. (2003). Integration of heard and seen speech: A factor in learning disabilities in children. Neuroscience Letters, 351(1), 46–50. https://doi.org/10.1016/s0304-3940(03)00971-6

Hirata, Y., & Kelly, S. D. (2010). Effects of lips and hands on auditory learning of second-language speech sounds. Journal of Speech, Language, and Hearing Research, 53(2), 298–310. https://doi.org/10.1044/1092-4388(2009/08-0243)

Hirata, Y., Kelly, S. D., Huang, J., & Manansala, M. (2014). Effects of hand gestures on auditory learning of second-language vowel length contrasts. Journal of Speech, Language, and Hearing Research, 57(6), 2090–2101. https://doi.org/10.1044/2014_

JSLHR-S-14-0049

Hoetjes, M., & van Maastricht, L. (2020). Using gesture to facilitate L2 phoneme acquisition: The importance of gesture and phoneme complexity. Frontiers in Psychology, 11, Article 575032. https://doi: 10.3389/fpsyg.2020.575032

Houston, D. M., Tincoff, R., & Jusczyk, P. W. (2003). 7.5-month-olds’ memory for words after a 1-week delay. In D. Houston, A Seidl, G.Hollich, E. Johnson, & A. Jusczyk (Eds.), Jusczyk lab final report. Retrieved September 14, 2023, from http://hincapie.psych.purdue.edu/Jusczyk/pdf/Memory.pdf

Hubbard, A. L., Wilson, S. M., Callan, D. E., & Dapretto, M. (2009). Giving speech a hand: Gesture modulates activity in auditory cortex during speech perception. Human Brain Mapping, 30(3), 1028–1037. https://doi.org/10.1002/hbm.20565

Johnson, E. K., & Jusczyk, P. W. (2001). Word segmentation by 8-month-olds: When speech cues count more than statistics. Journal of Memory and Language, 44(4), 548–567. https://doi.org/10.1006/jmla.2000.2755

Kissling, E. M. (2015). Phonetics instruction improves learners’ perception of L2 sounds. Language Teaching Research, 19(3), 254–275. https://doi.org/10.1177/1362168814541735

Krakowiak, K. (1995). Fonogesty jako narzędzie formowania języka dzieci z uszkodzonym słuchem. Wydawnictwo UMCS.

Krakowiak, K. (2006). Studia i szkice o wychowaniu dzieci z uszkodzeniami słuchu. Wydawnictwo KUL.

Krakowiak, K., & Sękowska, J. (1996). Mówimy z fonogestami. Przewodnik dla rodziców i przyjaciół dzieci i młodzieży z uszkodzonym słuchem. Wydawnictwa Szkolne i Pedagogiczne.

Krashen, S. D. (1981). Second language acquisition and second language learning. Pergamon.

Kuhl, P. K. (2010). Brain Mechanisms in Early Language Acquisition. Neuron, 67(5), 713–727. https://doi.org/10.1016/j.neuron.2010.08.038

Kuhl, P. K., Conboy, B. T., Padden, D., Nelson, T., & Pruitt, J. (2005). Early speech perception and later language development: Implications for the “Critical Period.” Language Learning and Development, 1(3–4), 237–264. https://doi.org/10.1080/15475441.2005.9671948

Kuhl, P. K., Tsao F.-M., & Liu H.-M. (2003). Foreign-language experience in infancy: Effects of short-term exposure and social interaction on phonetic learning. Proceedings of the National Academy of Sciences, 100(15), 9096–9101. https://doi.org/10.1073/pnas.1532872100

Kuliniak, R. (2013). Testy predyspozycji językowych. Instytut Badań Kompetencji.

Lehmann, S., & Murray, M. M. (2005). The role of multisensory memories in unisensory object discrimination. Brain Research. Cognitive Brain Research, 24(2), 326–334. https://doi.org/10.1016/j.cogbrainres.2005.02.005

Lewis, D., Hoover, B., Choi, S., & Stelmachowicz, P. (2010). Relationship between speech perception in noise and phonological awareness skills for children with normal hearing. Ear and Hearing, 31(6), 761–768. https://doi.org/10.1097/AUD.0b013e3181e5d188

Leybaert, J., & LaSasso, C. J. (2010). Cued speech for enhancing speech perception and first language development of children with cochlear implants. Trends in Amplification, 14(2), 96–112. https://doi.org/10.1177/1084713810375567

Leybaert, J., Aparicio, M., & Alegria, J. (2011). The role of cued speech in language development of deaf children. Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199750986.013.0020

Li, P., Baills, F., & Prieto, P. (2020). Observing and producing durational hand gestures facilitates the pronunciation of novel vowel-length contrasts. Studies in Second Language Acquisition, 42(5), 1015–1039. https://doi.org/10.1017/S0272263120000054

Li, P., Xiaotong, X, Baills F., & Prieto, P. (2021). Training non-native aspirated plosives with hand gestures: Learners’ gesture performance matters. Language, Cognition and Neuroscience, 36(10), 1313–1328. https://doi.org/10.1080/23273798.2021.1937663

Liu, D., Wang, S., Gao, Q., Dong, R., Fu, X., Pugh, E., & Hu, J. (2020). Learning a second language in adulthood changes subcortical neural encoding. Neural Plasticity, 2020, Article 8836161. https://doi.org/10.1155/2020/8836161

Logan, G. D., & Cowan, W. B. (1984). On the ability to inhibit thought and action: A theory of an act of control. Psychological Review, 91(3), 295–327. https://doi.org/10.1037/0033-295X.91.3.295

Logan, G.D. (1982). On the ability to inhibit complex actions: A stop-signal study of typewriting. Journal of Experimental Psychology: Human Perception and Performance, 8, 778–792. https://doi.org/10.1037/0096-1523.8.6.778

MacDonald, J., & McGurk, H. (1978). Visual influences on speech perception processes. Perception & Psychophysics, 24(3), 253–257. https://doi.org/10.3758/BF03206096

MacLeod, A., & Summerfield, Q. (1987). Quantifying the contribution of vision to speech perception in noise. British Journal of Audiology, 21(2), 131–141. https://doi.org/10.3109/03005368709077786

Mandel, D. R., Jusczyk, P. W., & Nelson, D. G. (1994). Does sentential prosody help infants organize and remember speech information? Cognition, 53(2), 155–180. https://doi.org/10.1016/0010-0277(94)90069-8

Mayberry, R. I., & Kluender, R. (2018). Rethinking the critical period for language: New insights into an old question from American Sign Language. Bilingualism: Language and Cognition, 21(5), 886–905. https://doi.org/10.1017/S1366728917000724

Morais, J., & Kolinsky, R. (1994). Perception and awareness in phonological processing: The case of the phoneme. Cognition, 50(1), 287–297. https://doi.org/10.1016/0010-0277(94)90032-9

Morais, J., & Kolinsky, R. (2002). Literacy effects on language and cognition. In L. Bäckman & C. von Hofsten (Eds.), Psychology at the turn of the millennium, Vol. 1: Cognitive, biological, and health perspectives (pp. 507–530). Psychology Press/Taylor & Francis.

Morais, J., & Kolinsky, R. (2017). The consequences of phonemic awareness. In B. D. Gelder & J. Morais (Eds.), Speech and reading (pp. 317–337). Routledge. https://doi.org/10.4324/9781315111810-16

Newport, E. L. (2018). Is there a critical period for L1 but not L2? Bilingualism, 21(5), 928–929. https://doi.org/10.1017/S1366728918000305

Niżegorodcew, A. (2007). Uwaga w procesie nauki języka obcego. In J. Majer & J. Nijakowska (Eds.), Język – Poznanie – Zachowanie. Studia nad psycholingwistycznymi aspektami przyswajania języka (pp. 52–67). Wydawnictwo Uniwersytetu Łódzkiego.

Pallier, C., Bosch, L., & Sebastián-Gallés, N. (1997). A limit on behavioral plasticity in speech perception. Cognition, 64(3), B9–B17. https://doi.org/10.1016/S0010-0277(97)00030-9

Pilling, M., & Thomas, S. (2011). Audiovisual cues and perceptual learning of spectrally distorted speech. Language and Speech, 54(4), 487–497. https://doi.org/10.1177/0023830911404958

Podlewska, A. (2013). Cued speech as an empirically-based approach to teaching English as a foreign language to hard of hearing students. In E. Domagała-Zyśk (Ed.), English as a foreign language for the deaf and hard of hearing persons in Europe. Wydawnictwo KUL.

Rees, R., Fitzpatrick, C., Foulkes, J., Peterson, H., & Newton, C. (2017). Can explicit training in cued speech improve phoneme identification? Deafness & Education International, 19(1), 13–21. https://doi.org/10.1080/14643154.2017.1281595

Schwartz, J.-L., Berthommier, F., & Savariaux, C. (2004). Seeing to hear better: Evidence for early audio-visual interactions in speech identification. Cognition, 93(2), B69–B78. https://doi.org/10.1016/j.cognition.2004.01.006

Sparks, R. L., & Miller, K. S. (2000). Teaching a foreign language using multisensory structured language techniques to at-risk learners: A review. Dyslexia, 6(2), 124–132. https://doi.org/10.1002/(SICI)1099-0909(200004/06)6:2<124::AID-DYS152>3.0.CO;2-3

Stevens, A. A., & Weaver, K. E. (2009). Functional characteristics of auditory cortex in the blind. Behavioural Brain Research, 196(1), 134–138. https://doi.org/10.1016/j.bbr.2008.07.041

Summerfield, Q. (1992). Lipreading and audio-visual speech perception. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 335(1273), 71–78. https://doi.org/10.1098/rstb.1992.0009

Swain, I. U., Zelazo, P. R. & Clifton, R. K. (1993). Newborn infants’ memory for speech sounds retained over 24 hours. Developmental Psychology, 29(2), 312–323. https://doi.org/10.1037/0012-1649.29.2.312

Szeląg, A., & Szymaszek, E. (2006). Test do badania słuchu fonematycznego dzieci i młodzieży. GWP.

Ungerer, J. A., Brody, L. R., & Zelazo, P. R. (1978). Long-term memory for speech in 2 to 4-week-old infants. Infant Behavior and Development, 1, 177–186. https://doi.org/10.1016/S0163-6383(78)80028-9

Werker, J. F. (2018). Perceptual beginnings to language acquisition. Applied Psycholinguistics, 39(4), 703–728.https://doi.org/10.1017/S0142716418000152

Werker, J. F., & Pegg, J. E. (1992). Infant speech perception and phonological acquisition. In C. A. Ferguson, L. Menn, & C. Stoel-Gammon (Eds.), Phonological development: Models, research, implications (pp. 131–164). Timonium.

Werker, J. F., & Tees, R. C. (1984). Cross-language speech perception: Evidence for perceptual reorganization during the first year of life. Infant Behavior & Development, 7(1), 49–63. https://doi.org/10.1016/S0163-6383(84)80022-3

Werker, J. F., & Tees, R. C. (2005). Speech perception as a window for understanding plasticity and commitment in language systems of the brain. Developmental Psychobiology, 46(3), 233–251. https://doi.org/10.1002/dev.20060

White, E., Hutka, S., Williams, L., & Moreno, S. (2013). Learning, neural plasticity and sensitive periods: Implications for language acquisition, music training and transfer across the lifespan. Frontiers in Systems Neuroscience, 7, Article 90. https://www.frontiersin.org/articles/10.3389/fnsys.2013.00090

White-Schwoch, T., Woodruff Carr, K., Thompson, E. C., Anderson, S., Nicol, T., Bradlow, A. R., Zecker, S. G., & Kraus, N. (2015). Auditory processing in noise: A preschool biomarker for literacy. PLoS Biology, 13(7), Article e1002196. https://doi.org/10.1371/journal.pbio.1002196

Woodhouse, L., Hickson, L., & Dodd, B. (2009). Review of visual speech perception by hearing and hearing-impaired people: Clinical implications. International Journal of Language & Communication Disorders, 44(3), 253–270. https://doi.org/10.1080/13682820802090281

Xiaotong, X., Li, P., Baills, F., & Prieto, P. (2020). Hand gestures facilitate the acquisition of novel phonemic contrasts when they appropriately mimic target phonetic features. Journal of Speech, Language, and Hearing Research, 63(11), 3571–3585. https://doi.org/10.1044/2020_JSLHR-20-00084.

Zhen, A., Van Hedger, S., Heald, S., Goldin-Meadow, S., & Tian, X. (2019). Manual directional gestures facilitate cross-modal perceptual learning. Cognition, 187, 178–187. https://doi.org/10.1016/j.cognition.2019.03.004