The contribution of the visual modality to vowel perception in native and non-native speakers

This study examines how visual cues impact the intelligibility of foreign-accented speech for native listeners. English CVC words with vowels involving salient (e.g., lip-spreading for /iː/) and non-salient visual cues (neutral lips for /ɪ/) produced by two French speakers and a native English contr...

Descripción completa

Detalles Bibliográficos
Autores: Rankin, Sinéad M., Solé, Maria-Josep|||0000-0002-2752-8767
Tipo de recurso: artículo
Fecha de publicación:2025
País:España
Institución:Universitat Autònoma de Barcelona
Repositorio:Dipòsit Digital de Documents de la UAB
Idioma:inglés
OAI Identifier:oai:ddd.uab.cat:310084
Acceso en línea:https://ddd.uab.cat/record/310084
https://dx.doi.org/urn:doi:10.1016/j.wocn.2024.101375
Access Level:acceso abierto
Palabra clave:Visual cues
Vowels
Intelligibility
L2 speech
French
English
Speech in noise
Descripción
Sumario:This study examines how visual cues impact the intelligibility of foreign-accented speech for native listeners. English CVC words with vowels involving salient (e.g., lip-spreading for /iː/) and non-salient visual cues (neutral lips for /ɪ/) produced by two French speakers and a native English control, were presented to native English listeners who identified the word heard. Tokens were presented in both auditory-only and audiovisual (AV) mode in cafeteria noise at -15 dB SNR. The visual cues analysed were lip spreading, lip rounding, jaw opening and tongue frontness in vowels, as well as lip-rounding in schwa. Visually salient cues improved vowel intelligibility, compared to non-visual cues, but the audiovisual benefit varied across vowel features and speaker groups. The presence of lip-spreading for /iː/ (vs /ɪ/) and jaw-opening for /æ/ (vs /ɪ/) enhanced intelligibility (i.e., larger AV benefit) for both speaker groups. However, compared to the English speaker, lip-rounding in /ɔː/ and /ə/ produced by French speakers (likely accompanied by lip protrusion) had a smaller, or negative AV benefit. These results suggest that the influence of L1 gestures on L2 production may reduce or negatively affect intelligibility. Furthermore, French productions of /ɑː/ exhibited unusually high AV benefits, suggesting an extreme jaw-opening for this vowel in an attempt to distinguish between L2 contrasts (/æ ʌ ɑː/) not present in the L1.