Aspects of visual speech in Arabic

Summary

A lipreading recognition experiment on Arabic where a set of consonant-vowel stimuli were presented as visual-only speech and participants were asked to report what they recognized, shows that some of the phonemes were well discriminated, however, for others it depends on the context.

Keywords

Vowel, Confusion, Consonant, Speech recognition, Computer science

References

Real-time analysis-synthesis and intelligibility of talking facesBertrand Le Goff, Thierry Guiard‐Marigny, Michael Cohen — 1994
Speech perception without hearingLynne E. Bernstein, Paula E. Tucker, Marilyn E. Demorest — 2000
Training Baldi to be multilingual: A case study for an Arabic BadrSlim Ouni, Michael M. Cohen, Dominic W. Massaro — 2005
Visual contribution to speech intelligibility in noiseWilliam H. Sumby, Irwin Pollack — 1954
Speechreading and the structure of the lexicon: computationally modeling the effects of reduced phonetic distinctiveness on lexical uniqueness.Edward T. Auer, Lynne E. Bernstein — 1997
Perceiving Talking Faces: From Speech Perception to a Behavioral PrincipleGeoff Plant — 1999
Confusions among visually perceived consonants.Cletus G. Fisher — 1968
Effects of phonetic context on audio-visual intelligibility of French.Christian Benoı̂t, Tayeb Mohamadi, Sonia Kandel — 1994
Use of Visual Information for Phonetic PerceptionQuentin Summerfield — 1979
Visual Contribution to Speech Perception: Measuring the Intelligibility of Animated Talking HeadsSlim Ouni, Michael M. Cohen, Hope Ishak — 2007
Similarity structure in perceptual and physical measures for visual Consonants across talkersJintao Jiang, Abeer Alwan, Lyme E. Bernstein — 2002
Arabic Phonology: An Acoustical and Physiological InvestigationDean H. Obrecht — 1970
Speechreading (lipreading).Andreas Markides — 1979
Mufaxxama – the ‘Emphatic’ Phonemes in ArabicR. Jakobson — 2002

Cited by

Arabic pharyngeals in visual speechSlim Ouni, Kaïs Ouni — 2007
Audiovisual perception of gemination and pharyngealization in ArabicMark Scott, Ali Idrissi — 2018
Project-Team Parole Analysis, Perception and speech recognitionM. Kuhlmann, Anne-Claire Bonneau, Christophe Cerisara — 2005

Related papers

Failure of selective attention to phonetic segments in consonant-vowel syllablesCharles Cresson Wood, Ruth S. Day — 1975
School-Aged Children’s Production of /s/ and /r/ Consonant ClustersSharynne McLeod, Joanne Arciuli — 2009
한국어 용언 어간 말 자음군의 발음 연구: 서울경기 지역과 충남지역 출신의 20대 화자를 중심으로박시균 — 2011
Элизия стыковых согласных в спонтанной речи британцев и американцевК С Куликова — 2012
A Study on the Pronunciation of English Consonant Clusters Based on Error AnalysisJin Seok Kim — 2003
“Same‐Different” Reaction Times to Consonants, Vowels, and SyllablesDavid B. Pisoni, Jeffrey Tash — 1974
Learning to spell and learning phonology: the spelling of consonant clusters in KiswahiliKatie Alcock, Damaris Ngorosho — 2007
Variation in stem-final consonant clusters in Korean nominal inflectionJi Yea Kim — 2022